DaemonForums  

Go Back   DaemonForums > OpenBSD > OpenBSD Security

OpenBSD Security Functionally paranoid!

Reply
 
Thread Tools Display Modes
  #1   (View Single Post)  
Old 4th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default OpenBSD CARP/PF

I have two openbsd 4.9 machines - running PF with CARP fail-over. Everything works as intended. If i reboot one machine, the other takes over and vice-versa.

However, my secondary firewall briefly takes over as master for some (not all) interfaces about every three hours, and then it will try to failover for no apparent reason.

If i reboot, it seems to be stable for a day or so, before starting over the behavior. Has anyone else experienced this or know where i should start looking for the answer. Its frustrating because all my SSH sessions going thru the firewall get reset.

Code:
Nov  4 10:32:50 pestilence2 /bsd: carp34: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp30: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp31: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp33: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp27: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp28: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp29: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp16: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp4: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp5: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp32: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp35: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp8: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp25: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp6: state transition: BACKUP -> MASTER
Nov  4 10:32:50 pestilence2 /bsd: carp1: state transition: BACKUP -> MASTER
Nov  4 10:33:10 pestilence2 /bsd: carp7: state transition: BACKUP -> MASTER
Nov  4 10:33:30 pestilence2 /bsd: carp8: state transition: MASTER -> BACKUP
Nov  4 10:33:50 pestilence2 /bsd: carp9: state transition: BACKUP -> MASTER
Nov  4 10:34:31 pestilence2 /bsd: carp16: state transition: MASTER -> BACKUP
Nov  4 10:34:31 pestilence2 /bsd: carp4: state transition: MASTER -> BACKUP
Nov  4 10:34:31 pestilence2 /bsd: carp5: state transition: MASTER -> BACKUP
Nov  4 10:34:31 pestilence2 /bsd: carp6: state transition: MASTER -> BACKUP
Nov  4 10:34:31 pestilence2 /bsd: carp7: state transition: MASTER -> BACKUP
Nov  4 10:34:31 pestilence2 /bsd: carp9: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp34: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp30: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp31: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp33: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp27: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp28: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp29: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp1: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp32: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp25: state transition: MASTER -> BACKUP
Nov  4 10:34:51 pestilence2 /bsd: carp35: state transition: MASTER -> BACKUP
Reply With Quote
  #2   (View Single Post)  
Old 4th November 2011
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

Hello and welcome.

Unfortunately there is not enough information in your post for us to give you clear guidance. You have only posted a fragment from /var/log/messages for one of your two firewalls. We know nothing about your network topology or your OpenBSD architecture(s), or if there was any information captured in other logs on pestilence2, or perhaps on its twin, famine1. We don't know how your carp(4) interfaces are configured, nor do we know about any applicable sysctl settings. We don't know if the network stacks have recorded physical layer errors and packet retries, nor do we know if there are any network stack statistics that might help isolate and identify the root cause.

To collect that information shouldn't be too difficult. From each machine, collect and post each dmesg(8). If the machines are twins, compare the dmesg outputs with diff(1) to confirm they produce identical output before posting only a single dmesg. If not, post both. Review all syslogs to see if any additional information other than your one excerpt has been produced, and post that as well. Granted, none may have been, but it's worth looking into. Posting your hostname.carp* files will help us with settings like advskew, and if you have any changes you made to sysctl.conf, post those too.

Lastly, see if netstat -in and netstat -ss produce anything of note on each of the machines.

While it's possible none of us will see anything, this is still worth the effort. Otherwise, all we can do is a) recommend upgrading to 5.0-release or -current to see if your problem disappears, or b) make wild guesses.
Reply With Quote
  #3   (View Single Post)  
Old 4th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default

Sorry for the skimpy post. As I said, it really is working quite well, i used calomel.org fine how-to posts to put it all together. I was hoping someone might have a similar situation and knew a place to look. Heh, but I suppose if that was the issue, Google would have picked it up for me =).

It "feels" like a pf sync hiccup. And there are no corresponding failover state change messages on pestilence1.

You did give me a few commands to chase down. I'll see what they produce and spend some time giving a more in-depth config/architecture/sysctl and repost. I do have 30 carp interfaces on this puppy and a couple vlan's as well. so i'll do my best to pair it down a bit as to not overload with info.

Thanks! I'll be back with more info....unless someone has a "Yah this happened to me once" story.

Last edited by nekron99; 4th November 2011 at 11:27 PM. Reason: posters remorse
Reply With Quote
  #4   (View Single Post)  
Old 4th November 2011
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

If you are looking for a "yeah this happened to me, here's what I did to fix it" you are welcome to post to OpenBSD's misc@ mailing list. It is a much larger audience of OpenBSD users, and includes many of the developers.

You can find guidelines here: http://www.openbsd.org/mail.html and, should you wish to post a formal problem report to bugs@ (since the PR database is non-operational) you can find additional guidance here: http://www.openbsd.org/report.html

Please note that even for an informal "Hey I'm seeing odd behavior, have you seen this too?" post, significant documentation of the problem is needed, including things such as I recommended.

And you will find that the misc@ community frown on third party support and "howto" information, from any source that has not been vetted by developers. If you didn't find it in the man pages, the FAQ, or the OpenBSD Journal, it will be considered likely to be incorrect, misleading, or out of date. Often with reason. In my experience that has the case more often than not, though I have no knowledge of the particular guide you were using. We strive to be a kinder and gentler subset of the community. Even so, we here will recommend great care when using unofficial recommendations or guidance, even when the source is ... us.
Reply With Quote
  #5   (View Single Post)  
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default follow up - more data {part 01}

Topology

Code:
 
            I  N   T  E  R  N  E  T


   [bge2]                                 [bge2]
Pestilence01 [bge0] ---pfsync--- [bge0]  Pestilence02
   [bge1]+[vlans]                      [bge1] + [vlans]

            P R I V A T E    L A N
Hardware: two identical Dell PE 850. 2 on-board NIC, +1 Nic Card, 512 meg mem, 80gig HD, two dual core 2.80ghz

Pestilence 01 dmsg
You see the boot here, and the ultimate wresting of control from the backup. no corresponding failover logs after that.
Code:
OpenBSD 4.9 (GENERIC.MP) #794: Wed Mar  2 07:19:02 MST 2011
    deraadt@i386.openbsd.org:/usr/src/sys/arch/i386/compile/GENERIC.MP
cpu0: Intel(R) Pentium(R) 4 CPU 2.80GHz ("GenuineIntel" 686-class) 2.81 GHz
cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,CX16,xTPR
real mem  = 536182784 (511MB)
avail mem = 517255168 (493MB)
mainbus0 at root
bios0 at mainbus0: AT/286+ BIOS, date 10/12/05, BIOS32 rev. 0 @ 0xffe90, SMBIOS rev. 2.3 @ 0xfa460 (48 entries)
bios0: vendor Dell Computer Corporation version "A02" date 10/12/2005
bios0: Dell Computer Corporation PowerEdge 850
acpi0 at bios0: rev 0
acpi0: sleep states S0 S4 S5
acpi0: tables DSDT FACP APIC SPCR HPET MCFG
acpi0: wakeup devices PCI0(S5) PES1(S5) PEP0(S5) PXHA(S5) PEP1(S5) PEP2(S5) PCIS(S5)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: apic clock running at 200MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Pentium(R) 4 CPU 2.80GHz ("GenuineIntel" 686-class) 2.81 GHz
cpu1: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,CX16,xTPR
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
ioapic0: misconfigured as apic 0, remapped to apid 2
ioapic1 at mainbus0: apid 3 pa 0xfec10000, version 20, 24 pins
ioapic1: misconfigured as apic 0, remapped to apid 3
acpihpet0 at acpi0: 14318179 Hz
acpimcfg0 at acpi0 addr 0xf0000000, bus 0-63
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 1 (PES1)
acpiprt2 at acpi0: bus 2 (PEP0)
acpiprt3 at acpi0: bus 3 (PXHA)
acpiprt4 at acpi0: bus 4 (PEP1)
acpiprt5 at acpi0: bus 5 (PEP2)
acpiprt6 at acpi0: bus 6 (PCIS)
acpicpu0 at acpi0
acpicpu1 at acpi0
bios0: ROM list: 0xc0000/0x8000 0xec000/0x4000!
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0: configuration mode 1 (bios)
pchb0 at pci0 dev 0 function 0 "Intel E7230 Host" rev 0x00
ppb0 at pci0 dev 1 function 0 "Intel E7230 PCIE" rev 0x00: apic 2 int 16 (irq 0)
pci1 at ppb0 bus 1
bge0 at pci1 dev 0 function 0 "Broadcom BCM5721" rev 0x11, BCM5750 B1 (0x4101): apic 2 int 16 (irq 5), address 00:10:18:14:7b:ed
brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0
ppb1 at pci0 dev 28 function 0 "Intel 82801GB PCIE" rev 0x01
pci2 at ppb1 bus 2
ppb2 at pci2 dev 0 function 0 "Intel PCIE-PCIE" rev 0x09
pci3 at ppb2 bus 3
ppb3 at pci0 dev 28 function 4 "Intel 82801G PCIE" rev 0x01
pci4 at ppb3 bus 4
bge1 at pci4 dev 0 function 0 "Broadcom BCM5721" rev 0x11, BCM5750 B1 (0x4101): apic 2 int 16 (irq 5), address 00:13:72:3b:d5:33
brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0
ppb4 at pci0 dev 28 function 5 "Intel 82801G PCIE" rev 0x01
pci5 at ppb4 bus 5
bge2 at pci5 dev 0 function 0 "Broadcom BCM5721" rev 0x11, BCM5750 B1 (0x4101): apic 2 int 17 (irq 3), address 00:13:72:3b:d5:34
brgphy2 at bge2 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0
uhci0 at pci0 dev 29 function 0 "Intel 82801GB USB" rev 0x01: apic 2 int 20 (irq 11)
uhci1 at pci0 dev 29 function 1 "Intel 82801GB USB" rev 0x01: apic 2 int 21 (irq 10)
uhci2 at pci0 dev 29 function 2 "Intel 82801GB USB" rev 0x01: apic 2 int 22 (irq 6)
ehci0 at pci0 dev 29 function 7 "Intel 82801GB USB" rev 0x01: apic 2 int 20 (irq 11)
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ppb5 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xe1
pci6 at ppb5 bus 6
vga1 at pci6 dev 5 function 0 "XGI Technology Volari Z7" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
ichpcib0 at pci0 dev 31 function 0 "Intel 82801GB LPC" rev 0x01: PM disabled
pciide0 at pci0 dev 31 function 1 "Intel 82801GB IDE" rev 0x01: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 ignored (disabled)
pciide0: channel 1 ignored (disabled)
pciide1 at pci0 dev 31 function 2 "Intel 82801GB SATA" rev 0x01: DMA, channel 0 configured to native-PCI, channel 1 configured to native-PCI
pciide1: using apic 2 int 20 (irq 11) for native-PCI interrupt
wd0 at pciide1 channel 0 drive 0: <ST380013AS>
wd0: 16-sector PIO, LBA48, 76293MB, 156250000 sectors
wd0(pciide1:0:0): using PIO mode 4, Ultra-DMA mode 6
ichiic0 at pci0 dev 31 function 3 "Intel 82801GB SMBus" rev 0x01: polling
iic0 at ichiic0
adt0 at iic0 addr 0x2e: lm96000 rev 0x68
spdmem0 at iic0 addr 0x50: 256MB DDR2 SDRAM ECC PC2-5300CL5
spdmem1 at iic0 addr 0x52: 256MB DDR2 SDRAM ECC PC2-5300CL5
usb1 at uhci0: USB revision 1.0
uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb2 at uhci1: USB revision 1.0
uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1
usb3 at uhci2: USB revision 1.0
uhub3 at usb3 "Intel UHCI root hub" rev 1.00/1.00 addr 1
isa0 at ichpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
mtrr: Pentium Pro MTRR support
vscsi0 at root
scsibus0 at vscsi0: 256 targets
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
carp: pfsync0 demoted group carp by 1 to 129 (pfsync bulk start)
carp: pfsync0 demoted group pfsync by 1 to 1 (pfsync bulk start)
carp: pfsync0 demoted group carp by -1 to 0 (pfsync bulk done)
carp: pfsync0 demoted group pfsync by -1 to 0 (pfsync bulk done)
carp23: state transition: BACKUP -> MASTER
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp24: state transition: BACKUP -> MASTER
carp17: state transition: BACKUP -> MASTER
carp18: state transition: BACKUP -> MASTER
carp19: state transition: BACKUP -> MASTER
carp10: state transition: BACKUP -> MASTER
carp11: state transition: BACKUP -> MASTER
carp12: state transition: BACKUP -> MASTER
carp13: state transition: BACKUP -> MASTER
carp14: state transition: BACKUP -> MASTER
carp15: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp2: state transition: BACKUP -> MASTER
carp20: state transition: BACKUP -> MASTER
carp21: state transition: BACKUP -> MASTER
carp22: state transition: BACKUP -> MASTER
carp26: state transition: BACKUP -> MASTER
carp3: state transition: BACKUP -> MASTER
Pestilence 02 dmsg - up 13 days - attempted to fail over so often, the dmesgs have rolled over.
Code:
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp35: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp1: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp6: state transition: BACKUP -> MASTER
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp1: state transition: MASTER -> BACKUP
carp16: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp34: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp1: state transition: MASTER -> BACKUP
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp6: state transition: MASTER -> BACKUP
carp7: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP
carp34: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp1: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp6: state transition: BACKUP -> MASTER
carp1: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP

Sysctl (identical on each machine)
Code:
# cat /etc/sysctl.conf  | grep -v \#
net.inet.ip.forwarding=1
net.inet.carp.preempt=1
net.inet.carp.log=3

Pestilence 01 – ifconfig –a
Code:
# ifconfig  
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33200
        priority: 0
        groups: lo
        inet 127.0.0.1 netmask 0xff000000
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:10:18:14:7b:ed
        priority: 0
        media: Ethernet 1000baseT full-duplex
        status: active
        inet 192.168.1.1 netmask 0xfffffffc broadcast 192.168.1.3
        inet6 fe80::210:18ff:fe14:7bed%bge0 prefixlen 64 scopeid 0x1
bge1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        media: Ethernet 100baseTX full-duplex
        status: active
        inet 10.0.206.2 netmask 0xffffff00 broadcast 10.0.206.255
        inet6 fe80::213:72ff:fe3b:d533%bge1 prefixlen 64 scopeid 0x2
bge2: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:34
        priority: 0
        groups: egress
        media: Ethernet 100baseTX full-duplex
        status: active
        inet 2.3.1.71 netmask 0xffffffc0 broadcast 2.3.1.127
        inet6 fe80::213:72ff:fe3b:d534%bge2 prefixlen 64 scopeid 0x3
enc0: flags=0<>
        priority: 0
        groups: enc
        status: active
vlan27: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 27 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan27 prefixlen 64 scopeid 0x6
        inet 10.0.203.2 netmask 0xfffffff8 broadcast 10.0.203.7
vlan28: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 28 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan28 prefixlen 64 scopeid 0x7
        inet 10.0.203.10 netmask 0xfffffff8 broadcast 10.0.203.15
vlan29: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 29 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan29 prefixlen 64 scopeid 0x8
        inet 10.0.203.18 netmask 0xfffffff8 broadcast 10.0.203.23
vlan30: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 30 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan30 prefixlen 64 scopeid 0x9
        inet 10.0.203.26 netmask 0xfffffff8 broadcast 10.0.203.31
vlan31: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        description: 
        priority: 0
        vlan: 31 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan31 prefixlen 64 scopeid 0xa
        inet 10.0.203.34 netmask 0xfffffff8 broadcast 10.0.203.39
vlan32: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 32 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan32 prefixlen 64 scopeid 0xb
        inet 10.0.203.42 netmask 0xfffffff8 broadcast 10.0.203.47
vlan33: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 33 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan33 prefixlen 64 scopeid 0xc
        inet 10.0.203.50 netmask 0xfffffff8 broadcast 10.0.203.55
vlan34: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 34 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan34 prefixlen 64 scopeid 0xd
        inet 10.0.203.58 netmask 0xfffffff8 broadcast 10.0.203.63
vlan35: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:d5:33
        priority: 0
        vlan: 35 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:d533%vlan35 prefixlen 64 scopeid 0xe
        inet 10.0.203.66 netmask 0xfffffff0 broadcast 10.0.203.79
pfsync0: flags=41<UP,RUNNING> mtu 1500
        priority: 0
        pfsync: syncdev: bge0 maxupd: 128 defer: off
        groups: carp pfsync
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33200
        priority: 0
        groups: pflog
carp1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:01
        priority: 0
        carp: MASTER carpdev bge1 vhid 1 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:101%carp1 prefixlen 64 scopeid 0xf
        inet 10.0.206.1 netmask 0xffffff00 broadcast 10.0.206.255
carp10: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0a
        priority: 0
        carp: MASTER carpdev bge2 vhid 10 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10a%carp10 prefixlen 64 scopeid 0x10
        inet 2.3.1.79 netmask 0xffffffc0 broadcast 2.3.1.127
carp11: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0b
        priority: 0
        carp: MASTER carpdev bge2 vhid 11 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10b%carp11 prefixlen 64 scopeid 0x11
        inet 2.3.1.105 netmask 0xffffffc0 broadcast 2.3.1.127
carp12: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0c
        priority: 0
        carp: MASTER carpdev bge2 vhid 12 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10c%carp12 prefixlen 64 scopeid 0x12
        inet 2.3.1.78 netmask 0xffffffc0 broadcast 2.3.1.127
carp13: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0d
        priority: 0
        carp: MASTER carpdev bge2 vhid 13 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10d%carp13 prefixlen 64 scopeid 0x13
        inet 2.3.1.106 netmask 0xffffffc0 broadcast 2.3.1.127
carp14: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0e
        priority: 0
        carp: MASTER carpdev bge2 vhid 14 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10e%carp14 prefixlen 64 scopeid 0x14
        inet 2.3.1.77 netmask 0xffffffc0 broadcast 2.3.1.127
carp15: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0f
        priority: 0
        carp: MASTER carpdev bge2 vhid 15 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:10f%carp15 prefixlen 64 scopeid 0x15
        inet 2.3.1.107 netmask 0xffffffc0 broadcast 2.3.1.127
carp16: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:10
        priority: 0
        carp: MASTER carpdev bge2 vhid 16 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:110%carp16 prefixlen 64 scopeid 0x16
        inet 2.3.1.108 netmask 0xffffffc0 broadcast 2.3.1.127
carp17: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:11
        priority: 0
        carp: MASTER carpdev bge2 vhid 17 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:111%carp17 prefixlen 64 scopeid 0x17
        inet 2.3.1.109 netmask 0xffffffc0 broadcast 2.3.1.127
carp18: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:12
        priority: 0
        carp: MASTER carpdev bge2 vhid 18 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:112%carp18 prefixlen 64 scopeid 0x18
        inet 2.3.1.110 netmask 0xffffffc0 broadcast 2.3.1.127
carp19: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:13
        priority: 0
        carp: MASTER carpdev bge2 vhid 19 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:113%carp19 prefixlen 64 scopeid 0x19
        inet 2.3.1.111 netmask 0xffffffc0 broadcast 2.3.1.127
carp2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:02
        priority: 0
        carp: MASTER carpdev bge2 vhid 2 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:102%carp2 prefixlen 64 scopeid 0x1a
        inet 2.3.1.68 netmask 0xffffffc0 broadcast 2.3.1.127
carp20: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:14
        priority: 0
        carp: MASTER carpdev bge2 vhid 20 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:114%carp20 prefixlen 64 scopeid 0x1b
        inet 2.3.1.112 netmask 0xffffffc0 broadcast 2.3.1.127
carp21: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:15
        priority: 0
        carp: MASTER carpdev bge2 vhid 21 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:115%carp21 prefixlen 64 scopeid 0x1c
        inet 2.3.1.113 netmask 0xffffffc0 broadcast 2.3.1.127
carp22: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:16
        priority: 0
        carp: MASTER carpdev bge2 vhid 22 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:116%carp22 prefixlen 64 scopeid 0x1d
        inet 2.3.1.114 netmask 0xffffffc0 broadcast 2.3.1.127
carp23: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:17
        priority: 0
        carp: MASTER carpdev bge2 vhid 23 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:117%carp23 prefixlen 64 scopeid 0x1e
        inet 2.3.1.115 netmask 0xffffffc0 broadcast 2.3.1.127
carp24: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:18
        priority: 0
        carp: MASTER carpdev bge2 vhid 24 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:118%carp24 prefixlen 64 scopeid 0x1f
        inet 2.3.1.116 netmask 0xffffffc0 broadcast 2.3.1.127
carp25: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:19
        priority: 0
        carp: MASTER carpdev bge2 vhid 25 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:119%carp25 prefixlen 64 scopeid 0x20
        inet 2.3.1.117 netmask 0xffffffc0 broadcast 2.3.1.127
carp26: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1a
        priority: 0
        carp: MASTER carpdev bge2 vhid 26 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11a%carp26 prefixlen 64 scopeid 0x21
        inet 2.3.1.118 netmask 0xffffffc0 broadcast 2.3.1.127
carp27: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1b
        priority: 0
        carp: MASTER carpdev vlan27 vhid 27 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11b%carp27 prefixlen 64 scopeid 0x22
        inet 10.0.203.1 netmask 0xfffffff8 broadcast 10.0.203.7
carp28: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1c
        priority: 0
        carp: MASTER carpdev vlan28 vhid 28 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11c%carp28 prefixlen 64 scopeid 0x23
        inet 10.0.203.9 netmask 0xfffffff8 broadcast 10.0.203.15
carp29: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1d
        priority: 0
        carp: MASTER carpdev vlan29 vhid 29 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11d%carp29 prefixlen 64 scopeid 0x24
        inet 10.0.203.17 netmask 0xfffffff8 broadcast 10.0.203.23
carp3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:03
        priority: 0
        carp: MASTER carpdev bge2 vhid 3 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:103%carp3 prefixlen 64 scopeid 0x25
        inet 2.3.1.80 netmask 0xffffffc0 broadcast 2.3.1.127
carp30: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1e
        priority: 0
        carp: MASTER carpdev vlan30 vhid 30 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11e%carp30 prefixlen 64 scopeid 0x26
        inet 10.0.203.25 netmask 0xfffffff8 broadcast 10.0.203.31
carp31: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1f
        priority: 0
        carp: MASTER carpdev vlan31 vhid 31 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:11f%carp31 prefixlen 64 scopeid 0x27
        inet 10.0.203.33 netmask 0xfffffff8 broadcast 10.0.203.39
carp32: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:20
        priority: 0
        carp: MASTER carpdev vlan32 vhid 32 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:120%carp32 prefixlen 64 scopeid 0x28
        inet 10.0.203.41 netmask 0xfffffff8 broadcast 10.0.203.47
carp33: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:21
        priority: 0
        carp: MASTER carpdev vlan33 vhid 33 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:121%carp33 prefixlen 64 scopeid 0x29
        inet 10.0.203.49 netmask 0xfffffff8 broadcast 10.0.203.55
carp34: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:22
        priority: 0
        carp: MASTER carpdev vlan34 vhid 34 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:122%carp34 prefixlen 64 scopeid 0x2a
        inet 10.0.203.57 netmask 0xfffffff8 broadcast 10.0.203.63
carp35: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:23
        priority: 0
        carp: MASTER carpdev vlan35 vhid 35 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:123%carp35 prefixlen 64 scopeid 0x2b
        inet 10.0.203.65 netmask 0xfffffff0 broadcast 10.0.203.79
carp4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:04
        priority: 0
        carp: MASTER carpdev bge2 vhid 4 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:104%carp4 prefixlen 64 scopeid 0x2c
        inet 2.3.1.90 netmask 0xffffffc0 broadcast 2.3.1.127
carp5: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:05
        priority: 0
        carp: MASTER carpdev bge2 vhid 5 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:105%carp5 prefixlen 64 scopeid 0x2d
        inet 2.3.1.100 netmask 0xffffffc0 broadcast 2.3.1.127
carp6: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:06
        priority: 0
        carp: MASTER carpdev bge2 vhid 6 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:106%carp6 prefixlen 64 scopeid 0x2e
        inet 2.3.1.101 netmask 0xffffffc0 broadcast 2.3.1.127
carp7: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:07
        priority: 0
        carp: MASTER carpdev bge2 vhid 7 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:107%carp7 prefixlen 64 scopeid 0x2f
        inet 2.3.1.102 netmask 0xffffffc0 broadcast 2.3.1.127
carp8: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:08
        priority: 0
        carp: MASTER carpdev bge2 vhid 8 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:108%carp8 prefixlen 64 scopeid 0x30
        inet 2.3.1.103 netmask 0xffffffc0 broadcast 2.3.1.127
carp9: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:09
        priority: 0
        carp: MASTER carpdev bge2 vhid 9 advbase 20 advskew 0
        groups: carp
        status: master
        inet6 fe80::200:5eff:fe00:109%carp9 prefixlen 64 scopeid 0x31
        inet 2.3.1.104 netmask 0xffffffc0 broadcast 2.3.1.127

Last edited by nekron99; 7th November 2011 at 08:47 PM.
Reply With Quote
  #6   (View Single Post)  
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default follow up - more data {part 02}

Pestilence 02 – ifconfig –a
Code:
# ifconfig -a
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33200
        priority: 0
        groups: lo
        inet 127.0.0.1 netmask 0xff000000
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:10:18:14:8a:6a
        priority: 0
        media: Ethernet 1000baseT full-duplex (1000baseT full-duplex,master)
        status: active
        inet 192.168.1.2 netmask 0xfffffffc broadcast 192.168.1.3
        inet6 fe80::210:18ff:fe14:8a6a%bge0 prefixlen 64 scopeid 0x1
bge1: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        media: Ethernet 100baseTX full-duplex
        status: active
        inet 10.0.206.3 netmask 0xffffff00 broadcast 10.0.206.255
        inet6 fe80::213:72ff:fe3b:efac%bge1 prefixlen 64 scopeid 0x2
bge2: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ad
        priority: 0
        groups: egress
        media: Ethernet 100baseTX full-duplex
        status: active
        inet 2.3.1.72 netmask 0xffffffc0 broadcast 2.3.1.127
        inet6 fe80::213:72ff:fe3b:efad%bge2 prefixlen 64 scopeid 0x3
enc0: flags=0<>
        priority: 0
        groups: enc
        status: active
vlan27: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 27 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan27 prefixlen 64 scopeid 0x6
        inet 10.0.203.3 netmask 0xfffffff8 broadcast 10.0.203.7
vlan28: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 28 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan28 prefixlen 64 scopeid 0x7
        inet 10.0.203.11 netmask 0xfffffff8 broadcast 10.0.203.15
vlan29: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 29 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan29 prefixlen 64 scopeid 0x8
        inet 10.0.203.19 netmask 0xfffffff8 broadcast 10.0.203.23
vlan30: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 30 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan30 prefixlen 64 scopeid 0x9
        inet 10.0.203.27 netmask 0xfffffff8 broadcast 10.0.203.31
vlan31: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 31 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan31 prefixlen 64 scopeid 0xa
        inet 10.0.203.35 netmask 0xfffffff8 broadcast 10.0.203.39
vlan32: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 32 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan32 prefixlen 64 scopeid 0xb
        inet 10.0.203.43 netmask 0xfffffff8 broadcast 10.0.203.47
vlan33: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 33 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan33 prefixlen 64 scopeid 0xc
        inet 10.0.203.51 netmask 0xfffffff8 broadcast 10.0.203.55
vlan34: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 34 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan34 prefixlen 64 scopeid 0xd
        inet 10.0.203.59 netmask 0xfffffff8 broadcast 10.0.203.63
vlan35: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:13:72:3b:ef:ac
        priority: 0
        vlan: 35 priority: 0 parent interface: bge1
        groups: vlan
        status: active
        inet6 fe80::213:72ff:fe3b:efac%vlan35 prefixlen 64 scopeid 0xe
        inet 10.0.203.67 netmask 0xfffffff0 broadcast 10.0.203.79
pfsync0: flags=41<UP,RUNNING> mtu 1500
        priority: 0
        pfsync: syncdev: bge0 maxupd: 128 defer: off
        groups: carp pfsync
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33200
        priority: 0
        groups: pflog
carp1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:01
        priority: 0
        carp: BACKUP carpdev bge1 vhid 1 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:101%carp1 prefixlen 64 scopeid 0xf
        inet 10.0.206.1 netmask 0xffffff00 broadcast 10.0.206.255
carp10: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0a
        priority: 0
        carp: BACKUP carpdev bge2 vhid 10 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10a%carp10 prefixlen 64 scopeid 0x10
        inet 2.3.1.79 netmask 0xffffffc0 broadcast 2.3.1.127
carp11: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0b
        priority: 0
        carp: BACKUP carpdev bge2 vhid 11 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10b%carp11 prefixlen 64 scopeid 0x11
        inet 2.3.1.105 netmask 0xffffffc0 broadcast 2.3.1.127
carp12: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0c
        priority: 0
        carp: BACKUP carpdev bge2 vhid 12 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10c%carp12 prefixlen 64 scopeid 0x12
        inet 2.3.1.78 netmask 0xffffffc0 broadcast 2.3.1.127
carp13: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0d
        priority: 0
        carp: BACKUP carpdev bge2 vhid 13 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10d%carp13 prefixlen 64 scopeid 0x13
        inet 2.3.1.106 netmask 0xffffffc0 broadcast 2.3.1.127
carp14: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0e
        priority: 0
        carp: BACKUP carpdev bge2 vhid 14 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10e%carp14 prefixlen 64 scopeid 0x14
        inet 2.3.1.77 netmask 0xffffffc0 broadcast 2.3.1.127
carp15: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:0f
        priority: 0
        carp: BACKUP carpdev bge2 vhid 15 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:10f%carp15 prefixlen 64 scopeid 0x15
        inet 2.3.1.107 netmask 0xffffffc0 broadcast 2.3.1.127
carp16: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:10
        priority: 0
        carp: BACKUP carpdev bge2 vhid 16 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:110%carp16 prefixlen 64 scopeid 0x16
        inet 2.3.1.108 netmask 0xffffffc0 broadcast 2.3.1.127
carp17: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:11
        priority: 0
        carp: BACKUP carpdev bge2 vhid 17 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:111%carp17 prefixlen 64 scopeid 0x17
        inet 2.3.1.109 netmask 0xffffffc0 broadcast 2.3.1.127
carp18: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:12
        priority: 0
        carp: BACKUP carpdev bge2 vhid 18 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:112%carp18 prefixlen 64 scopeid 0x18
        inet 2.3.1.110 netmask 0xffffffc0 broadcast 2.3.1.127
carp19: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:13
        priority: 0
        carp: BACKUP carpdev bge2 vhid 19 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:113%carp19 prefixlen 64 scopeid 0x19
        inet 2.3.1.111 netmask 0xffffffc0 broadcast 2.3.1.127
carp2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:02
        priority: 0
        carp: BACKUP carpdev bge2 vhid 2 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:102%carp2 prefixlen 64 scopeid 0x1a
        inet 2.3.1.68 netmask 0xffffffc0 broadcast 2.3.1.127
carp20: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:14
        priority: 0
        carp: BACKUP carpdev bge2 vhid 20 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:114%carp20 prefixlen 64 scopeid 0x1b
        inet 2.3.1.112 netmask 0xffffffc0 broadcast 2.3.1.127
carp21: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:15
        priority: 0
        carp: BACKUP carpdev bge2 vhid 21 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:115%carp21 prefixlen 64 scopeid 0x1c
        inet 2.3.1.113 netmask 0xffffffc0 broadcast 2.3.1.127
carp22: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:16
        priority: 0
        carp: BACKUP carpdev bge2 vhid 22 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:116%carp22 prefixlen 64 scopeid 0x1d
        inet 2.3.1.114 netmask 0xffffffc0 broadcast 2.3.1.127
carp23: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:17
        priority: 0
        carp: BACKUP carpdev bge2 vhid 23 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:117%carp23 prefixlen 64 scopeid 0x1e
        inet 2.3.1.115 netmask 0xffffffc0 broadcast 2.3.1.127
carp24: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:18
        priority: 0
        carp: BACKUP carpdev bge2 vhid 24 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:118%carp24 prefixlen 64 scopeid 0x1f
        inet 2.3.1.116 netmask 0xffffffc0 broadcast 2.3.1.127
carp25: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:19
        priority: 0
        carp: BACKUP carpdev bge2 vhid 25 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:119%carp25 prefixlen 64 scopeid 0x20
        inet 2.3.1.117 netmask 0xffffffc0 broadcast 2.3.1.127
carp26: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1a
        priority: 0
        carp: BACKUP carpdev bge2 vhid 26 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11a%carp26 prefixlen 64 scopeid 0x21
        inet 2.3.1.118 netmask 0xffffffc0 broadcast 2.3.1.127
carp27: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1b
        priority: 0
        carp: BACKUP carpdev vlan27 vhid 27 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11b%carp27 prefixlen 64 scopeid 0x22
        inet 10.0.203.1 netmask 0xfffffff8 broadcast 10.0.203.7
carp28: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1c
        priority: 0
        carp: BACKUP carpdev vlan28 vhid 28 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11c%carp28 prefixlen 64 scopeid 0x23
        inet 10.0.203.9 netmask 0xfffffff8 broadcast 10.0.203.15
carp29: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1d
        priority: 0
        carp: BACKUP carpdev vlan29 vhid 29 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11d%carp29 prefixlen 64 scopeid 0x24
        inet 10.0.203.17 netmask 0xfffffff8 broadcast 10.0.203.23
carp3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:03
        priority: 0
        carp: BACKUP carpdev bge2 vhid 3 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:103%carp3 prefixlen 64 scopeid 0x25
        inet 2.3.1.80 netmask 0xffffffc0 broadcast 2.3.1.127
carp30: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1e
        priority: 0
        carp: BACKUP carpdev vlan30 vhid 30 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11e%carp30 prefixlen 64 scopeid 0x26
        inet 10.0.203.25 netmask 0xfffffff8 broadcast 10.0.203.31
carp31: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:1f
        priority: 0
        carp: BACKUP carpdev vlan31 vhid 31 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:11f%carp31 prefixlen 64 scopeid 0x27
        inet 10.0.203.33 netmask 0xfffffff8 broadcast 10.0.203.39
carp32: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:20
        priority: 0
        carp: BACKUP carpdev vlan32 vhid 32 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:120%carp32 prefixlen 64 scopeid 0x28
        inet 10.0.203.41 netmask 0xfffffff8 broadcast 10.0.203.47
carp33: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:21
        priority: 0
        carp: BACKUP carpdev vlan33 vhid 33 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:121%carp33 prefixlen 64 scopeid 0x29
        inet 10.0.203.49 netmask 0xfffffff8 broadcast 10.0.203.55
carp34: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:22
        priority: 0
        carp: BACKUP carpdev vlan34 vhid 34 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:122%carp34 prefixlen 64 scopeid 0x2a
        inet 10.0.203.57 netmask 0xfffffff8 broadcast 10.0.203.63
carp35: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:23
        priority: 0
        carp: BACKUP carpdev vlan35 vhid 35 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:123%carp35 prefixlen 64 scopeid 0x2b
        inet 10.0.203.65 netmask 0xfffffff0 broadcast 10.0.203.79
carp4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:04
        priority: 0
        carp: BACKUP carpdev bge2 vhid 4 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:104%carp4 prefixlen 64 scopeid 0x2c
        inet 2.3.1.90 netmask 0xffffffc0 broadcast 2.3.1.127
carp5: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:05
        priority: 0
        carp: BACKUP carpdev bge2 vhid 5 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:105%carp5 prefixlen 64 scopeid 0x2d
        inet 2.3.1.100 netmask 0xffffffc0 broadcast 2.3.1.127
carp6: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:06
        priority: 0
        carp: BACKUP carpdev bge2 vhid 6 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:106%carp6 prefixlen 64 scopeid 0x2e
        inet 2.3.1.101 netmask 0xffffffc0 broadcast 2.3.1.127
carp7: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:07
        priority: 0
        carp: BACKUP carpdev bge2 vhid 7 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:107%carp7 prefixlen 64 scopeid 0x2f
        inet 2.3.1.102 netmask 0xffffffc0 broadcast 2.3.1.127
carp8: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:08
        priority: 0
        carp: BACKUP carpdev bge2 vhid 8 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:108%carp8 prefixlen 64 scopeid 0x30
        inet 2.3.1.103 netmask 0xffffffc0 broadcast 2.3.1.127
carp9: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:00:5e:00:01:09
        priority: 0
        carp: BACKUP carpdev bge2 vhid 9 advbase 20 advskew 10
        groups: carp
        status: backup
        inet6 fe80::200:5eff:fe00:109%carp9 prefixlen 64 scopeid 0x31
        inet 2.3.1.104 netmask 0xffffffc0 broadcast 2.3.1.127

ADVSKEW – I have verified all passwords and advskews are identical – using “beyond compare” tools.
Pestilence01
cat /etc/hostname*
Code:
/etc/hostname.bge0:  inet 192.168.1.1 255.255.255.252\nup
/etc/hostname.bge1:  inet 10.0.206.2  255.255.255.0 10.0.206.255 media 100baseTX mediaopt full-duplex\n!route add -net 10.0.207.0/24 10.0.206.241\n!route add -net 10.8.1.0/29     10.0.206.241
/etc/hostname.bge2:  inet 2.3.1.71 255.255.255.192 2.3.1.127 media 100baseTX mediaopt full-duplex
/etc/hostname.carp1: inet  10.0.206.1   255.255.255.0    10.0.206.255 vhid 1   advbase 20 advskew  0 pass a77e464c19c5a862cc3280656ebf4748
/etc/hostname.carp10: inet 2.3.1.79  255.255.255.192 2.3.1.127 vhid 10  advbase 20 advskew  0 pass c4ead88a4c0f60364c10cd4117c15e1c
/etc/hostname.carp11: inet 2.3.1.105 255.255.255.192 2.3.1.127 vhid 11  advbase 20 advskew  0 pass 303b5a5bb16f54bc79bec66548b93fb7
/etc/hostname.carp12: inet 2.3.1.78  255.255.255.192 2.3.1.127 vhid 12  advbase 20 advskew  0 pass 83b962fd060913a64d2c6615cfe2a1c3
/etc/hostname.carp13: inet 2.3.1.106 255.255.255.192 2.3.1.127 vhid 13  advbase 20 advskew  0 pass 13ffbf891ff16d3d119cdbf5bae6597a
/etc/hostname.carp14: inet 2.3.1.77  255.255.255.192 2.3.1.127 vhid 14  advbase 20 advskew  0 pass f4458bfb5caa1991ad5a877a1df8d14d
/etc/hostname.carp15: inet 2.3.1.107 255.255.255.192 2.3.1.127 vhid 15  advbase 20 advskew  0 pass 1ea2a0879b99977400044c4cb520d7a3
/etc/hostname.carp16: inet 2.3.1.108 255.255.255.192 2.3.1.127 vhid 16  advbase 20 advskew  0 pass 177535bbfa1fc2bb6a83bfbd7fb30109
/etc/hostname.carp17: inet 2.3.1.109 255.255.255.192 2.3.1.127 vhid 17  advbase 20 advskew  0 pass 83da8754f386c9e8dd3d80edb86075c7
/etc/hostname.carp18: inet 2.3.1.110 255.255.255.192 2.3.1.127 vhid 18  advbase 20 advskew  0 pass 05c290a31105902bae016dd8221e50e4
/etc/hostname.carp19: inet 2.3.1.111 255.255.255.192 2.3.1.127 vhid 19  advbase 20 advskew  0 pass 286531a8f5ffa87e9088c4cbbf6904dd
/etc/hostname.carp2: inet 2.3.1.68  255.255.255.192 2.3.1.127 vhid 2   advbase 20 advskew  0 pass 2d2c1fb6a617db7f09ee7119d46d5241
/etc/hostname.carp20: inet 2.3.1.112 255.255.255.192 2.3.1.127 vhid 20  advbase 20 advskew  0 pass e0ab84531f9ef4f72a38ba2ec13e7ce7
/etc/hostname.carp21: inet 2.3.1.113 255.255.255.192 2.3.1.127 vhid 21  advbase 20 advskew  0 pass a9d0c8b2d8e98217ca95b271b75f0a83
/etc/hostname.carp22: inet 2.3.1.114 255.255.255.192 2.3.1.127 vhid 22  advbase 20 advskew  0 pass 86729ec153225f4965e9a8bcc95a3277
/etc/hostname.carp23: inet 2.3.1.115 255.255.255.192 2.3.1.127 vhid 23  advbase 20 advskew  0 pass 2d81bea371cdb554be1985a8cb2ae59a
/etc/hostname.carp24: inet 2.3.1.116 255.255.255.192 2.3.1.127 vhid 24  advbase 20 advskew  0 pass 3190c74c26d0a9223fa34b77f3a3c489
/etc/hostname.carp25: inet 2.3.1.117 255.255.255.192 2.3.1.127 vhid 25  advbase 20 advskew  0 pass 32c9b0deb11e768700cadcd905f762ad
/etc/hostname.carp26: inet 2.3.1.118 255.255.255.192 2.3.1.127 vhid 26  advbase 20 advskew  0 pass 5bfca8e3907739d01108891f21f34d20
/etc/hostname.carp27: inet  10.0.203.1   255.255.255.248  10.0.203.7   vhid 27  advbase 20 advskew  0 pass f19940b02ac2a1114dc7680cd2ead6d4
/etc/hostname.carp28: inet  10.0.203.9   255.255.255.248  10.0.203.15  vhid 28  advbase 20 advskew  0 pass 3097252f3e0014ad8e08478bd3f70269
/etc/hostname.carp29: inet  10.0.203.17  255.255.255.248  10.0.203.23  vhid 29  advbase 20 advskew  0 pass ecb80e43d414d3c320cfff26c9d6c5c0
/etc/hostname.carp3: inet 2.3.1.80  255.255.255.192 2.3.1.127 vhid 3   advbase 20 advskew  0 pass 24a21d86c015efe8c1b7814ea79c89d1
/etc/hostname.carp30: inet  10.0.203.25  255.255.255.248  10.0.203.31  vhid 30  advbase 20 advskew  0 pass 126373e9515252e6e733edab837464d3
/etc/hostname.carp31: inet  10.0.203.33  255.255.255.248  10.0.203.39  vhid 31  advbase 20 advskew  0 pass 997ba368466bf752224ed7b389cdd39e
/etc/hostname.carp32: inet  10.0.203.41  255.255.255.248  10.0.203.47  vhid 32  advbase 20 advskew  0 pass 91ade2dd6b44ffd345025647b2f577d7
/etc/hostname.carp33: inet  10.0.203.49  255.255.255.248  10.0.203.55  vhid 33  advbase 20 advskew  0 pass ee08bff5a4be284150897ff4f0cd2fab
/etc/hostname.carp34: inet  10.0.203.57  255.255.255.248  10.0.203.63  vhid 34  advbase 20 advskew  0 pass b6a9643a2f1a313c5541d22bd016e0f0
/etc/hostname.carp35: inet  10.0.203.65  255.255.255.240  10.0.203.79  vhid 35  advbase 20 advskew  0 pass a1b6cb18ca07bc8d36f0cba9a1f22124
/etc/hostname.carp4: inet 2.3.1.90  255.255.255.192 2.3.1.127 vhid 4   advbase 20 advskew  0 pass 628977de65e3d2c049e59b78cfff86ab
/etc/hostname.carp5: inet 2.3.1.100 255.255.255.192 2.3.1.127 vhid 5   advbase 20 advskew  0 pass 2387e5465f8e77d22ce4c7fd4209af2c
/etc/hostname.carp6: inet 2.3.1.101 255.255.255.192 2.3.1.127 vhid 6   advbase 20 advskew  0 pass ed2b78e1086f1bfb99f8ccfdad561fcb
/etc/hostname.carp7: inet 2.3.1.102 255.255.255.192 2.3.1.127 vhid 7   advbase 20 advskew  0 pass b4347d4da39689ccf017574e35932f95
/etc/hostname.carp8: inet 2.3.1.103 255.255.255.192 2.3.1.127 vhid 8   advbase 20 advskew  0 pass 5baa2c58046026708290e16de09dbee1
/etc/hostname.carp9: inet 2.3.1.104 255.255.255.192 2.3.1.127 vhid 9   advbase 20 advskew  0 pass b7892268ad42a8712b24327e52830c03
/etc/hostname.pfsync0: up syncdev bge0
/etc/hostname.vlan27: inet 10.0.203.2  255.255.255.248 NONE vlan 27 vlandev bge1 
/etc/hostname.vlan28: inet 10.0.203.10 255.255.255.248 NONE vlan 28 vlandev bge1 
/etc/hostname.vlan29: inet 10.0.203.18 255.255.255.248 NONE vlan 29 vlandev bge1 
/etc/hostname.vlan30: inet 10.0.203.26 255.255.255.248 NONE vlan 30 vlandev bge1 
/etc/hostname.vlan31: inet 10.0.203.34 255.255.255.248 NONE vlan 31 vlandev bge1 
/etc/hostname.vlan32: inet 10.0.203.42 255.255.255.248 NONE vlan 32 vlandev bge1 
/etc/hostname.vlan33: inet 10.0.203.50 255.255.255.248 NONE vlan 33 vlandev bge1 
/etc/hostname.vlan34: inet 10.0.203.58 255.255.255.248 NONE vlan 34 vlandev bge1 
/etc/hostname.vlan35: inet 10.0.203.66 255.255.255.240 NONE vlan 35 vlandev bge1

Pestilence 02
cat /etc/hostname*
Code:
/etc/hostname.bge0: inet 192.168.1.2 255.255.255.252\nup
/etc/hostname.bge1: inet 10.0.206.3 255.255.255.0 10.0.206.255 media 100baseTX mediaopt full-duplex\n!route add -net 10.0.207.0/24 10.0.206.241\n!route add -net 10.8.1.0/29     10.0.206.241
/etc/hostname.bge2: inet 2.3.1.72 255.255.255.192  2.3.1.127 media 100baseTX mediaopt full-duplex
/etc/hostname.carp1: inet  10.0.206.1   255.255.255.0    10.0.206.255 vhid 1   advbase 20 advskew 10 pass a77e464c19c5a862cc3280656ebf4748
/etc/hostname.carp10: inet 2.3.1.79  255.255.255.192 2.3.1.127 vhid 10  advbase 20 advskew 10 pass c4ead88a4c0f60364c10cd4117c15e1c
/etc/hostname.carp11: inet 2.3.1.105 255.255.255.192 2.3.1.127 vhid 11  advbase 20 advskew 10 pass 303b5a5bb16f54bc79bec66548b93fb7
/etc/hostname.carp12: inet 2.3.1.78  255.255.255.192 2.3.1.127 vhid 12  advbase 20 advskew 10 pass 83b962fd060913a64d2c6615cfe2a1c3
/etc/hostname.carp13: inet 2.3.1.106 255.255.255.192 2.3.1.127 vhid 13  advbase 20 advskew 10 pass 13ffbf891ff16d3d119cdbf5bae6597a
/etc/hostname.carp14: inet 2.3.1.77  255.255.255.192 2.3.1.127 vhid 14  advbase 20 advskew 10 pass f4458bfb5caa1991ad5a877a1df8d14d
/etc/hostname.carp15: inet 2.3.1.107 255.255.255.192 2.3.1.127 vhid 15  advbase 20 advskew 10 pass 1ea2a0879b99977400044c4cb520d7a3
/etc/hostname.carp16: inet 2.3.1.108 255.255.255.192 2.3.1.127 vhid 16  advbase 20 advskew 10 pass 177535bbfa1fc2bb6a83bfbd7fb30109
/etc/hostname.carp17: inet 2.3.1.109 255.255.255.192 2.3.1.127 vhid 17  advbase 20 advskew 10 pass 83da8754f386c9e8dd3d80edb86075c7
/etc/hostname.carp18: inet 2.3.1.110 255.255.255.192 2.3.1.127 vhid 18  advbase 20 advskew 10 pass 05c290a31105902bae016dd8221e50e4
/etc/hostname.carp19: inet 2.3.1.111 255.255.255.192 2.3.1.127 vhid 19  advbase 20 advskew 10 pass 286531a8f5ffa87e9088c4cbbf6904dd
/etc/hostname.carp2: inet 2.3.1.68  255.255.255.192 2.3.1.127 vhid 2   advbase 20 advskew 10 pass 2d2c1fb6a617db7f09ee7119d46d5241
/etc/hostname.carp20: inet 2.3.1.112 255.255.255.192 2.3.1.127 vhid 20  advbase 20 advskew 10 pass e0ab84531f9ef4f72a38ba2ec13e7ce7
/etc/hostname.carp21: inet 2.3.1.113 255.255.255.192 2.3.1.127 vhid 21  advbase 20 advskew 10 pass a9d0c8b2d8e98217ca95b271b75f0a83
/etc/hostname.carp22: inet 2.3.1.114 255.255.255.192 2.3.1.127 vhid 22  advbase 20 advskew 10 pass 86729ec153225f4965e9a8bcc95a3277
/etc/hostname.carp23: inet 2.3.1.115 255.255.255.192 2.3.1.127 vhid 23  advbase 20 advskew 10 pass 2d81bea371cdb554be1985a8cb2ae59a
/etc/hostname.carp24: inet 2.3.1.116 255.255.255.192 2.3.1.127 vhid 24  advbase 20 advskew 10 pass 3190c74c26d0a9223fa34b77f3a3c489
/etc/hostname.carp25: inet 2.3.1.117 255.255.255.192 2.3.1.127 vhid 25  advbase 20 advskew 10 pass 32c9b0deb11e768700cadcd905f762ad
/etc/hostname.carp26: inet 2.3.1.118 255.255.255.192 2.3.1.127 vhid 26  advbase 20 advskew 10 pass 5bfca8e3907739d01108891f21f34d20
/etc/hostname.carp27: inet  10.0.203.1   255.255.255.248  10.0.203.7   vhid 27  advbase 20 advskew 10 pass f19940b02ac2a1114dc7680cd2ead6d4
/etc/hostname.carp28: inet  10.0.203.9   255.255.255.248  10.0.203.15  vhid 28  advbase 20 advskew 10 pass 3097252f3e0014ad8e08478bd3f70269
/etc/hostname.carp29: inet  10.0.203.17  255.255.255.248  10.0.203.23  vhid 29  advbase 20 advskew 10 pass ecb80e43d414d3c320cfff26c9d6c5c0
/etc/hostname.carp3: inet 2.3.1.80  255.255.255.192 2.3.1.127 vhid 3   advbase 20 advskew 10 pass 24a21d86c015efe8c1b7814ea79c89d1
/etc/hostname.carp30: inet  10.0.203.25  255.255.255.248  10.0.203.31  vhid 30  advbase 20 advskew 10 pass 126373e9515252e6e733edab837464d3
/etc/hostname.carp31: inet  10.0.203.33  255.255.255.248  10.0.203.39  vhid 31  advbase 20 advskew 10 pass 997ba368466bf752224ed7b389cdd39e
/etc/hostname.carp32: inet  10.0.203.41  255.255.255.248  10.0.203.47  vhid 32  advbase 20 advskew 10 pass 91ade2dd6b44ffd345025647b2f577d7
/etc/hostname.carp33: inet  10.0.203.49  255.255.255.248  10.0.203.55  vhid 33  advbase 20 advskew 10 pass ee08bff5a4be284150897ff4f0cd2fab
/etc/hostname.carp34: inet  10.0.203.57  255.255.255.248  10.0.203.63  vhid 34  advbase 20 advskew 10 pass b6a9643a2f1a313c5541d22bd016e0f0
/etc/hostname.carp35: inet  10.0.203.65  255.255.255.240  10.0.203.79  vhid 35  advbase 20 advskew 10 pass a1b6cb18ca07bc8d36f0cba9a1f22124
/etc/hostname.carp4: inet 2.3.1.90  255.255.255.192 2.3.1.127 vhid 4   advbase 20 advskew 10 pass 628977de65e3d2c049e59b78cfff86ab
/etc/hostname.carp5: inet 2.3.1.100 255.255.255.192 2.3.1.127 vhid 5   advbase 20 advskew 10 pass 2387e5465f8e77d22ce4c7fd4209af2c
/etc/hostname.carp6: inet 2.3.1.101 255.255.255.192 2.3.1.127 vhid 6   advbase 20 advskew 10 pass ed2b78e1086f1bfb99f8ccfdad561fcb
/etc/hostname.carp7: inet 2.3.1.102 255.255.255.192 2.3.1.127 vhid 7   advbase 20 advskew 10 pass b4347d4da39689ccf017574e35932f95
/etc/hostname.carp8: inet 2.3.1.103 255.255.255.192 2.3.1.127 vhid 8   advbase 20 advskew 10 pass 5baa2c58046026708290e16de09dbee1
/etc/hostname.carp9: inet 2.3.1.104 255.255.255.192 2.3.1.127 vhid 9   advbase 20 advskew 10 pass b7892268ad42a8712b24327e52830c03
/etc/hostname.pfsync0: up syncdev bge0
/etc/hostname.vlan27: inet 10.0.203.3  255.255.255.248 NONE vlan 27 vlandev bge1 
/etc/hostname.vlan28: inet 10.0.203.11 255.255.255.248 NONE vlan 28 vlandev bge1 
/etc/hostname.vlan29: inet 10.0.203.19 255.255.255.248 NONE vlan 29 vlandev bge1 
/etc/hostname.vlan30: inet 10.0.203.27 255.255.255.248 NONE vlan 30 vlandev bge1 
/etc/hostname.vlan31: inet 10.0.203.35 255.255.255.248 NONE vlan 31 vlandev bge1 
/etc/hostname.vlan32: inet 10.0.203.43 255.255.255.248 NONE vlan 32 vlandev bge1 
/etc/hostname.vlan33: inet 10.0.203.51 255.255.255.248 NONE vlan 33 vlandev bge1 
/etc/hostname.vlan34: inet 10.0.203.59 255.255.255.248 NONE vlan 34 vlandev bge1 
/etc/hostname.vlan35: inet 10.0.203.67 255.255.255.240 NONE vlan 35 vlandev bge1

Last edited by nekron99; 7th November 2011 at 08:49 PM.
Reply With Quote
  #7   (View Single Post)  
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default follow up - more data {part 03}

Pestilence 01 netstat -in

Code:
Name    Mtu   Network     Address              Ipkts Ierrs    Opkts Oerrs Colls
lo0     33200 <Link>                             567     0      567     0     0
lo0     33200 127/8       127.0.0.1              567     0      567     0     0
lo0     33200 ::1/128     ::1                    567     0      567     0     0
lo0     33200 fe80::%lo0/ fe80::1%lo0            567     0      567     0     0
bge0    1500  <Link>      00:10:18:14:7b:ed  3166606   171 11135115     0     0
bge0    1500  192.168.1.1 192.168.1.1        3166606   171 11135115     0     0
bge0    1500  fe80::%bge0 fe80::210:18ff:fe  3166606   171 11135115     0     0
bge1    1500  <Link>      00:13:72:3b:d5:33 298348513 31822 310233092     0     0
bge1    1500  10.0.206/ 10.0.206.2      298348513 31822 310233092     0     0
bge1    1500  fe80::%bge1 fe80::213:72ff:fe 298348513 31822 310233092     0     0
bge2    1500  <Link>      00:13:72:3b:d5:34 266979910 100667 244796771     0     0
bge2    1500  2.3.1 2.3.1.71    266979910 100667 244796771     0     0
bge2    1500  fe80::%bge2 fe80::213:72ff:fe 266979910 100667 244796771     0     0
enc0*   0     <Link>                               0     0        0     0     0
vlan27  1500  <Link>      00:13:72:3b:d5:33 10488977     0  8516499     0     0
vlan27  1500  fe80::%vlan fe80::213:72ff:fe 10488977     0  8516499     0     0
vlan27  1500  10.0.203. 10.0.203.2      10488977     0  8516499     0     0
vlan28  1500  <Link>      00:13:72:3b:d5:33 99426222     0 106252308     0     0
vlan28  1500  fe80::%vlan fe80::213:72ff:fe 99426222     0 106252308     0     0
vlan28  1500  10.0.203. 10.0.203.10     99426222     0 106252308     0     0
vlan29  1500  <Link>      00:13:72:3b:d5:33  4072981     0  3791557     0     0
vlan29  1500  fe80::%vlan fe80::213:72ff:fe  4072981     0  3791557     0     0
vlan29  1500  10.0.203. 10.0.203.18      4072981     0  3791557     0     0
vlan30  1500  <Link>      00:13:72:3b:d5:33 52304273     0 73214072     0     0
vlan30  1500  fe80::%vlan fe80::213:72ff:fe 52304273     0 73214072     0     0
vlan30  1500  10.0.203. 10.0.203.26     52304273     0 73214072     0     0
vlan31  1500  <Link>      00:13:72:3b:d5:33  6661250     0  6279377     0     0
vlan31  1500  fe80::%vlan fe80::213:72ff:fe  6661250     0  6279377     0     0
vlan31  1500  10.0.203. 10.0.203.34      6661250     0  6279377     0     0
vlan32  1500  <Link>      00:13:72:3b:d5:33   894006     0   423772     0     0
vlan32  1500  fe80::%vlan fe80::213:72ff:fe   894006     0   423772     0     0
vlan32  1500  10.0.203. 10.0.203.42       894006     0   423772     0     0
vlan33  1500  <Link>      00:13:72:3b:d5:33   659168     0   132639     0     0
vlan33  1500  fe80::%vlan fe80::213:72ff:fe   659168     0   132639     0     0
vlan33  1500  10.0.203. 10.0.203.50       659168     0   132639     0     0
vlan34  1500  <Link>      00:13:72:3b:d5:33   857089     0   286012     0     0
vlan34  1500  fe80::%vlan fe80::213:72ff:fe   857089     0   286012     0     0
vlan34  1500  10.0.203. 10.0.203.58       857089     0   286012     0     0
vlan35  1500  <Link>      00:13:72:3b:d5:33   607623     0   271835     0     0
vlan35  1500  fe80::%vlan fe80::213:72ff:fe   607623     0   271835     0     0
vlan35  1500  10.0.203. 10.0.203.66       607623     0   271835     0     0
pfsync0 1500  <Link>                         3166312     0 11134279     0     0
pflog0  33200 <Link>                               0     0    27868     0     0
carp1   1500  <Link>      00:00:5e:00:01:01 119812495     0    59821     1     0
carp1   1500  fe80::%carp fe80::200:5eff:fe 119812495     0    59821     1     0
carp1   1500  10.0.206/ 10.0.206.1      119812495     0    59821     1     0
carp10  1500  <Link>      00:00:5e:00:01:0a  6352265     0    59668     0     0
carp10  1500  fe80::%carp fe80::200:5eff:fe  6352265     0    59668     0     0
carp10  1500  2.3.1 2.3.1.79     6352265     0    59668     0     0
carp11  1500  <Link>      00:00:5e:00:01:0b   444795     0    59668     0     0
carp11  1500  fe80::%carp fe80::200:5eff:fe   444795     0    59668     0     0
carp11  1500  2.3.1 2.3.1.105     444795     0    59668     0     0
carp12  1500  <Link>      00:00:5e:00:01:0c 72192512     0    59668     0     0
carp12  1500  fe80::%carp fe80::200:5eff:fe 72192512     0    59668     0     0
carp12  1500  2.3.1 2.3.1.78    72192512     0    59668     0     0
carp13  1500  <Link>      00:00:5e:00:01:0d   104341     0    59668     0     0
carp13  1500  fe80::%carp fe80::200:5eff:fe   104341     0    59668     0     0
carp13  1500  2.3.1 2.3.1.106     104341     0    59668     0     0
carp14  1500  <Link>      00:00:5e:00:01:0e  3032192     0    59668     0     0
carp14  1500  fe80::%carp fe80::200:5eff:fe  3032192     0    59668     0     0
carp14  1500  2.3.1 2.3.1.77     3032192     0    59668     0     0
carp15  1500  <Link>      00:00:5e:00:01:0f   289109     0    59668     0     0
carp15  1500  fe80::%carp fe80::200:5eff:fe   289109     0    59668     0     0
carp15  1500  2.3.1 2.3.1.107     289109     0    59668     0     0
carp16  1500  <Link>      00:00:5e:00:01:10   370686     0    59668     0     0
carp16  1500  fe80::%carp fe80::200:5eff:fe   370686     0    59668     0     0
carp16  1500  2.3.1 2.3.1.108     370686     0    59668     0     0
carp17  1500  <Link>      00:00:5e:00:01:11    65999     0    59668     0     0
carp17  1500  fe80::%carp fe80::200:5eff:fe    65999     0    59668     0     0
carp17  1500  2.3.1 2.3.1.109      65999     0    59668     0     0
carp18  1500  <Link>      00:00:5e:00:01:12    38018     0    59668     0     0
carp18  1500  fe80::%carp fe80::200:5eff:fe    38018     0    59668     0     0
carp18  1500  2.3.1 2.3.1.110      38018     0    59668     0     0
carp19  1500  <Link>      00:00:5e:00:01:13 14188307     0    59668     0     0
carp19  1500  fe80::%carp fe80::200:5eff:fe 14188307     0    59668     0     0
carp19  1500  2.3.1 2.3.1.111   14188307     0    59668     0     0
carp2   1500  <Link>      00:00:5e:00:01:02 28658137 28648225    59667     0     0
carp2   1500  fe80::%carp fe80::200:5eff:fe 28658137 28648225    59667     0     0
carp2   1500  2.3.1 2.3.1.68    28658137 28648225    59667     0     0
carp20  1500  <Link>      00:00:5e:00:01:14     7676     0    59667     0     0
carp20  1500  fe80::%carp fe80::200:5eff:fe     7676     0    59667     0     0
carp20  1500  2.3.1 2.3.1.112       7676     0    59667     0     0
carp21  1500  <Link>      00:00:5e:00:01:15    15115     0    59667     0     0
carp21  1500  fe80::%carp fe80::200:5eff:fe    15115     0    59667     0     0
carp21  1500  2.3.1 2.3.1.113      15115     0    59667     0     0
carp22  1500  <Link>      00:00:5e:00:01:16     8051     0    59667     0     0
carp22  1500  fe80::%carp fe80::200:5eff:fe     8051     0    59667     0     0
carp22  1500  2.3.1 2.3.1.114       8051     0    59667     0     0
carp23  1500  <Link>      00:00:5e:00:01:17     7441     0    59668     0     0
carp23  1500  fe80::%carp fe80::200:5eff:fe     7441     0    59668     0     0
carp23  1500  2.3.1 2.3.1.115       7441     0    59668     0     0
carp24  1500  <Link>      00:00:5e:00:01:18     8506     0    59668     0     0
carp24  1500  fe80::%carp fe80::200:5eff:fe     8506     0    59668     0     0
carp24  1500  2.3.1 2.3.1.116       8506     0    59668     0     0
carp25  1500  <Link>      00:00:5e:00:01:19  6648635     0    59668     0     0
carp25  1500  fe80::%carp fe80::200:5eff:fe  6648635     0    59668     0     0
carp25  1500  2.3.1 2.3.1.117    6648635     0    59668     0     0
carp26  1500  <Link>      00:00:5e:00:01:1a     7061     0    59667     0     0
carp26  1500  fe80::%carp fe80::200:5eff:fe     7061     0    59667     0     0
carp26  1500  2.3.1 2.3.1.118       7061     0    59667     0     0
carp27  1500  <Link>      00:00:5e:00:01:1b  9889204     0    59668     1     0
carp27  1500  fe80::%carp fe80::200:5eff:fe  9889204     0    59668     1     0
carp27  1500  10.0.203. 10.0.203.1       9889204     0    59668     1     0
carp28  1500  <Link>      00:00:5e:00:01:1c 98826486     0    59668     1     0
carp28  1500  fe80::%carp fe80::200:5eff:fe 98826486     0    59668     1     0
carp28  1500  10.0.203. 10.0.203.9      98826486     0    59668     1     0
carp29  1500  <Link>      00:00:5e:00:01:1d  3472814     0    59668     1     0
carp29  1500  fe80::%carp fe80::200:5eff:fe  3472814     0    59668     1     0
carp29  1500  10.0.203. 10.0.203.17      3472814     0    59668     1     0
carp3   1500  <Link>      00:00:5e:00:01:03 104539961     0    59667     0     0
carp3   1500  fe80::%carp fe80::200:5eff:fe 104539961     0    59667     0     0
carp3   1500  2.3.1 2.3.1.80    104539961     0    59667     0     0
carp30  1500  <Link>      00:00:5e:00:01:1e 51704546     0    59668     1     0
carp30  1500  fe80::%carp fe80::200:5eff:fe 51704546     0    59668     1     0
carp30  1500  10.0.203. 10.0.203.25     51704546     0    59668     1     0
carp31  1500  <Link>      00:00:5e:00:01:1f  6061037     0    59668     1     0
carp31  1500  fe80::%carp fe80::200:5eff:fe  6061037     0    59668     1     0
carp31  1500  10.0.203. 10.0.203.33      6061037     0    59668     1     0
carp32  1500  <Link>      00:00:5e:00:01:20   293051     0    59668     1     0
carp32  1500  fe80::%carp fe80::200:5eff:fe   293051     0    59668     1     0
carp32  1500  10.0.203. 10.0.203.41       293051     0    59668     1     0
carp33  1500  <Link>      00:00:5e:00:01:21    59867     0    59668     1     0
carp33  1500  fe80::%carp fe80::200:5eff:fe    59867     0    59668     1     0
carp33  1500  10.0.203. 10.0.203.49        59867     0    59668     1     0
carp34  1500  <Link>      00:00:5e:00:01:22   256496     0    59668     1     0
carp34  1500  fe80::%carp fe80::200:5eff:fe   256496     0    59668     1     0
carp34  1500  10.0.203. 10.0.203.57       256496     0    59668     1     0
carp35  1500  <Link>      00:00:5e:00:01:23      291     0    59668     1     0
carp35  1500  fe80::%carp fe80::200:5eff:fe      291     0    59668     1     0
carp35  1500  10.0.203. 10.0.203.65          291     0    59668     1     0
carp4   1500  <Link>      00:00:5e:00:01:04 36971082     0    59668     0     0
carp4   1500  fe80::%carp fe80::200:5eff:fe 36971082     0    59668     0     0
carp4   1500  2.3.1 2.3.1.90    36971082     0    59668     0     0
carp5   1500  <Link>      00:00:5e:00:01:05  2972448     0    59716     0     0
carp5   1500  fe80::%carp fe80::200:5eff:fe  2972448     0    59716     0     0
carp5   1500  2.3.1 2.3.1.100    2972448     0    59716     0     0
carp6   1500  <Link>      00:00:5e:00:01:06    39288     0    59668     0     0
carp6   1500  fe80::%carp fe80::200:5eff:fe    39288     0    59668     0     0
carp6   1500  2.3.1 2.3.1.101      39288     0    59668     0     0
carp7   1500  <Link>      00:00:5e:00:01:07    93163     0    59668     0     0
carp7   1500  fe80::%carp fe80::200:5eff:fe    93163     0    59668     0     0
carp7   1500  2.3.1 2.3.1.102      93163     0    59668     0     0
carp8   1500  <Link>      00:00:5e:00:01:08  4335898     0    59668     0     0
carp8   1500  fe80::%carp fe80::200:5eff:fe  4335898     0    59668     0     0
carp8   1500  2.3.1 2.3.1.103    4335898     0    59668     0     0
carp9   1500  <Link>      00:00:5e:00:01:09  8166726     0    59668     0     0
carp9   1500  fe80::%carp fe80::200:5eff:fe  8166726     0    59668     0     0
carp9   1500  2.3.1 2.3.1.104    8166726     0    59668     0     0
Pestilence 02 netstat -in
Code:
Name    Mtu   Network     Address              Ipkts Ierrs    Opkts Oerrs Colls
lo0     33200 <Link>                             573     0      573     0     0
lo0     33200 127/8       127.0.0.1              573     0      573     0     0
lo0     33200 ::1/128     ::1                    573     0      573     0     0
lo0     33200 fe80::%lo0/ fe80::1%lo0            573     0      573     0     0
bge0    1500  <Link>      00:10:18:14:8a:6a 11136634  1493  3169082     0     0
bge0    1500  192.168.1.2 192.168.1.2       11136634  1493  3169082     0     0
bge0    1500  fe80::%bge0 fe80::210:18ff:fe 11136634  1493  3169082     0     0
bge1    1500  <Link>      00:13:72:3b:ef:ac 10806962 10324  1165931     0     0
bge1    1500  10.0.206/ 10.0.206.3      10806962 10324  1165931     0     0
bge1    1500  fe80::%bge1 fe80::213:72ff:fe 10806962 10324  1165931     0     0
bge2    1500  <Link>      00:13:72:3b:ef:ad  6370099  8781  1959089     0     0
bge2    1500  2.3.1 2.3.1.72     6370099  8781  1959089     0     0
bge2    1500  fe80::%bge2 fe80::213:72ff:fe  6370099  8781  1959089     0     0
enc0*   0     <Link>                               0     0        0     0     0
vlan27  1500  <Link>      00:13:72:3b:ef:ac   668513     0    28789     0     0
vlan27  1500  fe80::%vlan fe80::213:72ff:fe   668513     0    28789     0     0
vlan27  1500  10.0.203. 10.0.203.3        668513     0    28789     0     0
vlan28  1500  <Link>      00:13:72:3b:ef:ac   927735     0    19160     0     0
vlan28  1500  fe80::%vlan fe80::213:72ff:fe   927735     0    19160     0     0
vlan28  1500  10.0.203. 10.0.203.11       927735     0    19160     0     0
vlan29  1500  <Link>      00:13:72:3b:ef:ac   666241     0     1547     0     0
vlan29  1500  fe80::%vlan fe80::213:72ff:fe   666241     0     1547     0     0
vlan29  1500  10.0.203. 10.0.203.19       666241     0     1547     0     0
vlan30  1500  <Link>      00:13:72:3b:ef:ac   796837     0     3518     0     0
vlan30  1500  fe80::%vlan fe80::213:72ff:fe   796837     0     3518     0     0
vlan30  1500  10.0.203. 10.0.203.27       796837     0     3518     0     0
vlan31  1500  <Link>      00:13:72:3b:ef:ac   673431     0      259     0     0
vlan31  1500  fe80::%vlan fe80::213:72ff:fe   673431     0      259     0     0
vlan31  1500  10.0.203. 10.0.203.35       673431     0      259     0     0
vlan32  1500  <Link>      00:13:72:3b:ef:ac   661567     0      642     0     0
vlan32  1500  fe80::%vlan fe80::213:72ff:fe   661567     0      642     0     0
vlan32  1500  10.0.203. 10.0.203.43       661567     0      642     0     0
vlan33  1500  <Link>      00:13:72:3b:ef:ac   659115     0      228     0     0
vlan33  1500  fe80::%vlan fe80::213:72ff:fe   659115     0      228     0     0
vlan33  1500  10.0.203. 10.0.203.51       659115     0      228     0     0
vlan34  1500  <Link>      00:13:72:3b:ef:ac   660951     0      264     0     0
vlan34  1500  fe80::%vlan fe80::213:72ff:fe   660951     0      264     0     0
vlan34  1500  10.0.203. 10.0.203.59       660951     0      264     0     0
vlan35  1500  <Link>      00:13:72:3b:ef:ac   683065     0      640     0     0
vlan35  1500  fe80::%vlan fe80::213:72ff:fe   683065     0      640     0     0
vlan35  1500  10.0.203. 10.0.203.67       683065     0      640     0     0
pfsync0 1500  <Link>                        11133633     0  3169064     0     0
pflog0  33200 <Link>                               0     0     1720     0     0
carp1   1500  <Link>      00:00:5e:00:01:01  1741787     0      323     0     0
carp1   1500  fe80::%carp fe80::200:5eff:fe  1741787     0      323     0     0
carp1   1500  10.0.206/ 10.0.206.1       1741787     0      323     0     0
carp10  1500  <Link>      00:00:5e:00:01:0a  1491882     0        7     0     0
carp10  1500  fe80::%carp fe80::200:5eff:fe  1491882     0        7     0     0
carp10  1500  2.3.1 2.3.1.79     1491882     0        7     0     0
carp11  1500  <Link>      00:00:5e:00:01:0b  1491785     0        7     0     0
carp11  1500  fe80::%carp fe80::200:5eff:fe  1491785     0        7     0     0
carp11  1500  2.3.1 2.3.1.105    1491785     0        7     0     0
carp12  1500  <Link>      00:00:5e:00:01:0c  1493783     0        7     0     0
carp12  1500  fe80::%carp fe80::200:5eff:fe  1493783     0        7     0     0
carp12  1500  2.3.1 2.3.1.78     1493783     0        7     0     0
carp13  1500  <Link>      00:00:5e:00:01:0d  1491596     0        7     0     0
carp13  1500  fe80::%carp fe80::200:5eff:fe  1491596     0        7     0     0
carp13  1500  2.3.1 2.3.1.106    1491596     0        7     0     0
carp14  1500  <Link>      00:00:5e:00:01:0e  1490483     0        8     0     0
carp14  1500  fe80::%carp fe80::200:5eff:fe  1490483     0        8     0     0
carp14  1500  2.3.1 2.3.1.77     1490483     0        8     0     0
carp15  1500  <Link>      00:00:5e:00:01:0f  1488409     0        8     0     0
carp15  1500  fe80::%carp fe80::200:5eff:fe  1488409     0        8     0     0
carp15  1500  2.3.1 2.3.1.107    1488409     0        8     0     0
carp16  1500  <Link>      00:00:5e:00:01:10  1485941     0       73     0     0
carp16  1500  fe80::%carp fe80::200:5eff:fe  1485941     0       73     0     0
carp16  1500  2.3.1 2.3.1.108    1485941     0       73     0     0
carp17  1500  <Link>      00:00:5e:00:01:11  1491781     0        7     0     0
carp17  1500  fe80::%carp fe80::200:5eff:fe  1491781     0        7     0     0
carp17  1500  2.3.1 2.3.1.109    1491781     0        7     0     0
carp18  1500  <Link>      00:00:5e:00:01:12  1491780     0        7     0     0
carp18  1500  fe80::%carp fe80::200:5eff:fe  1491780     0        7     0     0
carp18  1500  2.3.1 2.3.1.110    1491780     0        7     0     0
carp19  1500  <Link>      00:00:5e:00:01:13  1491777     0        7     0     0
carp19  1500  fe80::%carp fe80::200:5eff:fe  1491777     0        7     0     0
carp19  1500  2.3.1 2.3.1.111    1491777     0        7     0     0
carp2   1500  <Link>      00:00:5e:00:01:02 30145517 28653784       11     0     0
carp2   1500  fe80::%carp fe80::200:5eff:fe 30145517 28653784       11     0     0
carp2   1500  2.3.1 2.3.1.68    30145517 28653784       11     0     0
carp20  1500  <Link>      00:00:5e:00:01:14  1491876   125       11     0     0
carp20  1500  fe80::%carp fe80::200:5eff:fe  1491876   125       11     0     0
carp20  1500  2.3.1 2.3.1.112    1491876   125       11     0     0
carp21  1500  <Link>      00:00:5e:00:01:15  1491750     0       11     0     0
carp21  1500  fe80::%carp fe80::200:5eff:fe  1491750     0       11     0     0
carp21  1500  2.3.1 2.3.1.113    1491750     0       11     0     0
carp22  1500  <Link>      00:00:5e:00:01:16  1491750     0       11     0     0
carp22  1500  fe80::%carp fe80::200:5eff:fe  1491750     0       11     0     0
carp22  1500  2.3.1 2.3.1.114    1491750     0       11     0     0
carp23  1500  <Link>      00:00:5e:00:01:17  1491778     0        8     0     0
carp23  1500  fe80::%carp fe80::200:5eff:fe  1491778     0        8     0     0
carp23  1500  2.3.1 2.3.1.115    1491778     0        8     0     0
carp24  1500  <Link>      00:00:5e:00:01:18  1491701     0        9     0     0
carp24  1500  fe80::%carp fe80::200:5eff:fe  1491701     0        9     0     0
carp24  1500  2.3.1 2.3.1.116    1491701     0        9     0     0
carp25  1500  <Link>      00:00:5e:00:01:19  1502788     0      243     0     0
carp25  1500  fe80::%carp fe80::200:5eff:fe  1502788     0      243     0     0
carp25  1500  2.3.1 2.3.1.117    1502788     0      243     0     0
carp26  1500  <Link>      00:00:5e:00:01:1a  1491750     0       11     0     0
carp26  1500  fe80::%carp fe80::200:5eff:fe  1491750     0       11     0     0
carp26  1500  2.3.1 2.3.1.118    1491750     0       11     0     0
carp27  1500  <Link>      00:00:5e:00:01:1b    68083     0      157     0     0
carp27  1500  fe80::%carp fe80::200:5eff:fe    68083     0      157     0     0
carp27  1500  10.0.203. 10.0.203.1         68083     0      157     0     0
carp28  1500  <Link>      00:00:5e:00:01:1c   317867     0      159     0     0
carp28  1500  fe80::%carp fe80::200:5eff:fe   317867     0      159     0     0
carp28  1500  10.0.203. 10.0.203.9        317867     0      159     0     0
carp29  1500  <Link>      00:00:5e:00:01:1d    65544     0      172     0     0
carp29  1500  fe80::%carp fe80::200:5eff:fe    65544     0      172     0     0
carp29  1500  10.0.203. 10.0.203.17        65544     0      172     0     0
carp3   1500  <Link>      00:00:5e:00:01:03  1496445     0       11     0     0
carp3   1500  fe80::%carp fe80::200:5eff:fe  1496445     0       11     0     0
carp3   1500  2.3.1 2.3.1.80     1496445     0       11     0     0
carp30  1500  <Link>      00:00:5e:00:01:1e   193478     0      153     0     0
carp30  1500  fe80::%carp fe80::200:5eff:fe   193478     0      153     0     0
carp30  1500  10.0.203. 10.0.203.25       193478     0      153     0     0
carp31  1500  <Link>      00:00:5e:00:01:1f    72692     0      157     0     0
carp31  1500  fe80::%carp fe80::200:5eff:fe    72692     0      157     0     0
carp31  1500  10.0.203. 10.0.203.33        72692     0      157     0     0
carp32  1500  <Link>      00:00:5e:00:01:20    60015     0      298     0     0
carp32  1500  fe80::%carp fe80::200:5eff:fe    60015     0      298     0     0
carp32  1500  10.0.203. 10.0.203.41        60015     0      298     0     0
carp33  1500  <Link>      00:00:5e:00:01:21    59381     0      157     0     0
carp33  1500  fe80::%carp fe80::200:5eff:fe    59381     0      157     0     0
carp33  1500  10.0.203. 10.0.203.49        59381     0      157     0     0
carp34  1500  <Link>      00:00:5e:00:01:22    59965     0      150     0     0
carp34  1500  fe80::%carp fe80::200:5eff:fe    59965     0      150     0     0
carp34  1500  10.0.203. 10.0.203.57        59965     0      150     0     0
carp35  1500  <Link>      00:00:5e:00:01:23    59102     0      298     0     0
carp35  1500  fe80::%carp fe80::200:5eff:fe    59102     0      298     0     0
carp35  1500  10.0.203. 10.0.203.65        59102     0      298     0     0
carp4   1500  <Link>      00:00:5e:00:01:04  1551412     0       85     0     0
carp4   1500  fe80::%carp fe80::200:5eff:fe  1551412     0       85     0     0
carp4   1500  2.3.1 2.3.1.90     1551412     0       85     0     0
carp5   1500  <Link>      00:00:5e:00:01:05  1850600     0       75     0     0
carp5   1500  fe80::%carp fe80::200:5eff:fe  1850600     0       75     0     0
carp5   1500  2.3.1 2.3.1.100    1850600     0       75     0     0
carp6   1500  <Link>      00:00:5e:00:01:06  1481788     0      119     0     0
carp6   1500  fe80::%carp fe80::200:5eff:fe  1481788     0      119     0     0
carp6   1500  2.3.1 2.3.1.101    1481788     0      119     0     0
carp7   1500  <Link>      00:00:5e:00:01:07  1481614     0      152     0     0
carp7   1500  fe80::%carp fe80::200:5eff:fe  1481614     0      152     0     0
carp7   1500  2.3.1 2.3.1.102    1481614     0      152     0     0
carp8   1500  <Link>      00:00:5e:00:01:08  1707366     0      156     0     0
carp8   1500  fe80::%carp fe80::200:5eff:fe  1707366     0      156     0     0
carp8   1500  2.3.1 2.3.1.103    1707366     0      156     0     0
carp9   1500  <Link>      00:00:5e:00:01:09  1513065     0      200     0     0
carp9   1500  fe80::%carp fe80::200:5eff:fe  1513065     0      200     0     0
carp9   1500  2.3.1 2.3.1.104    1513065     0      200     0     0
Pestilence01 – netstat –ss
Code:
ip:
        639036250 total packets received
        62111877 packets for this host
        1771 packets for unknown/unsupported protocol
        551265989 packets forwarded
        31670 packets not forwardable
        1446102 packets sent from this host
        200417 output datagrams fragmented
        200417 fragments created
        153 datagrams with bad address in header
        639035482 input datagrams checksum-processed by hardware
        564047216 output datagrams checksum-processed by hardware
        2496996 multicast packets which we don't join
icmp:
        61828 calls to icmp_error
        Output packet histogram:
                echo reply: 1006454
                destination unreachable: 57103
                time exceeded: 549
                time stamp reply: 264
        1 message with bad length
        Input packet histogram:
                echo reply: 95
                destination unreachable: 959
                routing redirect: 2
                echo: 1006454
                time exceeded: 454
                time stamp: 264
                address mask request: 264
        1006718 message responses generated
igmp:
ipencap:
tcp:
        145924 packets sent
                67537 data packets (36528496 bytes)
                488 data packets (603745 bytes) retransmitted
                55354 ack-only packets (83977 delayed)
                3618 window update packets
                18927 control packets
        434832 packets received
                87300 acks (for 36215923 bytes)
                13735 duplicate acks
                98477 packets (23842484 bytes) received in-sequence
                172 completely duplicate packets (12041 bytes)
                3 packets with some duplicate data (192 bytes duplicated)
                2423 out-of-order packets (284088 bytes)
                136 window update packets
                21 packets received after close
                873 discarded for bad checksums
                433422 packets hardware-checksummed
        3408 connection requests
        13904 connection accepts
        14008 connections established (including accepts)
        18028 connections closed (including 707 drops)
        15 embryonic connections dropped
        86600 segments updated rtt (of 75159 attempts)
        2107 retransmit timeouts
                7 connections dropped by rexmit timeout
        9 keepalive timeouts
                9 keepalive probes sent
        2986 correct ACK header predictions
        45772 correct data packet header predictions
        299465 PCB cache misses
                        cwr by fastrecovery: 129
                        cwr by timeout: 2107
        87 bad connection attempts
        15302 SYN cache entries added
                13904 completed
                28 timed out
                1370 dropped due to RST
        166 SYN,ACKs retransmitted
        36 duplicate SYNs received for entries already in the cache
        129 SACK recovery episodes
                252 segment rexmits in SACK recovery episodes
                308742 byte rexmits in SACK recovery episodes
        1137 SACK options received
        336 SACK options sent
udp:
        172079 datagrams received
        115 with no checksum
        171949 input packets hardware-checksummed
        37425 dropped due to no socket
        118000 broadcast/multicast datagrams dropped due to no socket
        437 dropped due to full socket buffers
        16217 delivered
        15809 datagrams output
        37979 missed PCB cache
esp:
ah:
etherip:
ipcomp:
carp:
        57331672 packets received (IPv4)
                28651650 discarded for bad authentication
                28651525 discarded for unknown vhid
        2088619 packets sent (IPv4)
        35 transitions to master
pfsync:
        3166573 packets received (IPv4)
                57793 stale states
                40786 failed state lookup/inserts
        11135591 packets sent (IPv4)
divert:
pflow:
ip6:
        43828 total packets received
        377 packets sent from this host
        Input packet histogram:
                UDP: 43828
        Mbuf statistics:
                43828 one ext mbufs
        source addresses on an outgoing I/F
                35 link-locals
        source addresses of same scope
                35 link-locals
divert6:
icmp6:
        Output packet histogram:
                multicast listener report: 330
                neighbor solicitation: 12
                neighbor advertisement: 35
        Histogram of error messages to be generated:
pim6:
rip6:
Pestilence02 – netstat –ss
Code:
ip:
        136548635 total packets received
        106698935 packets for this host
        69 packets for unknown/unsupported protocol
        2799500 packets forwarded
        13449 packets not forwardable
        316806 packets sent from this host
        1418 output datagrams fragmented
        1418 fragments created
        817 datagrams with bad address in header
        136547245 input datagrams checksum-processed by hardware
        6286271 output datagrams checksum-processed by hardware
        15585652 multicast packets which we don't join
icmp:
        8578 calls to icmp_error
        Output packet histogram:
                echo reply: 86337
                destination unreachable: 6848
                time stamp reply: 9
        Input packet histogram:
                echo reply: 3
                destination unreachable: 47
                echo: 86337
                time exceeded: 10
                time stamp: 9
                address mask request: 9
        86346 message responses generated
igmp:
ipencap:
tcp:
        63770 packets sent
                34097 data packets (10395930 bytes)
                136 data packets (61045 bytes) retransmitted
                23843 ack-only packets (40448 delayed)
                14 window update packets
                5680 control packets
        230253 packets received
                42205 acks (for 10347655 bytes)
                5544 duplicate acks
                45514 packets (3261240 bytes) received in-sequence
                171 completely duplicate packets (7560 bytes)
                1 old duplicate packet
                9 packets with some duplicate data (728 bytes duplicated)
                575 out-of-order packets (8568 bytes)
                64 window update packets
                40 discarded for bad checksums
                229670 packets hardware-checksummed
        37 connection requests
        5548 connection accepts
        5564 connections established (including accepts)
        6298 connections closed (including 25 drops)
        18 embryonic connections dropped
        41002 segments updated rtt (of 35641 attempts)
        218 retransmit timeouts
                8 connections dropped by rexmit timeout
        9 keepalive timeouts
                9 keepalive probes sent
        219 correct ACK header predictions
        16803 correct data packet header predictions
        170664 PCB cache misses
                        cwr by fastrecovery: 17
                        cwr by timeout: 218
        170 bad connection attempts
        6774 SYN cache entries added
                5548 completed
                22 timed out
                1204 dropped due to RST
        122 SYN,ACKs retransmitted
        27 duplicate SYNs received for entries already in the cache
        17 SACK recovery episodes
                96 segment rexmits in SACK recovery episodes
                51984 byte rexmits in SACK recovery episodes
        511 SACK options received
        163 SACK options sent
udp:
        130271 datagrams received
        3 with no checksum
        130252 input packets hardware-checksummed
        2945 dropped due to no socket
        118018 broadcast/multicast datagrams dropped due to no socket
        35 dropped due to full socket buffers
        9273 delivered
        9263 datagrams output
        3187 missed PCB cache
esp:
ah:
etherip:
ipcomp:
carp:
        95118150 packets received (IPv4)
                28654734 discarded for bad authentication
                28654619 discarded for unknown vhid
        3268 packets sent (IPv4)
        1158 transitions to master
pfsync:
        11133915 packets received (IPv4)
                2 states discarded for bad values
                44339 stale states
                84527 failed state lookup/inserts
        3169127 packets sent (IPv4)
divert:
pflow:
ip6:
        43828 total packets received
        1500 packets sent from this host
        Input packet histogram:
                UDP: 43828
        Mbuf statistics:
                43828 one ext mbufs
        source addresses on an outgoing I/F
                1158 link-locals
        source addresses of same scope
                1158 link-locals
divert6:
icmp6:
        Output packet histogram:
                multicast listener report: 330
                neighbor solicitation: 12
                neighbor advertisement: 1158
        Histogram of error messages to be generated:
pim6:
rip6:
#
Pf.conf (identical on both machines)

Code:
ext_if="bge2"
int_if="bge1"
pfsync_if="bge0"
vlan27_if="vlan27"
vlan28_if="vlan28"
vlan29_if="vlan29"
vlan30_if="vlan30"
vlan31_if="vlan31"
vlan32_if="vlan32"
vlan33_if="vlan33"
vlan34_if="vlan34"
vlan35_if="vlan35"
icmp_types="echoreq"
ssh_ports="{ 22, 443, 80, 5455 }"
http_ports="{ 80, 443 }"
http_only="{ 80 }"

prod_int="10.0.206.0/24"
corp_int="10.0.207.0/24"
corp_dmz="7.8.9.216/29"
prod_dmz="2.3.1.64/26"

vlan_net="10.0.203.0/24"
vlan27_net="10.0.203.0/29"
vlan28_net="10.0.203.8/29"
vlan29_net="10.0.203.16/29"
vlan30_net="10.0.203.24/29"
vlan31_net="10.0.203.32/29"
vlan32_net="10.0.203.40/29"
vlan33_net="10.0.203.48/29"
vlan34_net="10.0.203.56/29"
vlan35_net="10.0.203.64/28"

gate_priv="10.0.206.1"


vpn_pptp="2.3.1.90"
elijah="10.0.206.240"
openvpn="10.0.206.241"

web_corp="2.3.1.100"  
web_portal="2.3.1.100"
web_portal1="2.3.1.101"
web_portal2="2.3.1.102"
web_portal3="2.3.1.103"
web_portal4="2.3.1.104"
web_portal5="2.3.1.105"
web_portal6="2.3.1.106"
web_portal7="2.3.1.107"
web_portal8="2.3.1.108"
web_portal9="2.3.1.110"

mail_mx01="2.3.1.111"

db_01="10.0.206.201"
db_02="10.0.206.202"
db_03="10.0.206.204"
db_04="10.0.207.205"

file_repgen="10.0.206.209"

partners_web_prod="2.3.1.109"
partners_web_stage="10.0.203.53"

prodweb_stage="10.0.206.41"
prodweb_prod="10.0.206.42"
prodwebstage="10.0.206.205"
prodwebprod="10.0.206.44"
prodwebapi="10.0.206.45"
prodwebtrain="10.0.206.46"
prodweb_cust01="10.0.206.47"
prodweb_cust02="10.0.206.48"
prodweb_cust03="10.0.206.49"

prodmail_mx01="10.0.206.31"

vlan_blogs="10.0.203.61"
proj01_web_prod="10.0.203.45"

psweb_portal="2.3.1.105"
psprodweb="10.0.206.204"

prod_update_ssh="2.3.1.117"

svvpn_ssh="2.3.1.77"
psvpn_ssh="2.3.1.78"
adsvpn_ssh="2.3.1.79" 
vpn_ssh="2.3.1.80" 

controller="10.0.203.13"
adscontroller="10.0.203.37"
pscontroller="10.0.203.29"
svcontroller="10.0.203.21"

table <BLOCKPERM> counters file "/etc/pf_block_permanent"


set skip on lo
set skip on bge0

set fingerprints "/etc/pf.os"
set block-policy drop
set loginterface $ext_if
set debug urgent
set reassemble yes
set require-order yes
set state-policy if-bound
set ruleset-optimization none

antispoof log quick for { $int_if ($ext_if) }
# quiet the log from HISNA cisco interface
 block quick on $ext_if inet proto udp from { 2.3.1.67 2.3.1.66 }  port 1985 to 224.0.0.2 port 1985

 block        quick on $ext_if inet proto tcp from <BLOCKPERM> to any 
 block        quick            inet6
 block in     quick on $ext_if inet           from any to 255.255.255.255

anchor "ftp-proxy/*"

# NAT-ING
pass  out on $ext_if    from !($ext_if)      to any         nat-to ($ext_if:0)
pass  out on $ext_if    from $controller     to any         nat-to $vpn_ssh
pass  out on $ext_if    from $svcontroller   to any         nat-to $svvpn_ssh
pass  out on $ext_if    from $elijah         to any         nat-to $vpn_pptp
pass  out on $ext_if    from $openvpn        to any         nat-to $vpn_pptp
pass  out on $ext_if    from $adscontroller  to any         nat-to $adsvpn_ssh
pass  out on $ext_if    from $prodmail_mx01  to any         nat-to $mail_mx01
pass  out on $ext_if    from $vlan_blogs     to any         nat-to $web_portal7

pass in inet proto tcp from $vlan_net to !$prod_int port 80  rdr-to 127.0.0.1 port 3128 keep state



match on $ext_if all scrub (random-id min-ttl 64 set-tos lowdelay reassemble tcp max-mss 1472)

pass in log on $int_if inet proto tcp from $int_if:network to !$int_if port ftp flags S/SAFR modulate state rdr-to lo0 port 8021
 

    block out  log       on $ext_if inet        from $vlan_net to any
    block out  log       on $int_if inet        from $vlan_net to any
    pass  out     on $int_if proto udp from $vlan_net to { 10.0.206.11 10.0.206.12 } port 53
    pass  out     on $int_if proto tcp from $vlan_net to {        $prodmail_mx01       } port 25

pass quick on  $pfsync_if   proto pfsync keep state (no-sync) 
pass on { $ext_if $int_if } proto carp   keep state 
pass in on $ext_if inet proto tcp from any              to $mail_mx01 port 25   rdr-to $prodmail_mx01 port  25
pass in on $ext_if inet proto tcp from any              to $mail_mx01 port 465  rdr-to $prodmail_mx01 port 465 
pass in on $ext_if inet proto tcp from 7.8.9.216/29  to $mail_mx01 port 80   rdr-to $prodmail_mx01 port  80
pass in on $ext_if inet proto tcp from 7.8.9.216/29  to $mail_mx01 port 443  rdr-to $prodmail_mx01 port 443
pass in on $ext_if inet proto tcp from       205.144.48.0/20   to $adsvpn_ssh port 22   rdr-to $adscontroller port 22
pass in on $ext_if inet proto tcp from { $corp_dmz $prod_dmz } to $adsvpn_ssh port 443  rdr-to $adscontroller port 443
pass in on $ext_if inet proto tcp from { $corp_dmz $prod_dmz } to $adsvpn_ssh port 22   rdr-to $adscontroller port 22
pass in on $ext_if inet proto tcp from { 63.123.254.0/25 7.8.9.216/29 } to $adsvpn_ssh port 10443   rdr-to $adscontroller port 10443
pass in on $ext_if inet proto tcp from any to $web_portal7  port 10022       rdr-to $vlan_blogs port 22 keep state
pass in on $ext_if inet proto tcp from any to $web_portal7  port 80          rdr-to $vlan_blogs port 80 keep state

pass out on { $vlan34_if $int_if } inet proto tcp from $vlan_blogs to 10.0.206.10 port 445 keep state
pass out on { $vlan34_if $ext_if } inet proto tcp from $vlan_blogs to 7.8.9.220  port 995 keep state

pass in on $ext_if inet proto tcp from $corp_dmz        to $web_portal8  port 22           rdr-to $proj01_web_prod port 22
pass in on $ext_if inet proto tcp from 205.174.165.0/24 to $web_portal8  port 22           rdr-to $proj01_web_prod port 22
pass in on $ext_if inet proto tcp from 81.145.41.160/27 to $web_portal8  port 22           rdr-to $proj01_web_prod port 22
pass in on $ext_if inet proto tcp from any              to $web_portal8  port 10022        rdr-to $proj01_web_prod port 22 
pass in on $ext_if inet proto tcp from any              to $web_portal8  port 80           rdr-to $proj01_web_prod port 80
pass in on $ext_if inet proto tcp from any              to $web_portal8  port 443          rdr-to $proj01_web_prod port 443
pass in on $ext_if inet proto tcp from any to $partners_web_prod port 10022       rdr-to $partners_web_stage port 22 keep state
pass in on $ext_if inet proto tcp from any to $partners_web_prod port 80          rdr-to $partners_web_stage port 80 keep state
pass in on $ext_if inet proto tcp from any to $psvpn_ssh    port $ssh_ports  rdr-to $pscontroller  port 22  
pass in on $ext_if inet proto tcp from any to $web_portal5  port 80          rdr-to $prodweb_cust02 port 80
pass in on $ext_if inet proto tcp from any to $web_portal5  port 443         rdr-to $prodweb_cust02 port 443
pass in on $ext_if inet proto tcp from any to $web_portal9  port 80          rdr-to $prodweb_cust03 port 80
pass in on $ext_if inet proto tcp from any to $web_portal9  port 443         rdr-to $prodweb_cust03 port 443
pass in on $ext_if inet proto tcp from any to $web_portal port 80   rdr-to $prodweb_prod port 80
pass in on $ext_if inet proto tcp from any to $web_portal port 443  rdr-to $prodweb_prod port 443
pass in on $ext_if inet proto tcp from any to $web_portal1 port 80  rdr-to $prodwebstage port 80
pass in on $ext_if inet proto tcp from any to $web_portal1 port 443 rdr-to $prodwebstage port 443
pass in on $ext_if inet proto tcp from any to $web_portal4 port 443 rdr-to $prodwebapi port 443
pass in on $ext_if inet proto tcp from any to $web_portal4 port 80  rdr-to $prodwebapi port 80
pass in on $ext_if inet proto tcp from any to $web_portal2 port 443 rdr-to $prodwebtrain port 443
pass in on $ext_if inet proto tcp from any to $web_portal2 port 80  rdr-to $prodwebtrain port 80
pass in on $ext_if inet proto tcp from any to $svvpn_ssh   port $ssh_ports  rdr-to $svcontroller      port 22  
pass in on $ext_if inet proto tcp from any to $web_portal6 port 80          rdr-to $prodweb_cust01 port 80
pass in on $ext_if inet proto tcp from any to $web_portal6 port 443         rdr-to $prodweb_cust01 port 443
pass in on $ext_if inet proto tcp from any to $web_portal3 port 80  rdr-to $prodwebprod port 80 
pass in on $ext_if inet proto tcp from any to $web_portal3 port 443 rdr-to $prodwebprod port 443
pass in on $ext_if inet proto tcp from  7.8.9.216/29 to $vpn_pptp port 1723 rdr-to $elijah port 1723
pass in on $ext_if inet proto udp from  7.8.9.216/29 to $vpn_pptp port 1194 rdr-to $openvpn port 1194
pass in on $ext_if      proto gre from  7.8.9.216/29 to $vpn_pptp           rdr-to $elijah
pass in on $ext_if inet proto tcp from any to $vpn_ssh port $ssh_ports         rdr-to $controller port 22
pass in on $ext_if inet proto tcp from any to $prod_update_ssh    port $ssh_ports  rdr-to 10.0.203.5  port 22  keep state
pass in on $int_if inet proto tcp from any to $prod_int           port 22          rdr-to $vlan27_net  port 22  keep state
pass in on $int_if inet proto tcp from 10.8.1.2 to $vlan27_net keep state
pass out on { $vlan27_if $int_if } inet proto tcp from $vlan27_net to $db_01 port 1433 keep state

pass out on { $vlan35_if $int_if } inet proto tcp from $vlan35_net to $db_01 port 1433 keep state
pass out on { $vlan35_if $int_if } inet proto tcp from $vlan35_net to $db_03      port 1433 keep state
pass out on { $vlan35_if $int_if } inet proto tcp from $vlan35_net to $db_02  port 1433 keep state
pass out on { $vlan35_if $int_if } inet proto tcp from $vlan35_net to $db_04   port 1433 keep state
pass out on { $vlan35_if $int_if } inet from $vlan35_net to { 10.0.206.11 10.0.206.12 } keep state
pass out on { $vlan35_if $int_if } inet from $vlan35_net to $file_repgen keep state
pass in on $int_if inet proto tcp from 10.8.1.2 to $vlan35_net keep state

pass in quick on $int_if inet proto tcp from $prod_int to any port 22 keep state

pass in quick inet proto icmp all icmp-type $icmp_types keep state
Reply With Quote
  #8   (View Single Post)  
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default

*whew* hope its not too much info. Just can't see why Pest 02 is taking it upon itself to failover.
Reply With Quote
  #9   (View Single Post)  
Old 7th November 2011
J65nko J65nko is offline
Administrator
 
Join Date: May 2008
Location: Budel - the Netherlands
Posts: 4,128
Default

First remark: from Pestilence01 – netstat –ss output:
Code:
carp:
        57331672 packets received (IPv4)
                28651650 discarded for bad authentication
                28651525 discarded for unknown vhid
        2088619 packets sent (IPv4)
        35 transitions to master
pfsync:
        3166573 packets received (IPv4)
                57793 stale states
                40786 failed state lookup/inserts
        11135591 packets sent (IPv4)
So you have 57,331,672 IPv4 packets received, of which 28,651,650 have been "discarded for bad authentication".
That is nearly 50% of the packets:
Code:
$ echo "scale=2 ; 28651650 / (57331672/100)" | bc 
49.97
I only played with carp in a network lab setting several years ago, but this doesn't seem very healthy to me

The same applies to the 28,651,525 that were discarded because of "unknown vhid".
__________________
You don't need to be a genius to debug a pf.conf firewall ruleset, you just need the guts to run tcpdump
Reply With Quote
Old 7th November 2011
J65nko J65nko is offline
Administrator
 
Join Date: May 2008
Location: Budel - the Netherlands
Posts: 4,128
Default

Snippet from your pf.conf

Code:
pass in on $ext_if inet proto tcp from any to $prod_update_ssh    port $ssh_ports  rdr-to 10.0.203.5  port 22  keep state
pass in on $int_if inet proto tcp from any to $prod_int           port 22          rdr-to $vlan27_net  port 22  keep state
"keep state flags S/SA" has already been the default for several releases. This creates state on the first packet of the 3-way TCP handshake. By omitting the "flags S/SA" part you allow states to be created on the intermediate packets too.
Unless you have a reason for doing this, you should drop all those "keep state"s

I notice you hardly use "quick", while at first glance your ruleset could benefit from it. See http://www.openbsd.org/faq/pf/filter.html#quick and the pf.conf man page.
__________________
You don't need to be a genius to debug a pf.conf firewall ruleset, you just need the guts to run tcpdump
Reply With Quote
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default

Thank you J65nko.

i have added in my quick's and stripped the keep states.


I have another, older, carp installation on my public DMZ that has two failover DNS servers. I am seeing the CARPv2 Adverts coming through on the public interface. I am going to turn those off and see if it alleviates the issue.
Reply With Quote
Old 7th November 2011
J65nko J65nko is offline
Administrator
 
Join Date: May 2008
Location: Budel - the Netherlands
Posts: 4,128
Default

You also can watch the carp traffic with tcpdump. I don't have carp running so I do not know whether it shows sufficient details to diagnose your issue.

From the tcpdump man page:
Code:
 ip proto proto     True if the packet is an IP packet (see ip(4)) of
                        protocol type proto.  proto can be a number or name
                        from protocols(5), such as icmp, udp, or tcp.  These
                        identifiers are also keywords and must be escaped
                        using a backslash character (`\').
Code:
$ grep carp /etc/protocols
carp    112     CARP    vrrp    # Common Address Redundancy Protocol
A syntax test on my non-carp re0 interface:
Code:
$ tcpdump -vveni re0  ip proto 112
tcpdump: listening on re0, link-type EN10MB
__________________
You don't need to be a genius to debug a pf.conf firewall ruleset, you just need the guts to run tcpdump
Reply With Quote
Old 7th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default

looks like my NSServers were attempting to use vhids 1 and 2 - they also had a advskew of 0, which could account for the high numbers in the netstat -ss.


i moved them to two unused vhids and bumped up the advskew to 20. It'll take a couple hours to see if that works. Intuition tells me that was part of the issue.


a side note,

my cross-over cable interface [bge0]

on one machine the media options show
Code:
bge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
        lladdr 00:10:18:14:8a:6a
        priority: 0
        media: Ethernet autoselect (1000baseT full-duplex,master)
        status: active
        inet 192.168.1.2 netmask 0xfffffffc broadcast 192.168.1.3
        inet6 fe80::210:18ff:fe14:8a6a%bge0 prefixlen 64 scopeid 0x1

The "master" part, is b/c its a cross over (the pest01 interface doesn't show as master)? If so, how does it decide who is master. I couldn't find reference to this on the web, except that state pointed to carp interfaces.

Last edited by nekron99; 7th November 2011 at 11:15 PM.
Reply With Quote
Old 7th November 2011
J65nko J65nko is offline
Administrator
 
Join Date: May 2008
Location: Budel - the Netherlands
Posts: 4,128
Default

It is mentioned in the ifconfig(8) man page:

Code:
CARP
     ifconfig carp-interface [advbase n] [advskew n] [balancing mode]
              [carpnodes vhid:advskew,vhid:advskew,...] [carpdev iface]
              [[-]carppeer peer_address] [pass passphrase] [state state]
              [vhid host-id]
[snip]

    state state
             Explicitly force the interface to enter this state.  Valid states
             are init, backup, and master.
__________________
You don't need to be a genius to debug a pf.conf firewall ruleset, you just need the guts to run tcpdump
Reply With Quote
Old 8th November 2011
nekron99 nekron99 is offline
Real Name: Waldo
New User
 
Join Date: Nov 2011
Location: Dallas, Texas
Posts: 9
Default

i changed, then eliminated the competing VHID from my DMZ bind servers. Rebooted the secondary Pestilence 02. The netstat -ss cleaned up nicely but the dmesg's still show failovers for no apparent reason.

Is there anywhere else i can look for the reason why pestilence2 feels the need to assert control over the carps?

Code:
Nov  8 10:33:32 pestilence2 /bsd: carp27: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp28: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp29: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp30: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp31: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp33: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp34: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp16: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp5: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp6: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp7: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp8: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp25: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp32: state transition: BACKUP -> MASTER
Nov  8 10:33:32 pestilence2 /bsd: carp35: state transition: BACKUP -> MASTER
Nov  8 10:33:52 pestilence2 /bsd: carp5: state transition: MASTER -> BACKUP
Nov  8 10:33:52 pestilence2 /bsd: carp1: state transition: BACKUP -> MASTER
Nov  8 10:33:52 pestilence2 /bsd: carp4: state transition: BACKUP -> MASTER
Nov  8 10:34:12 pestilence2 /bsd: carp16: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp4: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp6: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp7: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp8: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp1: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp32: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp35: state transition: MASTER -> BACKUP
Nov  8 10:34:12 pestilence2 /bsd: carp25: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp34: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp30: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp31: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp33: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp27: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp28: state transition: MASTER -> BACKUP
Nov  8 10:34:52 pestilence2 /bsd: carp29: state transition: MASTER -> BACKUP
Code:
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16
mtrr: Pentium Pro MTRR support
vscsi0 at root
scsibus0 at vscsi0: 256 targets
softraid0 at root
root on wd0a swap on wd0b dump on wd0b
carp: pfsync0 demoted group carp by 1 to 129 (pfsync bulk start)
carp: pfsync0 demoted group pfsync by 1 to 1 (pfsync bulk start)
carp: pfsync0 demoted group carp by -1 to 128 (pfsync bulk done)
carp: pfsync0 demoted group pfsync by -1 to 0 (pfsync bulk done)
carp10: state transition: BACKUP -> MASTER
carp11: state transition: BACKUP -> MASTER
carp12: state transition: BACKUP -> MASTER
carp13: state transition: BACKUP -> MASTER
carp14: state transition: BACKUP -> MASTER
carp15: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp17: state transition: BACKUP -> MASTER
carp18: state transition: BACKUP -> MASTER
carp19: state transition: BACKUP -> MASTER
carp24: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp9: state transition: BACKUP -> MASTER
carp24: state transition: MASTER -> BACKUP
carp17: state transition: MASTER -> BACKUP
carp18: state transition: MASTER -> BACKUP
carp19: state transition: MASTER -> BACKUP
carp10: state transition: MASTER -> BACKUP
carp11: state transition: MASTER -> BACKUP
carp12: state transition: MASTER -> BACKUP
carp13: state transition: MASTER -> BACKUP
carp14: state transition: MASTER -> BACKUP
carp15: state transition: MASTER -> BACKUP
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp5: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp9: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp27: state transition: BACKUP -> MASTER
carp28: state transition: BACKUP -> MASTER
carp29: state transition: BACKUP -> MASTER
carp30: state transition: BACKUP -> MASTER
carp31: state transition: BACKUP -> MASTER
carp33: state transition: BACKUP -> MASTER
carp34: state transition: BACKUP -> MASTER
carp16: state transition: BACKUP -> MASTER
carp5: state transition: BACKUP -> MASTER
carp6: state transition: BACKUP -> MASTER
carp7: state transition: BACKUP -> MASTER
carp8: state transition: BACKUP -> MASTER
carp25: state transition: BACKUP -> MASTER
carp32: state transition: BACKUP -> MASTER
carp35: state transition: BACKUP -> MASTER
carp5: state transition: MASTER -> BACKUP
carp1: state transition: BACKUP -> MASTER
carp4: state transition: BACKUP -> MASTER
carp16: state transition: MASTER -> BACKUP
carp4: state transition: MASTER -> BACKUP
carp6: state transition: MASTER -> BACKUP
carp7: state transition: MASTER -> BACKUP
carp8: state transition: MASTER -> BACKUP
carp1: state transition: MASTER -> BACKUP
carp32: state transition: MASTER -> BACKUP
carp35: state transition: MASTER -> BACKUP
carp25: state transition: MASTER -> BACKUP
carp34: state transition: MASTER -> BACKUP
carp30: state transition: MASTER -> BACKUP
carp31: state transition: MASTER -> BACKUP
carp33: state transition: MASTER -> BACKUP
carp27: state transition: MASTER -> BACKUP
carp28: state transition: MASTER -> BACKUP
carp29: state transition: MASTER -> BACKUP


netstat From Pestilence 02 - i haven't cleared counters/rebooted on pest01 yet.
Code:
# netstat -ss  
ip:
        279386 total packets received
        181147 packets for this host
        11861 packets forwarded
        117 packets not forwardable
        7503 packets sent from this host
        279386 input datagrams checksum-processed by hardware
        30334 output datagrams checksum-processed by hardware
        7973 multicast packets which we don't join
icmp:
        122 calls to icmp_error
        Output packet histogram:
                echo reply: 324
                destination unreachable: 122
        Input packet histogram:
                echo: 324
        324 message responses generated
igmp:
ipencap:
tcp:
        6361 packets sent
                3245 data packets (1082676 bytes)
                1 data packet (21 bytes) retransmitted
                2495 ack-only packets (4407 delayed)
                620 control packets
        7576 packets received
                4436 acks (for 1082987 bytes)
                626 duplicate acks
                5025 packets (329128 bytes) received in-sequence
                5 completely duplicate packets (488 bytes)
                1 out-of-order packet (0 bytes)
                7576 packets hardware-checksummed
        620 connection accepts
        620 connections established (including accepts)
        622 connections closed (including 0 drops)
        4376 segments updated rtt (of 3781 attempts)
        2 retransmit timeouts
        24 correct ACK header predictions
        1885 correct data packet header predictions
        1249 PCB cache misses
                        cwr by timeout: 2
        621 SYN cache entries added
                620 completed
                1 dropped due to RST
        2 SYN,ACKs retransmitted
        2 duplicate SYNs received for entries already in the cache
        3 SACK options received
udp:
        1088 datagrams received
        1088 input packets hardware-checksummed
        5 dropped due to no socket
        394 broadcast/multicast datagrams dropped due to no socket
        689 delivered
        695 datagrams output
        7 missed PCB cache
esp:
ah:
etherip:
ipcomp:
carp:
        130278 packets received (IPv4)
        63 packets sent (IPv4)
        35 transitions to master
pfsync:
        41881 packets received (IPv4)
                14 states discarded for bad values
                687 stale states
                277 failed state lookup/inserts
        10970 packets sent (IPv4)
divert:
pflow:
ip6:
        166 total packets received
        377 packets sent from this host
        Input packet histogram:
                UDP: 166
        Mbuf statistics:
                166 one ext mbufs
        source addresses on an outgoing I/F
                35 link-locals
        source addresses of same scope
                35 link-locals
divert6:
icmp6:
        Output packet histogram:
                multicast listener report: 330
                neighbor solicitation: 12
                neighbor advertisement: 35
        Histogram of error messages to be generated:
pim6:
rip6:
Reply With Quote
Old 8th November 2011
jggimi's Avatar
jggimi jggimi is offline
More noise than signal
 
Join Date: May 2008
Location: USA
Posts: 7,977
Default

Quote:
Is there anywhere else i can look for the reason why pestilence2 feels the need to assert control over the carps?
misc@ perhaps?
Reply With Quote
Old 8th November 2011
J65nko J65nko is offline
Administrator
 
Join Date: May 2008
Location: Budel - the Netherlands
Posts: 4,128
Default

It could be that pest2 somehow doesn't receive the carp advertisements from the master, and thus "thinks" the master is offline, so it should take over.

In http://www.daemonforums.org/showthre...496#post41341I mentioned how to use tcpdump to see carp traffic. You could try to see whether that shows what is going on.
__________________
You don't need to be a genius to debug a pf.conf firewall ruleset, you just need the guts to run tcpdump
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
CARP Abbass OpenBSD Security 3 13th April 2011 07:22 PM
Clustering with CARP revzalot OpenBSD General 10 17th September 2009 04:44 AM
CARP interface with DHClient xinform3n OpenBSD General 5 22nd July 2009 12:41 PM
carp configuration ohhcarp OpenBSD General 3 16th April 2009 10:50 PM


All times are GMT. The time now is 10:10 AM.


Powered by vBulletin® Version 3.8.4
Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.
Content copyright © 2007-2010, the authors
Daemon image copyright ©1988, Marshall Kirk McKusick