Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 22 Jun 2011 09:39:16 -0700
From:      Jack Vogel <jfvogel@gmail.com>
To:        Joshua Boyd <boydjd@jbip.net>
Cc:        freebsd-stable <freebsd-stable@freebsd.org>, "Vogel, Jack" <jack.vogel@intel.com>, Jeremy Chadwick <freebsd@jdc.parodius.com>
Subject:   Re: em0 watchdog timeouts on 8-STABLE
Message-ID:  <BANLkTi=6ssM3uMvkx3OqfbWJ0%2BaV75mXZg@mail.gmail.com>
In-Reply-To: <BANLkTimcn2QcgiVq347%2BiX%2B0puxmFVurCw@mail.gmail.com>
References:  <BANLkTinoyV61RzkB8HbHe=AY8zsBov4JXg@mail.gmail.com> <20110615075754.GA54879@icarus.home.lan> <BANLkTim_Y30cXNtvOGg_%2Bj4devU5VtiMxA@mail.gmail.com> <BANLkTininFrihBXvsKwAnheqE%2B%2BXoyhCVg@mail.gmail.com> <BANLkTi=UPCZms5-t5vgXoS7-ZK4VkXWy8w@mail.gmail.com> <BANLkTi=DpPykyjUaG6KkDG=dQ=xqfOMEHg@mail.gmail.com> <BANLkTi=BgY2_SsL6tjSsoRXszffSddVXNA@mail.gmail.com> <BANLkTimcn2QcgiVq347%2BiX%2B0puxmFVurCw@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Then its sounding to me like the em driver is a victim of your other I/O,
meaning
that the watchdogs are just an honest indicator of the driver not getting to
run
when it needs to.

This is also a side effect of running older hardware with legacy interrupts,
the
MSIX capable adapters would be less likely to get starved I suspect.  I
don't
know anything about ZFS so maybe someone else can help with tuning this??

Jack


On Wed, Jun 22, 2011 at 8:24 AM, Joshua Boyd <boydjd@jbip.net> wrote:

> :(
>
> I don't actually have problems normally with maxing out the throughput of
> the network. Watchdogs only occur when I've got heavy I/O occurring during
> ZFS scrubs across 2 mpt devices, at about 700MB/s. And then it doesn't
> matter what kind of traffic I'm running through em0, it still throws
> watchdogs. During the first occurrence it was actually pretty minimal
> traffic, less than 100KB/s.
>
> Are there any statistics that would be useful to you if I were to trigger
> the watchdogs again?
>
>
> On Wed, Jun 22, 2011 at 1:22 AM, Jack Vogel <jfvogel@gmail.com> wrote:
>
>> I cannot repro this, I used your kernel config, this is on a Dell 1850
>> btw,
>> I ran netperf stress from 3 clients, and have seen no watchdogs :(
>>
>> Jack
>>
>>
>>
>> On Tue, Jun 21, 2011 at 7:59 PM, Joshua Boyd <boydjd@jbip.net> wrote:
>>
>>> If needed, I can reproduce this on demand. Just need to know what sort of
>>> statistics are needed when the problem is occurring. I've had to turn off my
>>> weekly scrubs until I can figure out how to fix this problem.
>>>
>>>
>>> On Wed, Jun 15, 2011 at 8:37 PM, Joshua Boyd <boydjd@jbip.net> wrote:
>>>
>>>> In the kernel. Here's my kernel configuration:
>>>>
>>>> http://pastebin.com/raw.php?i=4JL814m3
>>>>
>>>>  On Wed, Jun 15, 2011 at 8:20 PM, Jack Vogel <jfvogel@gmail.com> wrote:
>>>>
>>>>> I have hardware now, am working on reproducing this. Just curious, do
>>>>> you have
>>>>> the em driver defined in the kernel, or as a module?
>>>>>
>>>>> Jack
>>>>>
>>>>>
>>>>> On Wed, Jun 15, 2011 at 2:09 AM, Joshua Boyd <boydjd@jbip.net> wrote:
>>>>>
>>>>>> On Wed, Jun 15, 2011 at 3:57 AM, Jeremy Chadwick
>>>>>> <freebsd@jdc.parodius.com>wrote:
>>>>>>
>>>>>> > On Wed, Jun 15, 2011 at 03:14:43AM -0400, Joshua Boyd wrote:
>>>>>> > > I recently updated my server to the latest 8-STABLE, and upgraded
>>>>>> to v28
>>>>>> > > ZFS. I have not had these problems on any other version of
>>>>>> 8-STABLE or
>>>>>> > > 7-STABLE, which this box was upgraded from some time ago.
>>>>>> > >
>>>>>> > > Now, during my weekly scrub, I get the following messages and em0
>>>>>> is
>>>>>> > > unresponsive:
>>>>>> > >
>>>>>> > > Jun 12 03:07:58 foghornleghorn kernel: em0: Watchdog timeout --
>>>>>> resetting
>>>>>> > > Jun 12 03:07:58 foghornleghorn kernel: em0: link state changed to
>>>>>> DOWN
>>>>>> > > Jun 12 03:08:01 foghornleghorn kernel: em0: link state changed to
>>>>>> UP
>>>>>> > > Jun 12 03:08:47 foghornleghorn kernel: em0: Watchdog timeout --
>>>>>> resetting
>>>>>> > > Jun 12 03:08:47 foghornleghorn kernel: em0: link state changed to
>>>>>> DOWN
>>>>>> > > Jun 12 03:08:50 foghornleghorn kernel: em0: link state changed to
>>>>>> UP
>>>>>> > >
>>>>>> > > My scrub is scheduled to start at 03:00:00, so it looks like
>>>>>> watchdog
>>>>>> > > timeouts start occurring pretty quickly once I/O ramps up.
>>>>>> > >
>>>>>> > > Here's some possibly relevant information, let me know if anything
>>>>>> else
>>>>>> > > would be helpful to troubleshoot.
>>>>>> > >
>>>>>> > > FreeBSD foghornleghorn.res.openband.net 8.2-STABLE FreeBSD
>>>>>> 8.2-STABLE
>>>>>> > #17:
>>>>>> > > Mon Jun  6 19:40:19 EDT 2011
>>>>>> > > root@foghornleghorn.res.openband.net:
>>>>>> /usr/obj/usr/src/sys/FOGHORNLEGHORN
>>>>>> > >  amd64
>>>>>> > >
>>>>>> > > em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
>>>>>> > 0xe800-0xe83f
>>>>>> > > mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device
>>>>>> 5.0 on
>>>>>> > pci7
>>>>>> > >
>>>>>> > > em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>>> rev=0x05
>>>>>> > > hdr=0x00
>>>>>> > >     vendor     = 'Intel Corporation'
>>>>>> > >     device     = 'Gigabit Ethernet Controller (Copper) rev 5
>>>>>> (82541PI)'
>>>>>> > >     class      = network
>>>>>> > >     subclass   = ethernet
>>>>>> > >
>>>>>> > > And, the SAS cards:
>>>>>> > >
>>>>>> > > dev.mpt.0.%desc: LSILogic SAS/SATA Adapter
>>>>>> > > dev.mpt.0.%driver: mpt
>>>>>> > > dev.mpt.0.%location: slot=0 function=0
>>>>>> > > dev.mpt.0.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
>>>>>> > > subdevice=0xa580 class=0x010000
>>>>>> > > dev.mpt.0.%parent: pci1
>>>>>> > > dev.mpt.0.debug: 3
>>>>>> > > dev.mpt.0.role: 1
>>>>>> > > dev.mpt.1.%desc: LSILogic SAS/SATA Adapter
>>>>>> > > dev.mpt.1.%driver: mpt
>>>>>> > > dev.mpt.1.%location: slot=0 function=0
>>>>>> > > dev.mpt.1.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x15d9
>>>>>> > > subdevice=0xa580 class=0x010000
>>>>>> > > dev.mpt.1.%parent: pci2
>>>>>> > > dev.mpt.1.debug: 3
>>>>>> > > dev.mpt.1.role: 1
>>>>>> > > dev.mpt.2.%desc: LSILogic SAS/SATA Adapter
>>>>>> > > dev.mpt.2.%driver: mpt
>>>>>> > > dev.mpt.2.%location: slot=0 function=0
>>>>>> > > dev.mpt.2.%pnpinfo: vendor=0x1000 device=0x0058 subvendor=0x1000
>>>>>> > > subdevice=0x30a0 class=0x010000
>>>>>> > > dev.mpt.2.%parent: pci6
>>>>>> > > dev.mpt.2.debug: 3
>>>>>> > > dev.mpt.2.role: 1
>>>>>> >
>>>>>> > Please provide output from the following commands (as root):
>>>>>> >
>>>>>> > # pciconf -lvcb
>>>>>> >
>>>>>>
>>>>>> hostb0@pci0:0:0:0: class=0x060000 card=0x59561002 chip=0x59561002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 GFX Dual Slot'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> pcib1@pci0:0:2:0: class=0x060400 card=0x59561002 chip=0x59781002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> pcib2@pci0:0:3:0: class=0x060400 card=0x59561002 chip=0x59791002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port B)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> pcib3@pci0:0:4:0: class=0x060400 card=0x59561002 chip=0x597a1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> pcib4@pci0:0:6:0: class=0x060400 card=0x59561002 chip=0x597c1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port C)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> pcib5@pci0:0:7:0: class=0x060400 card=0x59561002 chip=0x597d1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port D)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> pcib6@pci0:0:11:0: class=0x060400 card=0x59561002 chip=0x59801002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx1 port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> atapci4@pci0:0:18:0: class=0x01018f card=0x81ef1043 chip=0x43801002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 Serial ATA Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>> ohci0@pci0:0:19:0: class=0x0c0310 card=0x82881043 chip=0x43871002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI0)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> ohci1@pci0:0:19:1: class=0x0c0310 card=0x82881043 chip=0x43881002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI1)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> ohci2@pci0:0:19:2: class=0x0c0310 card=0x82881043 chip=0x43891002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI2)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> ohci3@pci0:0:19:3: class=0x0c0310 card=0x82881043 chip=0x438a1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI3)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> ohci4@pci0:0:19:4: class=0x0c0310 card=0x82881043 chip=0x438b1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI4)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> ehci0@pci0:0:19:5: class=0x0c0320 card=0x82881043 chip=0x43861002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (EHCI)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>> none0@pci0:0:20:0: class=0x0c0500 card=0x82881043 chip=0x43851002
>>>>>> rev=0x14
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'ATI SMBus (ATI RD600/RS600)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = SMBus
>>>>>> atapci5@pci0:0:20:1: class=0x01018a card=0x82881043 chip=0x438c1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'ATI RD600/RS600 IDE Controller (RD600/RS600)'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>> none1@pci0:0:20:2: class=0x040300 card=0x82881043 chip=0x43831002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 High Definition Audio Controller'
>>>>>>    class      = multimedia
>>>>>>    subclass   = HDA
>>>>>> isab0@pci0:0:20:3: class=0x060100 card=0x82881043 chip=0x438d1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 PCI to LPC Bridge'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-ISA
>>>>>> pcib7@pci0:0:20:4: class=0x060401 card=0x00000000 chip=0x43841002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 PCI to PCI Bridge'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> hostb1@pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x12001022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron HyperTransport
>>>>>> Technology Configuration'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb2@pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x12011022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Address Map'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb3@pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x12021022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron DRAM
>>>>>> Controller'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb4@pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x12031022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Miscellaneous
>>>>>> Control'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb5@pci0:0:24:4: class=0x060000 card=0x00000000 chip=0x12041022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Link Control'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> mpt0@pci0:1:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>> mpt1@pci0:2:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>> atapci0@pci0:3:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>>> rev=0xb1
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = '6121 SATA2 Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>> mskc0@pci0:4:0:0: class=0x020000 card=0x81f81043 chip=0x436411ab
>>>>>> rev=0x12
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = 'Yukon PCI-E Gigabit Ethernet Controller (88E8056)'
>>>>>>    class      = network
>>>>>>    subclass   = ethernet
>>>>>> atapci2@pci0:5:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>>> rev=0xb2
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = '6121 SATA2 Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>> mpt2@pci0:6:0:0: class=0x010000 card=0x30a01000 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>> em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>>> rev=0x05
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Intel Corporation'
>>>>>>    device     = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)'
>>>>>>    class      = network
>>>>>>    subclass   = ethernet
>>>>>> vgapci0@pci0:7:6:0: class=0x030000 card=0x00000000 chip=0x88115333
>>>>>> rev=0x44
>>>>>> hdr=0x00
>>>>>>    vendor     = 'S3 Graphics Co., Ltd'
>>>>>>    device     = '86C732 Trio32, 86C764 Trio64, 86C765 Trio64V+ Rev 01'
>>>>>>    class      = display
>>>>>>    subclass   = VGA
>>>>>> none2@pci0:7:8:0: class=0x0c0010 card=0x82941043 chip=0x581111c1
>>>>>> rev=0x70
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Lucent/Agere Systems (Was: AT&T MicroElectronics)'
>>>>>>    device     = '1394A PCI PHY/Link Open Host Ctrlr I/F (FW322)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = FireWire
>>>>>> [josh@foghornleghorn /var/log]$ sudo su -
>>>>>> foghornleghorn#  pciconf -lvcb
>>>>>> hostb0@pci0:0:0:0: class=0x060000 card=0x59561002 chip=0x59561002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 GFX Dual Slot'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>>    cap 08[c4] = HT slave
>>>>>>    cap 08[40] = HT retry mode
>>>>>>    cap 08[54] = HT unit ID clumping
>>>>>>    cap 08[9c] = HT unknown d03c
>>>>>> pcib1@pci0:0:2:0: class=0x060400 card=0x59561002 chip=0x59781002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> pcib2@pci0:0:3:0: class=0x060400 card=0x59561002 chip=0x59791002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx0 port B)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> pcib3@pci0:0:4:0: class=0x060400 card=0x59561002 chip=0x597a1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x2)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> pcib4@pci0:0:6:0: class=0x060400 card=0x59561002 chip=0x597c1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port C)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x1)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> pcib5@pci0:0:7:0: class=0x060400 card=0x59561002 chip=0x597d1002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (PCIe gpp port D)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x1(x1)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> pcib6@pci0:0:11:0: class=0x060400 card=0x59561002 chip=0x59801002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'RD790 PCI to PCI bridge (external gfx1 port A)'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>>    cap 01[50] = powerspec 3  supports D0 D3  current D0
>>>>>>    cap 10[58] = PCI-Express 2 root port max data 128(128) link x4(x8)
>>>>>>    cap 05[a0] = MSI supports 1 message
>>>>>>    cap 0d[b0] = PCI Bridge card=0x59561002
>>>>>>    cap 08[b8] = HT MSI fixed address window enabled at 0xfee00000
>>>>>> ecap 000b[100] = unknown 1
>>>>>> ecap 0002[110] = VC 1 max VC0
>>>>>> atapci4@pci0:0:18:0: class=0x01018f card=0x81ef1043 chip=0x43801002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 Serial ATA Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>>    bar   [10] = type I/O Port, range 32, base 0x5000, size  8, enabled
>>>>>>    bar   [14] = type I/O Port, range 32, base 0x4000, size  4, enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0x3000, size  8, enabled
>>>>>>    bar   [1c] = type I/O Port, range 32, base 0x2000, size  4, enabled
>>>>>>    bar   [20] = type I/O Port, range 32, base 0x1000, size 16, enabled
>>>>>>    bar   [24] = type Memory, range 32, base 0xf71ff800, size 1024,
>>>>>> enabled
>>>>>>    cap 01[60] = powerspec 2  supports D0 D3  current D0
>>>>>> ohci0@pci0:0:19:0: class=0x0c0310 card=0x82881043 chip=0x43871002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI0)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71fe000, size 4096,
>>>>>> enabled
>>>>>> ohci1@pci0:0:19:1: class=0x0c0310 card=0x82881043 chip=0x43881002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI1)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71fd000, size 4096,
>>>>>> enabled
>>>>>> ohci2@pci0:0:19:2: class=0x0c0310 card=0x82881043 chip=0x43891002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI2)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71fc000, size 4096,
>>>>>> enabled
>>>>>> ohci3@pci0:0:19:3: class=0x0c0310 card=0x82881043 chip=0x438a1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI3)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71fb000, size 4096,
>>>>>> enabled
>>>>>> ohci4@pci0:0:19:4: class=0x0c0310 card=0x82881043 chip=0x438b1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (OHCI4)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71fa000, size 4096,
>>>>>> enabled
>>>>>> ehci0@pci0:0:19:5: class=0x0c0320 card=0x82881043 chip=0x43861002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 USB Controller (EHCI)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = USB
>>>>>>    bar   [10] = type Memory, range 32, base 0xf71ff000, size 256,
>>>>>> enabled
>>>>>>    cap 01[c0] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>>    cap 05[d0] = MSI supports 1 message
>>>>>>    cap 0a[e4] = EHCI Debug Port at offset 0xe0 in map 0x14
>>>>>> none0@pci0:0:20:0: class=0x0c0500 card=0x82881043 chip=0x43851002
>>>>>> rev=0x14
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'ATI SMBus (ATI RD600/RS600)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = SMBus
>>>>>>    bar   [10] = type I/O Port, range 32, base 0xb00, size 16, enabled
>>>>>>    cap 08[b0] = HT MSI fixed address window disabled at 0xfee00000
>>>>>> atapci5@pci0:0:20:1: class=0x01018a card=0x82881043 chip=0x438c1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'ATI RD600/RS600 IDE Controller (RD600/RS600)'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>>    bar   [10] = type I/O Port, range 32, base 0x1f0, size  8, enabled
>>>>>>    bar   [14] = type I/O Port, range 32, base 0x3f4, size  1, enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0x170, size  8, enabled
>>>>>>    bar   [1c] = type I/O Port, range 32, base 0x374, size  1, enabled
>>>>>>    bar   [20] = type I/O Port, range 32, base 0xff00, size 16, enabled
>>>>>> none1@pci0:0:20:2: class=0x040300 card=0x82881043 chip=0x43831002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 High Definition Audio Controller'
>>>>>>    class      = multimedia
>>>>>>    subclass   = HDA
>>>>>>    bar   [10] = type Memory, range 64, base 0xf71f4000, size 16384,
>>>>>> enabled
>>>>>>    cap 01[50] = powerspec 2  supports D0 D3  current D0
>>>>>> isab0@pci0:0:20:3: class=0x060100 card=0x82881043 chip=0x438d1002
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 PCI to LPC Bridge'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-ISA
>>>>>> pcib7@pci0:0:20:4: class=0x060401 card=0x00000000 chip=0x43841002
>>>>>> rev=0x00
>>>>>> hdr=0x01
>>>>>>    vendor     = 'ATI Technologies Inc. / Advanced Micro Devices, Inc.'
>>>>>>    device     = 'IXP SB600 PCI to PCI Bridge'
>>>>>>    class      = bridge
>>>>>>    subclass   = PCI-PCI
>>>>>> hostb1@pci0:0:24:0: class=0x060000 card=0x00000000 chip=0x12001022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron HyperTransport
>>>>>> Technology Configuration'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>>    cap 08[80] = HT host
>>>>>> hostb2@pci0:0:24:1: class=0x060000 card=0x00000000 chip=0x12011022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Address Map'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb3@pci0:0:24:2: class=0x060000 card=0x00000000 chip=0x12021022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron DRAM
>>>>>> Controller'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> hostb4@pci0:0:24:3: class=0x060000 card=0x00000000 chip=0x12031022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Miscellaneous
>>>>>> Control'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>>    cap 0f[f0] = unknown
>>>>>> hostb5@pci0:0:24:4: class=0x060000 card=0x00000000 chip=0x12041022
>>>>>> rev=0x00
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Advanced Micro Devices (AMD)'
>>>>>>    device     = '(Family 10h) Athlon64/Opteron/Sempron Link Control'
>>>>>>    class      = bridge
>>>>>>    subclass   = HOST-PCI
>>>>>> mpt0@pci0:1:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>>    bar   [10] = type I/O Port, range 32, base 0x6000, size 256,
>>>>>> disabled
>>>>>>    bar   [14] = type Memory, range 64, base 0xf75fc000, size 16384,
>>>>>> enabled
>>>>>>    bar   [1c] = type Memory, range 64, base 0xf75e0000, size 65536,
>>>>>> enabled
>>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>>> mpt1@pci0:2:0:0: class=0x010000 card=0xa58015d9 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>>    bar   [10] = type I/O Port, range 32, base 0x7000, size 256,
>>>>>> disabled
>>>>>>    bar   [14] = type Memory, range 64, base 0xf78fc000, size 16384,
>>>>>> enabled
>>>>>>    bar   [1c] = type Memory, range 64, base 0xf78e0000, size 65536,
>>>>>> enabled
>>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>>> atapci0@pci0:3:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>>> rev=0xb1
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = '6121 SATA2 Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>>    bar   [10] = type I/O Port, range 32, base 0x9800, size  8, enabled
>>>>>>    bar   [14] = type I/O Port, range 32, base 0x9400, size  4, enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0x9000, size  8, enabled
>>>>>>    bar   [1c] = type I/O Port, range 32, base 0x8800, size  4, enabled
>>>>>>    bar   [20] = type I/O Port, range 32, base 0x8400, size 16, enabled
>>>>>>    bar   [24] = type Memory, range 32, base 0xf79ffc00, size 1024,
>>>>>> enabled
>>>>>>    cap 01[48] = powerspec 2  supports D0 D1 D3  current D0
>>>>>>    cap 05[50] = MSI supports 1 message
>>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>>> x1(x1)
>>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 2 corrected
>>>>>> mskc0@pci0:4:0:0: class=0x020000 card=0x81f81043 chip=0x436411ab
>>>>>> rev=0x12
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = 'Yukon PCI-E Gigabit Ethernet Controller (88E8056)'
>>>>>>    class      = network
>>>>>>    subclass   = ethernet
>>>>>>    bar   [10] = type Memory, range 64, base 0xf7afc000, size 16384,
>>>>>> enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0xa800, size 256,
>>>>>> enabled
>>>>>>    cap 01[48] = powerspec 3  supports D0 D1 D2 D3  current D0
>>>>>>    cap 03[50] = VPD
>>>>>>    cap 05[5c] = MSI supports 1 message, 64 bit enabled with 1 message
>>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>>> x1(x1)
>>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
>>>>>> atapci2@pci0:5:0:0: class=0x01018f card=0x612111ab chip=0x612111ab
>>>>>> rev=0xb2
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Marvell Semiconductor (Was: Galileo Technology Ltd)'
>>>>>>    device     = '6121 SATA2 Controller'
>>>>>>    class      = mass storage
>>>>>>    subclass   = ATA
>>>>>>    bar   [10] = type I/O Port, range 32, base 0xc800, size  8, enabled
>>>>>>    bar   [14] = type I/O Port, range 32, base 0xc400, size  4, enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0xc000, size  8, enabled
>>>>>>    bar   [1c] = type I/O Port, range 32, base 0xb800, size  4, enabled
>>>>>>    bar   [20] = type I/O Port, range 32, base 0xb400, size 16, enabled
>>>>>>    bar   [24] = type Memory, range 32, base 0xf7bffc00, size 1024,
>>>>>> enabled
>>>>>>    cap 01[48] = powerspec 2  supports D0 D1 D3  current D0
>>>>>>    cap 05[50] = MSI supports 1 message
>>>>>>    cap 10[e0] = PCI-Express 1 legacy endpoint max data 128(128) link
>>>>>> x1(x1)
>>>>>> ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected
>>>>>> mpt2@pci0:6:0:0: class=0x010000 card=0x30a01000 chip=0x00581000
>>>>>> rev=0x08
>>>>>> hdr=0x00
>>>>>>    vendor     = 'LSI Logic (Was: Symbios Logic, NCR)'
>>>>>>    device     = 'SAS 3000 series, 8-port with 1068E -StorPort'
>>>>>>    class      = mass storage
>>>>>>    subclass   = SCSI
>>>>>>    bar   [10] = type I/O Port, range 32, base 0xd000, size 256,
>>>>>> disabled
>>>>>>    bar   [14] = type Memory, range 64, base 0xf7ffc000, size 16384,
>>>>>> enabled
>>>>>>    bar   [1c] = type Memory, range 64, base 0xf7fe0000, size 65536,
>>>>>> enabled
>>>>>>    cap 01[50] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>>    cap 10[68] = PCI-Express 1 endpoint max data 128(4096) link x4(x8)
>>>>>>    cap 05[98] = MSI supports 1 message, 64 bit
>>>>>>    cap 11[b0] = MSI-X supports 1 message in map 0x14
>>>>>> ecap 0001[100] = AER 1 1 fatal 1 non-fatal 0 corrected
>>>>>> em0@pci0:7:5:0: class=0x020000 card=0x13768086 chip=0x107c8086
>>>>>> rev=0x05
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Intel Corporation'
>>>>>>    device     = 'Gigabit Ethernet Controller (Copper) rev 5 (82541PI)'
>>>>>>    class      = network
>>>>>>    subclass   = ethernet
>>>>>>     bar   [10] = type Memory, range 32, base 0xfebe0000, size 131072,
>>>>>> enabled
>>>>>>    bar   [14] = type Memory, range 32, base 0xfebc0000, size 131072,
>>>>>> enabled
>>>>>>    bar   [18] = type I/O Port, range 32, base 0xe800, size 64, enabled
>>>>>>    cap 01[dc] = powerspec 2  supports D0 D3  current D0
>>>>>>    cap 07[e4] = PCI-X supports 2048 burst read, 1 split transaction
>>>>>> vgapci0@pci0:7:6:0: class=0x030000 card=0x00000000 chip=0x88115333
>>>>>> rev=0x44
>>>>>> hdr=0x00
>>>>>>    vendor     = 'S3 Graphics Co., Ltd'
>>>>>>    device     = '86C732 Trio32, 86C764 Trio64, 86C765 Trio64V+ Rev 01'
>>>>>>    class      = display
>>>>>>    subclass   = VGA
>>>>>>    bar   [10] = type Memory, range 32, base 0xf8000000, size 67108864,
>>>>>> enabled
>>>>>> none2@pci0:7:8:0: class=0x0c0010 card=0x82941043 chip=0x581111c1
>>>>>> rev=0x70
>>>>>> hdr=0x00
>>>>>>    vendor     = 'Lucent/Agere Systems (Was: AT&T MicroElectronics)'
>>>>>>    device     = '1394A PCI PHY/Link Open Host Ctrlr I/F (FW322)'
>>>>>>    class      = serial bus
>>>>>>    subclass   = FireWire
>>>>>>    bar   [10] = type Memory, range 32, base 0xfeb8f000, size 4096,
>>>>>> enabled
>>>>>>    cap 01[44] = powerspec 2  supports D0 D1 D2 D3  current D0
>>>>>>
>>>>>>
>>>>>>
>>>>>> > # vmstat -i
>>>>>> >
>>>>>>
>>>>>> interrupt                          total       rate
>>>>>> irq9: acpi0                            1          0
>>>>>> irq16: atapci0+                        2          0
>>>>>> irq17: ohci1 ohci3                     3          0
>>>>>> irq18: mpt0 ohci2+               7066718         31
>>>>>> irq19: mpt1 atapci*              7798877         34
>>>>>> irq20: em0                      11715792         51
>>>>>> irq22: atapci4                    628883          2
>>>>>> cpu0: timer                    455853831       1999
>>>>>> irq256: mskc0                   97098730        425
>>>>>> cpu1: timer                    455845190       1999
>>>>>> Total                         1036008027       4544
>>>>>>
>>>>>>
>>>>>>
>>>>>> > # sysctl -a | grep msi
>>>>>> >
>>>>>>
>>>>>> hw.pci.honor_msi_blacklist: 1
>>>>>> hw.pci.enable_msix: 1
>>>>>> hw.pci.enable_msi: 1
>>>>>>
>>>>>>
>>>>>>
>>>>>> > # dmesg
>>>>>> >
>>>>>>
>>>>>> Copyright (c) 1992-2011 The FreeBSD Project.
>>>>>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993,
>>>>>> 1994
>>>>>> The Regents of the University of California. All rights reserved.
>>>>>> FreeBSD is a registered trademark of The FreeBSD Foundation.
>>>>>> FreeBSD 8.2-STABLE #17: Mon Jun  6 19:40:19 EDT 2011
>>>>>>    root@foghornleghorn.res.openband.net:
>>>>>> /usr/obj/usr/src/sys/FOGHORNLEGHORN
>>>>>> amd64
>>>>>> Timecounter "i8254" frequency 1193182 Hz quality 0
>>>>>> CPU: AMD Phenom(tm) II X2 555 Processor (3209.77-MHz K8-class CPU)
>>>>>>  Origin = "AuthenticAMD"  Id = 0x100f43  Family = 10  Model = 4
>>>>>>  Stepping =
>>>>>> 3
>>>>>>
>>>>>>
>>>>>> Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
>>>>>>  Features2=0x802009<SSE3,MON,CX16,POPCNT>
>>>>>>  AMD
>>>>>>
>>>>>> Features=0xee500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM,3DNow!+,3DNow!>
>>>>>>  AMD
>>>>>>
>>>>>> Features2=0x37ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT>
>>>>>>  TSC: P-state invariant
>>>>>> real memory  = 8589934592 (8192 MB)
>>>>>> avail memory = 8257736704 (7875 MB)
>>>>>> ACPI APIC Table: <092310 OEMAPIC >
>>>>>> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
>>>>>> FreeBSD/SMP: 1 package(s) x 2 core(s)
>>>>>>  cpu0 (BSP): APIC ID:  0
>>>>>>  cpu1 (AP): APIC ID:  1
>>>>>> ioapic0 <Version 2.1> irqs 0-23 on motherboard
>>>>>> acpi0: <092310 OEMRSDT> on motherboard
>>>>>> acpi0: [ITHREAD]
>>>>>> acpi0: Power Button (fixed)
>>>>>> acpi0: reservation of fee00000, 1000 (3) failed
>>>>>> acpi0: reservation of ffb80000, 80000 (3) failed
>>>>>> acpi0: reservation of fff00000, 100000 (3) failed
>>>>>> acpi0: reservation of 0, a0000 (3) failed
>>>>>> acpi0: reservation of 100000, dff00000 (3) failed
>>>>>> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
>>>>>> acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
>>>>>> cpu0: <ACPI CPU> on acpi0
>>>>>> cpu1: <ACPI CPU> on acpi0
>>>>>> acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff
>>>>>> on
>>>>>> acpi0
>>>>>> Timecounter "HPET" frequency 14318180 Hz quality 900
>>>>>> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>>>>>> pci0: <ACPI PCI bus> on pcib0
>>>>>> pcib1: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci0
>>>>>> pci1: <ACPI PCI bus> on pcib1
>>>>>> mpt0: <LSILogic SAS/SATA Adapter> port 0x6000-0x60ff mem
>>>>>> 0xf75fc000-0xf75fffff,0xf75e0000-0xf75effff irq 18 at device 0.0 on
>>>>>> pci1
>>>>>> mpt0: [ITHREAD]
>>>>>> mpt0: MPI Version=1.5.20.0
>>>>>> pcib2: <ACPI PCI-PCI bridge> irq 19 at device 3.0 on pci0
>>>>>> pci2: <ACPI PCI bus> on pcib2
>>>>>> mpt1: <LSILogic SAS/SATA Adapter> port 0x7000-0x70ff mem
>>>>>> 0xf78fc000-0xf78fffff,0xf78e0000-0xf78effff irq 19 at device 0.0 on
>>>>>> pci2
>>>>>> mpt1: [ITHREAD]
>>>>>> mpt1: MPI Version=1.5.20.0
>>>>>> pcib3: <ACPI PCI-PCI bridge> irq 16 at device 4.0 on pci0
>>>>>> pci3: <ACPI PCI bus> on pcib3
>>>>>> atapci0: <Marvell 88SX6121 UDMA133 controller> port
>>>>>> 0x9800-0x9807,0x9400-0x9403,0x9000-0x9007,0x8800-0x8803,0x8400-0x840f
>>>>>> mem
>>>>>> 0xf79ffc00-0xf79fffff irq 16 at device 0.0 on pci3
>>>>>> atapci0: [ITHREAD]
>>>>>> atapci1: <AHCI SATA controller> on atapci0
>>>>>> atapci1: [ITHREAD]
>>>>>> atapci1: AHCI v1.00 controller with 3 3Gbps ports, PM supported
>>>>>> ata2: <ATA channel 0> on atapci1
>>>>>> ata2: [ITHREAD]
>>>>>> ata3: <ATA channel 1> on atapci1
>>>>>> ata3: [ITHREAD]
>>>>>> ata4: <ATA channel 0> on atapci0
>>>>>> ata4: [ITHREAD]
>>>>>> pcib4: <ACPI PCI-PCI bridge> irq 18 at device 6.0 on pci0
>>>>>> pci4: <ACPI PCI bus> on pcib4
>>>>>> mskc0: <Marvell Yukon 88E8056 Gigabit Ethernet> port 0xa800-0xa8ff mem
>>>>>> 0xf7afc000-0xf7afffff irq 18 at device 0.0 on pci4
>>>>>> msk0: <Marvell Technology Group Ltd. Yukon EC Ultra Id 0xb4 Rev 0x03>
>>>>>> on
>>>>>> mskc0
>>>>>> msk0: Ethernet address: 00:1f:c6:e9:f8:7c
>>>>>> miibus0: <MII bus> on msk0
>>>>>> e1000phy0: <Marvell 88E1149 Gigabit PHY> PHY 0 on miibus0
>>>>>> e1000phy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
>>>>>> 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
>>>>>> mskc0: [ITHREAD]
>>>>>> pcib5: <ACPI PCI-PCI bridge> irq 19 at device 7.0 on pci0
>>>>>> pci5: <ACPI PCI bus> on pcib5
>>>>>> atapci2: <Marvell 88SX6121 UDMA133 controller> port
>>>>>> 0xc800-0xc807,0xc400-0xc403,0xc000-0xc007,0xb800-0xb803,0xb400-0xb40f
>>>>>> mem
>>>>>> 0xf7bffc00-0xf7bfffff irq 19 at device 0.0 on pci5
>>>>>> atapci2: [ITHREAD]
>>>>>> atapci3: <AHCI SATA controller> on atapci2
>>>>>> atapci3: [ITHREAD]
>>>>>> atapci3: AHCI v1.00 controller with 3 3Gbps ports, PM supported
>>>>>> ata5: <ATA channel 0> on atapci3
>>>>>> ata5: [ITHREAD]
>>>>>> ata6: <ATA channel 1> on atapci3
>>>>>> ata6: [ITHREAD]
>>>>>> ata7: <ATA channel 0> on atapci2
>>>>>> ata7: [ITHREAD]
>>>>>> pcib6: <ACPI PCI-PCI bridge> irq 19 at device 11.0 on pci0
>>>>>> pci6: <ACPI PCI bus> on pcib6
>>>>>> mpt2: <LSILogic SAS/SATA Adapter> port 0xd000-0xd0ff mem
>>>>>> 0xf7ffc000-0xf7ffffff,0xf7fe0000-0xf7feffff irq 19 at device 0.0 on
>>>>>> pci6
>>>>>> mpt2: [ITHREAD]
>>>>>> mpt2: MPI Version=1.5.19.0
>>>>>> atapci4: <ATI IXP600 SATA300 controller> port
>>>>>> 0x5000-0x5007,0x4000-0x4003,0x3000-0x3007,0x2000-0x2003,0x1000-0x100f
>>>>>> mem
>>>>>> 0xf71ff800-0xf71ffbff irq 22 at device 18.0 on pci0
>>>>>> atapci4: [ITHREAD]
>>>>>> atapci4: AHCI v1.10 controller with 4 3Gbps ports, PM supported
>>>>>> ata8: <ATA channel 0> on atapci4
>>>>>> ata8: port is not ready (timeout 0ms) tfd = 000001d0
>>>>>> ata8: software reset clear timeout
>>>>>> ata8: [ITHREAD]
>>>>>> ata9: <ATA channel 1> on atapci4
>>>>>> ata9: [ITHREAD]
>>>>>> ata10: <ATA channel 2> on atapci4
>>>>>> ata10: [ITHREAD]
>>>>>> ata11: <ATA channel 3> on atapci4
>>>>>> ata11: [ITHREAD]
>>>>>> ohci0: <OHCI (generic) USB controller> mem 0xf71fe000-0xf71fefff irq
>>>>>> 16 at
>>>>>> device 19.0 on pci0
>>>>>> ohci0: [ITHREAD]
>>>>>> usbus0: <OHCI (generic) USB controller> on ohci0
>>>>>> ohci1: <OHCI (generic) USB controller> mem 0xf71fd000-0xf71fdfff irq
>>>>>> 17 at
>>>>>> device 19.1 on pci0
>>>>>> ohci1: [ITHREAD]
>>>>>> usbus1: <OHCI (generic) USB controller> on ohci1
>>>>>> ohci2: <OHCI (generic) USB controller> mem 0xf71fc000-0xf71fcfff irq
>>>>>> 18 at
>>>>>> device 19.2 on pci0
>>>>>> ohci2: [ITHREAD]
>>>>>> usbus2: <OHCI (generic) USB controller> on ohci2
>>>>>> ohci3: <OHCI (generic) USB controller> mem 0xf71fb000-0xf71fbfff irq
>>>>>> 17 at
>>>>>> device 19.3 on pci0
>>>>>> ohci3: [ITHREAD]
>>>>>> usbus3: <OHCI (generic) USB controller> on ohci3
>>>>>> ohci4: <OHCI (generic) USB controller> mem 0xf71fa000-0xf71fafff irq
>>>>>> 18 at
>>>>>> device 19.4 on pci0
>>>>>> ohci4: [ITHREAD]
>>>>>> usbus4: <OHCI (generic) USB controller> on ohci4
>>>>>> ehci0: <EHCI (generic) USB 2.0 controller> mem 0xf71ff000-0xf71ff0ff
>>>>>> irq 19
>>>>>> at device 19.5 on pci0
>>>>>> ehci0: [ITHREAD]
>>>>>> ehci0: AMD SB600/700 quirk applied
>>>>>> usbus5: EHCI version 1.0
>>>>>> usbus5: <EHCI (generic) USB 2.0 controller> on ehci0
>>>>>> pci0: <serial bus, SMBus> at device 20.0 (no driver attached)
>>>>>> atapci5: <ATI IXP600 UDMA133 controller> port
>>>>>> 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xff00-0xff0f at device 20.1 on
>>>>>> pci0
>>>>>> ata0: <ATA channel 0> on atapci5
>>>>>> ata0: [ITHREAD]
>>>>>> pci0: <multimedia, HDA> at device 20.2 (no driver attached)
>>>>>> isab0: <PCI-ISA bridge> at device 20.3 on pci0
>>>>>> isa0: <ISA bus> on isab0
>>>>>> pcib7: <ACPI PCI-PCI bridge> at device 20.4 on pci0
>>>>>> pci7: <ACPI PCI bus> on pcib7
>>>>>> em0: <Intel(R) PRO/1000 Legacy Network Connection 1.0.3> port
>>>>>> 0xe800-0xe83f
>>>>>> mem 0xfebe0000-0xfebfffff,0xfebc0000-0xfebdffff irq 20 at device 5.0
>>>>>> on pci7
>>>>>> em0: [FILTER]
>>>>>> em0: Ethernet address: 00:1b:21:4e:e5:2e
>>>>>> vgapci0: <VGA-compatible display> mem 0xf8000000-0xfbffffff at device
>>>>>> 6.0 on
>>>>>> pci7
>>>>>> pci7: <serial bus, FireWire> at device 8.0 (no driver attached)
>>>>>> acpi_button0: <Power Button> on acpi0
>>>>>> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
>>>>>> acpi_hpet1: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff
>>>>>> on
>>>>>> acpi0
>>>>>> device_attach: acpi_hpet1 attach returned 12
>>>>>> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on
>>>>>> acpi0
>>>>>> uart0: [FILTER]
>>>>>> orm0: <ISA Option ROMs> at iomem
>>>>>> 0xc0000-0xc7fff,0xc8000-0xc87ff,0xc8800-0xc97ff on isa0
>>>>>> sc0: <System console> at flags 0x100 on isa0
>>>>>> sc0: VGA <16 virtual consoles, flags=0x300>
>>>>>> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
>>>>>> isa0
>>>>>> acpi_throttle0: <ACPI CPU Throttling> on cpu0
>>>>>> acpi_throttle0: CLK_VAL field overlaps THT_EN bit
>>>>>> device_attach: acpi_throttle0 attach returned 6
>>>>>> hwpstate0: <Cool`n'Quiet 2.0> on cpu0
>>>>>> Timecounters tick every 1.000 msec
>>>>>> usbus0: 12Mbps Full Speed USB v1.0
>>>>>> usbus1: 12Mbps Full Speed USB v1.0
>>>>>> usbus2: 12Mbps Full Speed USB v1.0
>>>>>> usbus3: 12Mbps Full Speed USB v1.0
>>>>>> usbus4: 12Mbps Full Speed USB v1.0
>>>>>> usbus5: 480Mbps High Speed USB v2.0
>>>>>> ugen0.1: <ATI> at usbus0
>>>>>> uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
>>>>>> ugen1.1: <ATI> at usbus1
>>>>>> uhub1: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
>>>>>> ugen2.1: <ATI> at usbus2
>>>>>> uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
>>>>>> ugen3.1: <ATI> at usbus3
>>>>>> uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
>>>>>> ugen4.1: <ATI> at usbus4
>>>>>> uhub4: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
>>>>>> ugen5.1: <ATI> at usbus5
>>>>>> uhub5: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
>>>>>> ad16: 476940MB <Seagate ST3500641NS 3.AEP> at ata8-master UDMA100 SATA
>>>>>> 3Gb/s
>>>>>> uhub0: 2 ports with 2 removable, self powered
>>>>>> uhub1: 2 ports with 2 removable, self powered
>>>>>> uhub2: 2 ports with 2 removable, self powered
>>>>>> uhub3: 2 ports with 2 removable, self powered
>>>>>> uhub4: 2 ports with 2 removable, self powered
>>>>>> da8 at mpt0 bus 0 scbus0 target 0 lun 0
>>>>>> da8: <ATA ST31000528AS CC38> Fixed Direct Access SCSI-5 device
>>>>>> da8: 300.000MB/s transfers
>>>>>> da8: Command Queueing enabled
>>>>>> da8: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da9 at mpt0 bus 0 scbus0 target 1 lun 0
>>>>>> da9: <ATA Hitachi HDS72101 A39C> Fixed Direct Access SCSI-5 device
>>>>>> da9: 300.000MB/s transfers
>>>>>> da9: Command Queueing enabled
>>>>>> da9: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da10 at mpt0 bus 0 scbus0 target 2 lun 0
>>>>>> da10: <ATA SAMSUNG HD103SJ 00E4> Fixed Direct Access SCSI-5 device
>>>>>> da10: 300.000MB/s transfers
>>>>>> da10: Command Queueing enabled
>>>>>> da10: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da11 at mpt0 bus 0 scbus0 target 3 lun 0
>>>>>> da11: <ATA SAMSUNG HD103SJ 00E4> Fixed Direct Access SCSI-5 device
>>>>>> da11: 300.000MB/s transfers
>>>>>> da11: Command Queueing enabled
>>>>>> da11: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da12 at mpt0 bus 0 scbus0 target 4 lun 0
>>>>>> da12: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>>> da12: 300.000MB/s transfers
>>>>>> da12: Command Queueing enabled
>>>>>> da12: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da13 at mpt0 bus 0 scbus0 target 5 lun 0
>>>>>> da13: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>>> da13: 300.000MB/s transfers
>>>>>> da13: Command Queueing enabled
>>>>>> da13: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da14 at mpt0 bus 0 scbus0 target 6 lun 0
>>>>>> da14: <ATA Hitachi HDS72101 A39C> Fixed Direct Access SCSI-5 device
>>>>>> da14: 300.000MB/s transfers
>>>>>> da14: Command Queueing enabled
>>>>>> da14: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da0 at mpt1 bus 0 scbus1 target 0 lun 0
>>>>>> da0: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>>> da0: 300.000MB/s transfers
>>>>>> da0: Command Queueing enabled
>>>>>> da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>>> da1 at mpt1 bus 0 scbus1 target 1 lun 0
>>>>>> da1: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>>> da1: 300.000MB/s transfers
>>>>>> da1: Command Queueing enabled
>>>>>> da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>>> da2 at mpt1 bus 0 scbus1 target 2 lun 0
>>>>>> da2: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>>> da2: 300.000MB/s transfers
>>>>>> da2: Command Queueing enabled
>>>>>> da2: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>>> da3 at mpt1 bus 0 scbus1 target 3 lun 0
>>>>>> da3: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>>> da3: 300.000MB/s transfers
>>>>>> da3: Command Queueing enabled
>>>>>> da3: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>>> da4 at mpt1 bus 0 scbus1 target 4 lun 0
>>>>>> da4: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-5 device
>>>>>> da4: 300.000MB/s transfers
>>>>>> da4: Command Queueing enabled
>>>>>> da4: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
>>>>>> da5 at mpt1 bus 0 scbus1 target 5 lun 0
>>>>>> da5: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>>> da5: 300.000MB/s transfers
>>>>>> da5: Command Queueing enabled
>>>>>> da5: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da6 at mpt1 bus 0 scbus1 target 6 lun 0
>>>>>> da6: <ATA ST31000340AS SD04> Fixed Direct Access SCSI-5 device
>>>>>> da6: 300.000MB/s transfers
>>>>>> da6: Command Queueing enabled
>>>>>> da6: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> da7 at mpt1 bus 0 scbus1 target 7 lun 0
>>>>>> da7: <ATA SAMSUNG HD103SI 1118> Fixed Direct Access SCSI-5 device
>>>>>> da7: 300.000MB/s transfers
>>>>>> da7: Command Queueing enabled
>>>>>> da7: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
>>>>>> SMP: AP CPU #1 Launched!
>>>>>> uhub5: 10 ports with 10 removable, self powered
>>>>>> GEOM: da7: geometry does not match label (16h,63s != 255h,63s).
>>>>>> Trying to mount root from ufs:/dev/ad16s1a
>>>>>> WARNING: / was not properly dismounted
>>>>>> ZFS filesystem version 5
>>>>>> ZFS storage pool version 28
>>>>>> WARNING: /tmp was not properly dismounted
>>>>>> WARNING: /usr was not properly dismounted
>>>>>> WARNING: /var was not properly dismounted
>>>>>> 0
>>>>>> mpt1: request 0xffffff80002c57f0:2369 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c57f0:2369 function 0
>>>>>> mpt1: mpt_wait_req(1) timed out
>>>>>> mpt1: mpt_recover_commands: abort timed-out. Resetting controller
>>>>>> mpt1: mpt_cam_event: 0x80
>>>>>> mpt1: mpt_cam_event: 0x80
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c57f0:2369
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x12
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c5c70:2375 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c5c70:2375 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c5c70:2375
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c5c70:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c5fd0:2379 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c5fd0:2379 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c5fd0:2379
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c5fd0:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c6210:2383 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c6210:2383 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6210:2383
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c6210:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c6180:2387 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c6180:2387 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6180:2387
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c6180:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c62a0:2391 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c62a0:2391 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c62a0:2391
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c62a0:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c6720:2395 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c6720:2395 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c6720:2395
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c6720:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: request 0xffffff80002c67b0:2399 timed out for ccb
>>>>>> 0xffffff00063bb000
>>>>>> (req->ccb 0xffffff00063bb000)
>>>>>> mpt1: attempting to abort req 0xffffff80002c67b0:2399 function 0
>>>>>> mpt1: completing timedout/aborted req 0xffffff80002c67b0:2399
>>>>>> mpt1:
>>>>>> abort of req 0xffffff80002c67b0:0 completed
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt1: mpt_cam_event: 0x16
>>>>>> mpt0: request 0xffffff80002a69e0:2082 timed out for ccb
>>>>>> 0xffffff0006389800
>>>>>> (req->ccb 0xffffff0006389800)
>>>>>> mpt0: attempting to abort req 0xffffff80002a69e0:2082 function 0
>>>>>> mpt0: completing timedout/aborted req 0xffffff80002a69e0:2082
>>>>>> mpt0: abort of req 0xffffff80002a69e0:0 completed
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: request 0xffffff80002a6c20:2086 timed out for ccb
>>>>>> 0xffffff0006389800
>>>>>> (req->ccb 0xffffff0006389800)
>>>>>> mpt0: attempting to abort req 0xffffff80002a6c20:2086 function 0
>>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6c20:2086
>>>>>> mpt0: abort of req 0xffffff80002a6c20:0 completed
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: request 0xffffff80002a6cb0:2090 timed out for ccb
>>>>>> 0xffffff0006389800
>>>>>> (req->ccb 0xffffff0006389800)
>>>>>> mpt0: attempting to abort req 0xffffff80002a6cb0:2090 function 0
>>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6cb0:2090
>>>>>> mpt0: abort of req 0xffffff80002a6cb0:0 completed
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: request 0xffffff80002a6b90:2094 timed out for ccb
>>>>>> 0xffffff0006389800
>>>>>> (req->ccb 0xffffff0006389800)
>>>>>> mpt0: attempting to abort req 0xffffff80002a6b90:2094 function 0
>>>>>> mpt0: completing timedout/aborted req 0xffffff80002a6b90:2094
>>>>>> mpt0: abort of req 0xffffff80002a6b90:0 completed
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> mpt0: mpt_cam_event: 0x16
>>>>>> tun0: link state changed to UP
>>>>>> (da8:mpt0:0:0:0): READ(10). CDB: 28 0 3e e2 6f 56 0 0 1 0
>>>>>> (da8:mpt0:0:0:0): CAM status: SCSI Status Error
>>>>>> (da8:mpt0:0:0:0): SCSI status: Check Condition
>>>>>> (da8:mpt0:0:0:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da11:mpt0:0:3:0): READ(10). CDB: 28 0 1a b6 92 0 0 0 80 0
>>>>>> (da11:mpt0:0:3:0): CAM status: SCSI Status Error
>>>>>> (da11:mpt0:0:3:0): SCSI status: Check Condition
>>>>>> (da11:mpt0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da2:mpt1:0:2:0): READ(10). CDB: 28 0 76 7b de 0 0 0 80 0
>>>>>> (da2:mpt1:0:2:0): CAM status: SCSI Status Error
>>>>>> (da2:mpt1:0:2:0): SCSI status: Check Condition
>>>>>> (da2:mpt1:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da10:mpt0:0:2:0): READ(10). CDB: 28 0 1a ff 67 80 0 0 80 0
>>>>>> (da10:mpt0:0:2:0): CAM status: SCSI Status Error
>>>>>> (da10:mpt0:0:2:0): SCSI status: Check Condition
>>>>>> (da10:mpt0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da5:mpt1:0:5:0): READ(10). CDB: 28 0 1a ff 67 80 0 0 80 0
>>>>>> (da5:mpt1:0:5:0): CAM status: SCSI Status Error
>>>>>> (da5:mpt1:0:5:0): SCSI status: Check Condition
>>>>>> (da5:mpt1:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da7:mpt1:0:7:0): READ(10). CDB: 28 0 40 d7 da 80 0 0 80 0
>>>>>> (da7:mpt1:0:7:0): CAM status: SCSI Status Error
>>>>>> (da7:mpt1:0:7:0): SCSI status: Check Condition
>>>>>> (da7:mpt1:0:7:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da6:mpt1:0:6:0): READ(10). CDB: 28 0 40 d7 da 80 0 0 80 0
>>>>>> (da6:mpt1:0:6:0): CAM status: SCSI Status Error
>>>>>> (da6:mpt1:0:6:0): SCSI status: Check Condition
>>>>>> (da6:mpt1:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da0:mpt1:0:0:0): READ(10). CDB: 28 0 76 91 87 e3 0 0 1 0
>>>>>> (da0:mpt1:0:0:0): CAM status: SCSI Status Error
>>>>>> (da0:mpt1:0:0:0): SCSI status: Check Condition
>>>>>> (da0:mpt1:0:0:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da3:mpt1:0:3:0): READ(10). CDB: 28 0 76 69 1 1c 0 0 1 0
>>>>>> (da3:mpt1:0:3:0): CAM status: SCSI Status Error
>>>>>> (da3:mpt1:0:3:0): SCSI status: Check Condition
>>>>>> (da3:mpt1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da1:mpt1:0:1:0): READ(10). CDB: 28 0 76 69 1 1c 0 0 1 0
>>>>>> (da1:mpt1:0:1:0): CAM status: SCSI Status Error
>>>>>> (da1:mpt1:0:1:0): SCSI status: Check Condition
>>>>>> (da1:mpt1:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da9:mpt0:0:1:0): READ(10). CDB: 28 0 1a b3 d7 0 0 0 80 0
>>>>>> (da9:mpt0:0:1:0): CAM status: SCSI Status Error
>>>>>> (da9:mpt0:0:1:0): SCSI status: Check Condition
>>>>>> (da9:mpt0:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>> (da4:mpt1:0:4:0): READ(10). CDB: 28 0 53 3c c6 0 0 0 80 0
>>>>>> (da4:mpt1:0:4:0): CAM status: SCSI Status Error
>>>>>> (da4:mpt1:0:4:0): SCSI status: Check Condition
>>>>>> (da4:mpt1:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on,
>>>>>> reset, or
>>>>>> bus device reset occurred)
>>>>>>
>>>>>>
>>>>>>
>>>>>> >
>>>>>> > --
>>>>>> > | Jeremy Chadwick
>>>>>> jdc@parodius.com |
>>>>>> > | Parodius Networking
>>>>>> http://www.parodius.com/ |
>>>>>> > | UNIX Systems Administrator                   Mountain View, CA, US
>>>>>> |
>>>>>> > | Making life hard for others since 1977.               PGP 4BD6C0CB
>>>>>> |
>>>>>> >
>>>>>> >
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Joshua Boyd
>>>>>> _______________________________________________
>>>>>> freebsd-stable@freebsd.org mailing list
>>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
>>>>>> To unsubscribe, send any mail to "
>>>>>> freebsd-stable-unsubscribe@freebsd.org"
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Joshua Boyd
>>>>
>>>
>>>
>>>
>>> --
>>> Joshua Boyd
>>>
>>>
>>> E-mail: boydjd@jbip.net
>>> http://www.jbip.net
>>>
>>
>>
>
>
> --
> Joshua Boyd
>
> E-mail: boydjd@jbip.net
> http://www.jbip.net
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?BANLkTi=6ssM3uMvkx3OqfbWJ0%2BaV75mXZg>