Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 7 Oct 2011 15:24:43 -0400
From:      Arnaud Lacombe <lacombar@gmail.com>
To:        Jason Wolfe <nitroboost@gmail.com>
Cc:        freebsd-net@freebsd.org
Subject:   Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled
Message-ID:  <CACqU3MVUsO4eRS8rZannCO%2BKRf0T55aaYSXrkavi07LMofwreQ@mail.gmail.com>
In-Reply-To: <CAAAm0r2MoFrGE_ubB_CX8jrV9cxobR-rsrZbRiRqBiLO_-Py4w@mail.gmail.com>
References:  <CAAAm0r0RXEJo4UiKS=Ui0e5OQTg6sg-xcYf3mYB5%2Bvk8i8557w@mail.gmail.com> <CAFOYbc=6J%2B43sqMEO3gYGQXdOaOw2V4sV=xdgr3feKcc3qPM3A@mail.gmail.com> <CAAAm0r2MoFrGE_ubB_CX8jrV9cxobR-rsrZbRiRqBiLO_-Py4w@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi,

On Fri, Oct 7, 2011 at 2:57 PM, Jason Wolfe <nitroboost@gmail.com> wrote:
> Jack,
>
> Entirely possible there are multiple moving pieces here, the only bit I k=
now
> for certain is it's related to the different operation when running with =
MSI
> vs MSI-X. Here is also my loader.conf for reference. I'm currently runnin=
g
> the modular congestion control stuff with cubic in use, but these issues
> predate those changes also. Just to give you a scope of it though, it was
> somewhat 'rare' for them to wedge. Out of a pool of ~2000 servers running
> with the 82574L doing ~800Mb/s average, there were ~220 reports in a week=
.
> So with some fuzzy math to put it in the same terms you were talking in, =
a
> server in particular would hang about once every 9 weeks.
>
Just a two questions out of my mind:

Are the failing server evenly distributed, or always the same are failing ?

Did you collect the uptime and the kernel msgbuf of the server when
the issue triggered ?

Thanks,
 - Arnaud

> net.inet.tcp.cc.available: cubic, newreno
> net.inet.tcp.cc.algorithm: cubic
>
> loader.conf:
> hw.pci.do_power_nodriver=3D"3"
> net.link.ifqmaxlen=3D"1024"
> net.inet.tcp.tcbhashsize=3D"4096"
> net.inet.tcp.syncache.hashsize=3D"1024"
> net.inet.tcp.syncache.bucketlimit=3D"512"
> net.inet.tcp.syncache.cachelimit=3D"65536"
> net.inet.tcp.hostcache.hashsize=3D"1024"
> net.inet.tcp.hostcache.bucketlimit=3D"512"
> net.inet.tcp.hostcache.cachelimit=3D"65536"
> hw.em.enable_msix=3D"0"
> hw.em.rxd=3D"2048"
> hw.em.txd=3D"2048"
> cc_cubic_load=3D"YES"
>
> Thanks again for looking into it.
>
> Jason
>
> On Thu, Oct 6, 2011 at 5:02 PM, Jack Vogel <jfvogel@gmail.com> wrote:
>
>> There are plenty other users using the 574 with MSI-X without issue, so =
its
>> likely
>> more complicated than just that 1 variable. The issue discussed was like
>> last year,
>> it has to do with getting stuck in low power state, and my driver has co=
de
>> that addresses
>> that. There was rigorous testing done at the performance center in Canad=
a,
>> got to
>> the point of having a hang once in maybe 3 weeks, and then that was fixe=
d.
>> I have
>> not heard of a problem from Mike since.
>>
>> So, I'd say something else must be coming into play here, I'll stare at =
the
>> data
>> a bit when I get a chance and see if anything jumps out at me.
>>
>> Jack
>>
>>
>> On Thu, Oct 6, 2011 at 4:15 PM, Jason Wolfe <nitroboost@gmail.com> wrote=
:
>>
>>> I'm seeing the interface wedge on a good number of systems with Intel
>>> 82574L
>>> chips under FBSD8.2 _only when MSI-X is enabled_, running either 7.1.9
>>> from
>>> 8.2-RELEASE or 7.2.3 from 8.2-STABLE. =A0I have em0 and em1 in a lagg, =
but
>>> only one side would fail, and a few systems that didn't have a lagg als=
o
>>> saw
>>> the issue. =A0Higher traffic did seem to increase the likely hood of it
>>> cropping up, but lower traffic server also showed the same issues
>>> (anywhere
>>> from 200Mb/s -> 1.8Gb/s). =A0This wedging on the Intel chips has been
>>> discussed in many threads over the past year, though some have turned o=
ut
>>> to
>>> be various other issues. =A0I haven't seen reports of it being fixed by
>>> disabling MSI-X via loader.conf, hw.em.enable_msix=3D0, so I figured I'=
d
>>> start
>>> a fresh one.
>>>
>>> The band aid for me was throwing a quick script into cron that watched =
for
>>> incrementing drops and static outgoing packet counts from netstat, then
>>> just
>>> bounced the interface with ifconfig down/up. =A0Prior to the bounce I h=
ad it
>>> emailing me the output of the following commands:
>>>
>>> vmstat -i
>>> netstat -m
>>> netstat -ndi
>>> sysctl dev.em.X.debug=3D1
>>> sysctl net.inet.ip.intr_queue_maxlen net.inet.ip.intr_queue_drops dev.e=
m
>>>
>>> I have ~300 reports from over the course of a week or so while I played
>>> with
>>> various bits before finding MSI-X to be the culprit. =A0These were all
>>> collected about a month ago, but as I'm seeing now the increased latenc=
y
>>> with MSI-X disabled (as discussed in another thread) I'm more intereste=
d
>>> in
>>> seeing we can tackle this. =A0I can bounce them over to anyone interest=
ed.
>>> Random one, follow by pciconf output:
>>>
>>> I bounced em1 because dropped packets incremented 3175498 to 3175688 an=
d
>>> the
>>> interface is not incrementing packets out.
>>>
>>> interrupt total rate
>>> irq3: uart1 94210 0
>>> cpu0: timer 8536176695 2000
>>> irq256: em0:rx 0 24657925778 5777
>>> irq257: em0:tx 0 18016438387 4221
>>> irq258: em0:link 1096 0
>>> irq259: em1:rx 0 49440830 11
>>> irq260: em1:tx 0 17831558454 4177
>>> irq261: em1:link 3 0
>>> irq262: mps0 971428418 227
>>> cpu1: timer 8536168686 2000
>>> cpu2: timer 8536168739 2000
>>> cpu3: timer 8536168715 2000
>>> Total 95671570011 22415
>>>
>>> 43620/31830/75450 mbufs in use (current/cache/total)
>>> 8457/1825/10282/6192924 mbuf clusters in use (current/cache/total/max)
>>> 8457/1490 mbuf+clusters out of packet secondary zone in use
>>> (current/cache)
>>> 32620/3569/36189/3096461 4k (page size) jumbo clusters in use
>>> (current/cache/total/max)
>>> 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
>>> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
>>> 158299K/25883K/184182K bytes allocated to network (current/cache/total)
>>> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
>>> 0/0/0 requests for jumbo clusters denied (4k/9k/16k)
>>> 0/0/0 sfbufs in use (current/peak/max)
>>> 0 requests for sfbufs denied
>>> 0 requests for sfbufs delayed
>>> 0 requests for I/O initiated by sendfile
>>> 0 calls to protocol drain routines
>>>
>>> Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop
>>> em0 1500 <Link#1> 00:25:90:2c:a8:c8 70347342717 2290 0 53256848932 0 0
>>> 1209615
>>> em0 1500 fe80:1::225:9 fe80:1::225:90ff: 0 - - 5 - - -
>>> em1 1500 <Link#2> 00:25:90:2c:a8:c8 49440879 0 0 50500079972 0 0 317605=
7
>>> em1 1500 fe80:2::225:9 fe80:2::225:90ff: 0 - - 2 - - -
>>> lagg0 1500 <Link#5> 00:25:90:2c:a8:c8 70396711726 0 0 103748441456 4385=
672
>>> 0
>>> 0
>>> lagg0 1500 117.121.249.0 117.121.249.76 46351366311 - - 103757765366 - =
- -
>>> lagg0 1500 fe80:5::225:9 fe80:5::225:90ff: 607 - - 674 - - -
>>> lagg0 1500 2402:6800:730 2402:6800:730:12: 136847 - - 142450 - - -
>>>
>>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>>> Aug 30 23:05:04 cds56 kernel: em0: hw tdh =3D 371, hw tdt =3D 376
>>> Aug 30 23:05:04 cds56 kernel: em0: hw rdh =3D 923, hw rdt =3D 922
>>> Aug 30 23:05:04 cds56 kernel: em0: Tx Queue Status =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em0: TX descriptors avail =3D 1014
>>> Aug 30 23:05:04 cds56 kernel: em0: Tx Descriptors avail failure =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em0: RX discarded packets =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Check =3D 986
>>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Refresh =3D 994
>>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>>> Aug 30 23:05:04 cds56 kernel: em1: hw tdh =3D 78, hw tdt =3D 78
>>> Aug 30 23:05:04 cds56 kernel: em1: hw rdh =3D 88, hw rdt =3D 87
>>> Aug 30 23:05:04 cds56 kernel: em1: Tx Queue Status =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em1: TX descriptors avail =3D 1024
>>> Aug 30 23:05:04 cds56 kernel: em1: Tx Descriptors avail failure =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em1: RX discarded packets =3D 0
>>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Check =3D 88
>>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Refresh =3D 88
>>>
>>> net.inet.ip.intr_queue_maxlen: 512
>>> net.inet.ip.intr_queue_drops: 0
>>> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>>> dev.em.0.%driver: em
>>> dev.em.0.%location: slot=3D0 function=3D0
>>> dev.em.0.%pnpinfo: vendor=3D0x8086 device=3D0x10d3 subvendor=3D0x15d9
>>> subdevice=3D0x10d3 class=3D0x020000
>>> dev.em.0.%parent: pci1
>>> dev.em.0.nvm: -1
>>> dev.em.0.debug: -1
>>> dev.em.0.rx_int_delay: 0
>>> dev.em.0.tx_int_delay: 66
>>> dev.em.0.rx_abs_int_delay: 66
>>> dev.em.0.tx_abs_int_delay: 66
>>> dev.em.0.rx_processing_limit: 100
>>> dev.em.0.flow_control: 3
>>> dev.em.0.link_irq: 1096
>>> dev.em.0.mbuf_alloc_fail: 0
>>> dev.em.0.cluster_alloc_fail: 0
>>> dev.em.0.dropped: 0
>>> dev.em.0.tx_dma_fail: 0
>>> dev.em.0.rx_overruns: 0
>>> dev.em.0.watchdog_timeouts: 0
>>> dev.em.0.device_control: 1477444168
>>> dev.em.0.rx_control: 67141634
>>> dev.em.0.fc_high_water: 18432
>>> dev.em.0.fc_low_water: 16932
>>> dev.em.0.queue0.txd_head: 923
>>> dev.em.0.queue0.txd_tail: 923
>>> dev.em.0.queue0.tx_irq: 18016443069
>>> dev.em.0.queue0.no_desc_avail: 0
>>> dev.em.0.queue0.rxd_head: 620
>>> dev.em.0.queue0.rxd_tail: 619
>>> dev.em.0.queue0.rx_irq: 24617484192
>>> dev.em.0.mac_stats.excess_coll: 0
>>> dev.em.0.mac_stats.single_coll: 0
>>> dev.em.0.mac_stats.multiple_coll: 0
>>> dev.em.0.mac_stats.late_coll: 0
>>> dev.em.0.mac_stats.collision_count: 0
>>> dev.em.0.mac_stats.symbol_errors: 0
>>> dev.em.0.mac_stats.sequence_errors: 0
>>> dev.em.0.mac_stats.defer_count: 0
>>> dev.em.0.mac_stats.missed_packets: 2290
>>> dev.em.0.mac_stats.recv_no_buff: 2063
>>> dev.em.0.mac_stats.recv_undersize: 0
>>> dev.em.0.mac_stats.recv_fragmented: 0
>>> dev.em.0.mac_stats.recv_oversize: 0
>>> dev.em.0.mac_stats.recv_jabber: 0
>>> dev.em.0.mac_stats.recv_errs: 0
>>> dev.em.0.mac_stats.crc_errs: 0
>>> dev.em.0.mac_stats.alignment_errs: 0
>>> dev.em.0.mac_stats.coll_ext_errs: 0
>>> dev.em.0.mac_stats.xon_recvd: 0
>>> dev.em.0.mac_stats.xon_txd: 34
>>> dev.em.0.mac_stats.xoff_recvd: 0
>>> dev.em.0.mac_stats.xoff_txd: 2281
>>> dev.em.0.mac_stats.total_pkts_recvd: 70347571042
>>> dev.em.0.mac_stats.good_pkts_recvd: 70347568752
>>> dev.em.0.mac_stats.bcast_pkts_recvd: 49354826
>>> dev.em.0.mac_stats.mcast_pkts_recvd: 21430
>>> dev.em.0.mac_stats.rx_frames_64: 24097227332
>>> dev.em.0.mac_stats.rx_frames_65_127: 26282000524
>>> dev.em.0.mac_stats.rx_frames_128_255: 117491895
>>> dev.em.0.mac_stats.rx_frames_256_511: 397131263
>>> dev.em.0.mac_stats.rx_frames_512_1023: 1048868288
>>> dev.em.0.mac_stats.rx_frames_1024_1522: 18404849450
>>> dev.em.0.mac_stats.good_octets_recvd: 32288605684532
>>> dev.em.0.mac_stats.good_octets_txd: 59508100377248
>>> dev.em.0.mac_stats.total_pkts_txd: 53257111032
>>> dev.em.0.mac_stats.good_pkts_txd: 53257108716
>>> dev.em.0.mac_stats.bcast_pkts_txd: 21098
>>> dev.em.0.mac_stats.mcast_pkts_txd: 28465
>>> dev.em.0.mac_stats.tx_frames_64: 1243827849
>>> dev.em.0.mac_stats.tx_frames_65_127: 12126816593
>>> dev.em.0.mac_stats.tx_frames_128_255: 260192405
>>> dev.em.0.mac_stats.tx_frames_256_511: 196901153
>>> dev.em.0.mac_stats.tx_frames_512_1023: 565384449
>>> dev.em.0.mac_stats.tx_frames_1024_1522: 38863986268
>>> dev.em.0.mac_stats.tso_txd: 0
>>> dev.em.0.mac_stats.tso_ctx_fail: 0
>>> dev.em.0.interrupts.asserts: 571
>>> dev.em.0.interrupts.rx_pkt_timer: 0
>>> dev.em.0.interrupts.rx_abs_timer: 0
>>> dev.em.0.interrupts.tx_pkt_timer: 0
>>> dev.em.0.interrupts.tx_abs_timer: 0
>>> dev.em.0.interrupts.tx_queue_empty: 0
>>> dev.em.0.interrupts.tx_queue_min_thresh: 0
>>> dev.em.0.interrupts.rx_desc_min_thresh: 0
>>> dev.em.0.interrupts.rx_overrun: 0
>>> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>>> dev.em.1.%driver: em
>>> dev.em.1.%location: slot=3D0 function=3D0
>>> dev.em.1.%pnpinfo: vendor=3D0x8086 device=3D0x10d3 subvendor=3D0x15d9
>>> subdevice=3D0x10d3 class=3D0x020000
>>> dev.em.1.%parent: pci2
>>> dev.em.1.nvm: -1
>>> dev.em.1.debug: -1
>>> dev.em.1.rx_int_delay: 0
>>> dev.em.1.tx_int_delay: 66
>>> dev.em.1.rx_abs_int_delay: 66
>>> dev.em.1.tx_abs_int_delay: 66
>>> dev.em.1.rx_processing_limit: 100
>>> dev.em.1.flow_control: 3
>>> dev.em.1.link_irq: 3
>>> dev.em.1.mbuf_alloc_fail: 0
>>> dev.em.1.cluster_alloc_fail: 0
>>> dev.em.1.dropped: 0
>>> dev.em.1.tx_dma_fail: 0
>>> dev.em.1.rx_overruns: 0
>>> dev.em.1.watchdog_timeouts: 0
>>> dev.em.1.device_control: 1477444168
>>> dev.em.1.rx_control: 67141634
>>> dev.em.1.fc_high_water: 18432
>>> dev.em.1.fc_low_water: 16932
>>> dev.em.1.queue0.txd_head: 78
>>> dev.em.1.queue0.txd_tail: 78
>>> dev.em.1.queue0.tx_irq: 17831483878
>>> dev.em.1.queue0.no_desc_avail: 0
>>> dev.em.1.queue0.rxd_head: 104
>>> dev.em.1.queue0.rxd_tail: 103
>>> dev.em.1.queue0.rx_irq: 49440805
>>> dev.em.1.mac_stats.excess_coll: 0
>>> dev.em.1.mac_stats.single_coll: 0
>>> dev.em.1.mac_stats.multiple_coll: 0
>>> dev.em.1.mac_stats.late_coll: 0
>>> dev.em.1.mac_stats.collision_count: 0
>>> dev.em.1.mac_stats.symbol_errors: 0
>>> dev.em.1.mac_stats.sequence_errors: 0
>>> dev.em.1.mac_stats.defer_count: 0
>>> dev.em.1.mac_stats.missed_packets: 0
>>> dev.em.1.mac_stats.recv_no_buff: 0
>>> dev.em.1.mac_stats.recv_undersize: 0
>>> dev.em.1.mac_stats.recv_fragmented: 0
>>> dev.em.1.mac_stats.recv_oversize: 0
>>> dev.em.1.mac_stats.recv_jabber: 0
>>> dev.em.1.mac_stats.recv_errs: 0
>>> dev.em.1.mac_stats.crc_errs: 0
>>> dev.em.1.mac_stats.alignment_errs: 0
>>> dev.em.1.mac_stats.coll_ext_errs: 0
>>> dev.em.1.mac_stats.xon_recvd: 0
>>> dev.em.1.mac_stats.xon_txd: 0
>>> dev.em.1.mac_stats.xoff_recvd: 0
>>> dev.em.1.mac_stats.xoff_txd: 0
>>> dev.em.1.mac_stats.total_pkts_recvd: 49440891
>>> dev.em.1.mac_stats.good_pkts_recvd: 49440891
>>> dev.em.1.mac_stats.bcast_pkts_recvd: 49419308
>>> dev.em.1.mac_stats.mcast_pkts_recvd: 21444
>>> dev.em.1.mac_stats.rx_frames_64: 49419319
>>> dev.em.1.mac_stats.rx_frames_65_127: 21536
>>> dev.em.1.mac_stats.rx_frames_128_255: 1
>>> dev.em.1.mac_stats.rx_frames_256_511: 11
>>> dev.em.1.mac_stats.rx_frames_512_1023: 13
>>> dev.em.1.mac_stats.rx_frames_1024_1522: 11
>>> dev.em.1.mac_stats.good_octets_recvd: 3165480294
>>> dev.em.1.mac_stats.good_octets_txd: 58735098276348
>>> dev.em.1.mac_stats.total_pkts_txd: 50500079972
>>> dev.em.1.mac_stats.good_pkts_txd: 50500079972
>>> dev.em.1.mac_stats.bcast_pkts_txd: 0
>>> dev.em.1.mac_stats.mcast_pkts_txd: 5
>>> dev.em.1.mac_stats.tx_frames_64: 1267032327
>>> dev.em.1.mac_stats.tx_frames_65_127: 9722353368
>>> dev.em.1.mac_stats.tx_frames_128_255: 265847363
>>> dev.em.1.mac_stats.tx_frames_256_511: 198177596
>>> dev.em.1.mac_stats.tx_frames_512_1023: 568826323
>>> dev.em.1.mac_stats.tx_frames_1024_1522: 38477842995
>>> dev.em.1.mac_stats.tso_txd: 0
>>> dev.em.1.mac_stats.tso_ctx_fail: 0
>>> dev.em.1.interrupts.asserts: 4
>>> dev.em.1.interrupts.rx_pkt_timer: 0
>>> dev.em.1.interrupts.rx_abs_timer: 0
>>> dev.em.1.interrupts.tx_pkt_timer: 0
>>> dev.em.1.interrupts.tx_abs_timer: 0
>>> dev.em.1.interrupts.tx_queue_empty: 0
>>> dev.em.1.interrupts.tx_queue_min_thresh: 0
>>> dev.em.1.interrupts.rx_desc_min_thresh: 0
>>> dev.em.1.interrupts.rx_overrun: 0
>>>
>>> hostb0@pci0:0:0:0: class=3D0x060000 card=3D0x00008086 chip=3D0x34068086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub to ESI Port'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> pcib1@pci0:0:1:0: class=3D0x060400 card=3D0x00008086 chip=3D0x34088086 =
rev=3D0x22
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 1'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> pcib2@pci0:0:2:0: class=3D0x060400 card=3D0x00008086 chip=3D0x34098086 =
rev=3D0x22
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 2'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> pcib3@pci0:0:3:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340a8086 =
rev=3D0x22
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 3'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> pcib4@pci0:0:5:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340c8086 =
rev=3D0x22
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 5'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> pcib5@pci0:0:7:0: class=3D0x060400 card=3D0x00008086 chip=3D0x340e8086 =
rev=3D0x22
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub PCI Express Root Port 7'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> ioapic0@pci0:0:19:0: class=3D0x080020 card=3D0x00000000 chip=3D0x342d80=
86
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub I/OxAPIC Interrupt Controlle=
r'
>>> class =3D base peripheral
>>> subclass =3D interrupt controller
>>> bar [10] =3D type Memory, range 32, base 0xfec8a000, size 4096, enabled
>>> none0@pci0:0:20:0: class=3D0x080000 card=3D0x00000000 chip=3D0x342e8086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub System Management Registers'
>>> class =3D base peripheral
>>> subclass =3D interrupt controller
>>> none1@pci0:0:20:1: class=3D0x080000 card=3D0x00000000 chip=3D0x34228086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Registe=
rs'
>>> class =3D base peripheral
>>> subclass =3D interrupt controller
>>> none2@pci0:0:20:2: class=3D0x080000 card=3D0x00000000 chip=3D0x34238086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub Control Status and RAS Regis=
ters'
>>> class =3D base peripheral
>>> subclass =3D interrupt controller
>>> none3@pci0:0:20:3: class=3D0x080000 card=3D0x00000000 chip=3D0x34388086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'QuickPath Architecture I/O Hub Throttle Registers'
>>> class =3D base peripheral
>>> subclass =3D interrupt controller
>>> none4@pci0:0:22:0: class=3D0x088000 card=3D0x000715d9 chip=3D0x34308086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbed8000, size 16384, enable=
d
>>> none5@pci0:0:22:1: class=3D0x088000 card=3D0x000715d9 chip=3D0x34318086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbedc000, size 16384, enable=
d
>>> none6@pci0:0:22:2: class=3D0x088000 card=3D0x000715d9 chip=3D0x34328086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbee0000, size 16384, enable=
d
>>> none7@pci0:0:22:3: class=3D0x088000 card=3D0x000715d9 chip=3D0x34338086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbee4000, size 16384, enable=
d
>>> none8@pci0:0:22:4: class=3D0x088000 card=3D0x000715d9 chip=3D0x34298086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbee8000, size 16384, enable=
d
>>> none9@pci0:0:22:5: class=3D0x088000 card=3D0x000715d9 chip=3D0x342a8086
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbeec000, size 16384, enable=
d
>>> none10@pci0:0:22:6: class=3D0x088000 card=3D0x000715d9 chip=3D0x342b808=
6
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbef0000, size 16384, enable=
d
>>> none11@pci0:0:22:7: class=3D0x088000 card=3D0x000715d9 chip=3D0x342c808=
6
>>> rev=3D0x22
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'DMA Engine'
>>> class =3D base peripheral
>>> bar [10] =3D type Memory, range 64, base 0xfbef4000, size 16384, enable=
d
>>> none12@pci0:0:26:0: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a37808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *4'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none13@pci0:0:26:1: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a38808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *5'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none14@pci0:0:26:2: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a39808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *6'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none15@pci0:0:26:7: class=3D0x0c0320 card=3D0x000715d9 chip=3D0x3a3c808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB EHCI Controller *2'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none16@pci0:0:29:0: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a34808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *1'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none17@pci0:0:29:1: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a35808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *2'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none18@pci0:0:29:2: class=3D0x0c0300 card=3D0x000715d9 chip=3D0x3a36808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB UHCI Controller *3'
>>> class =3D serial bus
>>> subclass =3D USB
>>> none19@pci0:0:29:7: class=3D0x0c0320 card=3D0x000715d9 chip=3D0x3a3a808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'USB EHCI Controller *1'
>>> class =3D serial bus
>>> subclass =3D USB
>>> pcib6@pci0:0:30:0: class=3D0x060401 card=3D0x000715d9 chip=3D0x244e8086
>>> rev=3D0x90
>>> hdr=3D0x01
>>> vendor =3D 'Intel Corporation'
>>> device =3D '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to =
PCI
>>> Bridge'
>>> class =3D bridge
>>> subclass =3D PCI-PCI
>>> isab0@pci0:0:31:0: class=3D0x060100 card=3D0x000715d9 chip=3D0x3a188086
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'LPC Interface Controller'
>>> class =3D bridge
>>> subclass =3D PCI-ISA
>>> atapci0@pci0:0:31:2: class=3D0x01018f card=3D0x000715d9 chip=3D0x3a2080=
86
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'SATA2(4Port2) (ICH10 Family)'
>>> class =3D mass storage
>>> subclass =3D ATA
>>> bar [10] =3D type I/O Port, range 32, base 0xbc00, size 8, enabled
>>> bar [14] =3D type I/O Port, range 32, base 0xb880, size 4, enabled
>>> bar [18] =3D type I/O Port, range 32, base 0xb800, size 8, enabled
>>> bar [1c] =3D type I/O Port, range 32, base 0xb480, size 4, enabled
>>> bar [20] =3D type I/O Port, range 32, base 0xb400, size 16, enabled
>>> bar [24] =3D type I/O Port, range 32, base 0xb080, size 16, enabled
>>> none20@pci0:0:31:3: class=3D0x0c0500 card=3D0x000715d9 chip=3D0x3a30808=
6
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'SMB controller (50011458)'
>>> class =3D serial bus
>>> subclass =3D SMBus
>>> bar [10] =3D type Memory, range 64, base 0xfbefa000, size 256, enabled
>>> bar [20] =3D type I/O Port, range 32, base 0x400, size 32, enabled
>>> atapci1@pci0:0:31:5: class=3D0x010185 card=3D0x000715d9 chip=3D0x3a2680=
86
>>> rev=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'SATA2(2Port2) (ICH10 Family)'
>>> class =3D mass storage
>>> subclass =3D ATA
>>> bar [10] =3D type I/O Port, range 32, base 0xac00, size 8, enabled
>>> bar [14] =3D type I/O Port, range 32, base 0xa880, size 4, enabled
>>> bar [18] =3D type I/O Port, range 32, base 0xa800, size 8, enabled
>>> bar [1c] =3D type I/O Port, range 32, base 0xa480, size 4, enabled
>>> bar [20] =3D type I/O Port, range 32, base 0xa400, size 16, enabled
>>> bar [24] =3D type I/O Port, range 32, base 0xa080, size 16, enabled
>>> em0@pci0:1:0:0: class=3D0x020000 card=3D0x10d315d9 chip=3D0x10d38086 re=
v=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>>> class =3D network
>>> subclass =3D ethernet
>>> bar [10] =3D type Memory, range 32, base 0xfbbe0000, size 131072, enabl=
ed
>>> bar [18] =3D type I/O Port, range 32, base 0xcc00, size 32, enabled
>>> bar [1c] =3D type Memory, range 32, base 0xfbbdc000, size 16384, enable=
d
>>> em1@pci0:2:0:0: class=3D0x020000 card=3D0x10d315d9 chip=3D0x10d38086 re=
v=3D0x00
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> device =3D 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>>> class =3D network
>>> subclass =3D ethernet
>>> bar [10] =3D type Memory, range 32, base 0xfbce0000, size 131072, enabl=
ed
>>> bar [18] =3D type I/O Port, range 32, base 0xdc00, size 32, enabled
>>> bar [1c] =3D type Memory, range 32, base 0xfbcdc000, size 16384, enable=
d
>>> mps0@pci0:4:0:0: class=3D0x010700 card=3D0x040015d9 chip=3D0x00721000 r=
ev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'LSI Logic (Was: Symbios Logic, NCR)'
>>> class =3D mass storage
>>> subclass =3D SAS
>>> bar [10] =3D type I/O Port, range 32, base 0xe000, size 256, enabled
>>> bar [14] =3D type Memory, range 64, base 0xfbd3c000, size 16384, enable=
d
>>> bar [1c] =3D type Memory, range 64, base 0xfbd40000, size 262144, enabl=
ed
>>> vgapci0@pci0:6:1:0: class=3D0x030000 card=3D0x000715d9 chip=3D0x0532102=
b
>>> rev=3D0x0a
>>> hdr=3D0x00
>>> vendor =3D 'Matrox Electronic Systems Ltd.'
>>> class =3D display
>>> subclass =3D VGA
>>> bar [10] =3D type Prefetchable Memory, range 32, base 0xf9000000, size
>>> 16777216, enabled
>>> bar [14] =3D type Memory, range 32, base 0xfaffc000, size 16384, enable=
d
>>> bar [18] =3D type Memory, range 32, base 0xfb000000, size 8388608, enab=
led
>>> hostb1@pci0:255:0:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2c7080=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb2@pci0:255:0:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d8180=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb3@pci0:255:2:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9080=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb4@pci0:255:2:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9180=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb5@pci0:255:2:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9280=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb6@pci0:255:2:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9380=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb7@pci0:255:2:4: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9480=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb8@pci0:255:2:5: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9580=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb9@pci0:255:3:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9880=
86
>>> rev=3D0x02
>>> hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb10@pci0:255:3:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2d998=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb11@pci0:255:3:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9a8=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb12@pci0:255:3:4: class=3D0x060000 card=3D0x80868086 chip=3D0x2d9c8=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb13@pci0:255:4:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2da08=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb14@pci0:255:4:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2da18=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb15@pci0:255:4:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2da28=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb16@pci0:255:4:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2da38=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb17@pci0:255:5:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2da88=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb18@pci0:255:5:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2da98=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb19@pci0:255:5:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2daa8=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb20@pci0:255:5:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2dab8=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb21@pci0:255:6:0: class=3D0x060000 card=3D0x80868086 chip=3D0x2db08=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb22@pci0:255:6:1: class=3D0x060000 card=3D0x80868086 chip=3D0x2db18=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb23@pci0:255:6:2: class=3D0x060000 card=3D0x80868086 chip=3D0x2db28=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>> hostb24@pci0:255:6:3: class=3D0x060000 card=3D0x80868086 chip=3D0x2db38=
086
>>> rev=3D0x02 hdr=3D0x00
>>> vendor =3D 'Intel Corporation'
>>> class =3D bridge
>>> subclass =3D HOST-PCI
>>>
>>> Thank you in advance sirs!
>>> Jason Wolfe
>>> _______________________________________________
>>> freebsd-net@freebsd.org mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>>>
>>
>>
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CACqU3MVUsO4eRS8rZannCO%2BKRf0T55aaYSXrkavi07LMofwreQ>