Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 7 Oct 2011 11:57:32 -0700
From:      Jason Wolfe <nitroboost@gmail.com>
To:        freebsd-net@freebsd.org
Subject:   Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled
Message-ID:  <CAAAm0r2MoFrGE_ubB_CX8jrV9cxobR-rsrZbRiRqBiLO_-Py4w@mail.gmail.com>
In-Reply-To: <CAFOYbc=6J%2B43sqMEO3gYGQXdOaOw2V4sV=xdgr3feKcc3qPM3A@mail.gmail.com>
References:  <CAAAm0r0RXEJo4UiKS=Ui0e5OQTg6sg-xcYf3mYB5%2Bvk8i8557w@mail.gmail.com> <CAFOYbc=6J%2B43sqMEO3gYGQXdOaOw2V4sV=xdgr3feKcc3qPM3A@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Jack,

Entirely possible there are multiple moving pieces here, the only bit I know
for certain is it's related to the different operation when running with MSI
vs MSI-X. Here is also my loader.conf for reference. I'm currently running
the modular congestion control stuff with cubic in use, but these issues
predate those changes also. Just to give you a scope of it though, it was
somewhat 'rare' for them to wedge. Out of a pool of ~2000 servers running
with the 82574L doing ~800Mb/s average, there were ~220 reports in a week.
So with some fuzzy math to put it in the same terms you were talking in, a
server in particular would hang about once every 9 weeks.

net.inet.tcp.cc.available: cubic, newreno
net.inet.tcp.cc.algorithm: cubic

loader.conf:
hw.pci.do_power_nodriver="3"
net.link.ifqmaxlen="1024"
net.inet.tcp.tcbhashsize="4096"
net.inet.tcp.syncache.hashsize="1024"
net.inet.tcp.syncache.bucketlimit="512"
net.inet.tcp.syncache.cachelimit="65536"
net.inet.tcp.hostcache.hashsize="1024"
net.inet.tcp.hostcache.bucketlimit="512"
net.inet.tcp.hostcache.cachelimit="65536"
hw.em.enable_msix="0"
hw.em.rxd="2048"
hw.em.txd="2048"
cc_cubic_load="YES"

Thanks again for looking into it.

Jason

On Thu, Oct 6, 2011 at 5:02 PM, Jack Vogel <jfvogel@gmail.com> wrote:

> There are plenty other users using the 574 with MSI-X without issue, so its
> likely
> more complicated than just that 1 variable. The issue discussed was like
> last year,
> it has to do with getting stuck in low power state, and my driver has code
> that addresses
> that. There was rigorous testing done at the performance center in Canada,
> got to
> the point of having a hang once in maybe 3 weeks, and then that was fixed.
> I have
> not heard of a problem from Mike since.
>
> So, I'd say something else must be coming into play here, I'll stare at the
> data
> a bit when I get a chance and see if anything jumps out at me.
>
> Jack
>
>
> On Thu, Oct 6, 2011 at 4:15 PM, Jason Wolfe <nitroboost@gmail.com> wrote:
>
>> I'm seeing the interface wedge on a good number of systems with Intel
>> 82574L
>> chips under FBSD8.2 _only when MSI-X is enabled_, running either 7.1.9
>> from
>> 8.2-RELEASE or 7.2.3 from 8.2-STABLE.  I have em0 and em1 in a lagg, but
>> only one side would fail, and a few systems that didn't have a lagg also
>> saw
>> the issue.  Higher traffic did seem to increase the likely hood of it
>> cropping up, but lower traffic server also showed the same issues
>> (anywhere
>> from 200Mb/s -> 1.8Gb/s).  This wedging on the Intel chips has been
>> discussed in many threads over the past year, though some have turned out
>> to
>> be various other issues.  I haven't seen reports of it being fixed by
>> disabling MSI-X via loader.conf, hw.em.enable_msix=0, so I figured I'd
>> start
>> a fresh one.
>>
>> The band aid for me was throwing a quick script into cron that watched for
>> incrementing drops and static outgoing packet counts from netstat, then
>> just
>> bounced the interface with ifconfig down/up.  Prior to the bounce I had it
>> emailing me the output of the following commands:
>>
>> vmstat -i
>> netstat -m
>> netstat -ndi
>> sysctl dev.em.X.debug=1
>> sysctl net.inet.ip.intr_queue_maxlen net.inet.ip.intr_queue_drops dev.em
>>
>> I have ~300 reports from over the course of a week or so while I played
>> with
>> various bits before finding MSI-X to be the culprit.  These were all
>> collected about a month ago, but as I'm seeing now the increased latency
>> with MSI-X disabled (as discussed in another thread) I'm more interested
>> in
>> seeing we can tackle this.  I can bounce them over to anyone interested.
>> Random one, follow by pciconf output:
>>
>> I bounced em1 because dropped packets incremented 3175498 to 3175688 and
>> the
>> interface is not incrementing packets out.
>>
>> interrupt total rate
>> irq3: uart1 94210 0
>> cpu0: timer 8536176695 2000
>> irq256: em0:rx 0 24657925778 5777
>> irq257: em0:tx 0 18016438387 4221
>> irq258: em0:link 1096 0
>> irq259: em1:rx 0 49440830 11
>> irq260: em1:tx 0 17831558454 4177
>> irq261: em1:link 3 0
>> irq262: mps0 971428418 227
>> cpu1: timer 8536168686 2000
>> cpu2: timer 8536168739 2000
>> cpu3: timer 8536168715 2000
>> Total 95671570011 22415
>>
>> 43620/31830/75450 mbufs in use (current/cache/total)
>> 8457/1825/10282/6192924 mbuf clusters in use (current/cache/total/max)
>> 8457/1490 mbuf+clusters out of packet secondary zone in use
>> (current/cache)
>> 32620/3569/36189/3096461 4k (page size) jumbo clusters in use
>> (current/cache/total/max)
>> 0/0/0/6400 9k jumbo clusters in use (current/cache/total/max)
>> 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max)
>> 158299K/25883K/184182K bytes allocated to network (current/cache/total)
>> 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
>> 0/0/0 requests for jumbo clusters denied (4k/9k/16k)
>> 0/0/0 sfbufs in use (current/peak/max)
>> 0 requests for sfbufs denied
>> 0 requests for sfbufs delayed
>> 0 requests for I/O initiated by sendfile
>> 0 calls to protocol drain routines
>>
>> Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop
>> em0 1500 <Link#1> 00:25:90:2c:a8:c8 70347342717 2290 0 53256848932 0 0
>> 1209615
>> em0 1500 fe80:1::225:9 fe80:1::225:90ff: 0 - - 5 - - -
>> em1 1500 <Link#2> 00:25:90:2c:a8:c8 49440879 0 0 50500079972 0 0 3176057
>> em1 1500 fe80:2::225:9 fe80:2::225:90ff: 0 - - 2 - - -
>> lagg0 1500 <Link#5> 00:25:90:2c:a8:c8 70396711726 0 0 103748441456 4385672
>> 0
>> 0
>> lagg0 1500 117.121.249.0 117.121.249.76 46351366311 - - 103757765366 - - -
>> lagg0 1500 fe80:5::225:9 fe80:5::225:90ff: 607 - - 674 - - -
>> lagg0 1500 2402:6800:730 2402:6800:730:12: 136847 - - 142450 - - -
>>
>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>> Aug 30 23:05:04 cds56 kernel: em0: hw tdh = 371, hw tdt = 376
>> Aug 30 23:05:04 cds56 kernel: em0: hw rdh = 923, hw rdt = 922
>> Aug 30 23:05:04 cds56 kernel: em0: Tx Queue Status = 0
>> Aug 30 23:05:04 cds56 kernel: em0: TX descriptors avail = 1014
>> Aug 30 23:05:04 cds56 kernel: em0: Tx Descriptors avail failure = 0
>> Aug 30 23:05:04 cds56 kernel: em0: RX discarded packets = 0
>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Check = 986
>> Aug 30 23:05:04 cds56 kernel: em0: RX Next to Refresh = 994
>> Aug 30 23:05:04 cds56 kernel: Interface is RUNNING and INACTIVE
>> Aug 30 23:05:04 cds56 kernel: em1: hw tdh = 78, hw tdt = 78
>> Aug 30 23:05:04 cds56 kernel: em1: hw rdh = 88, hw rdt = 87
>> Aug 30 23:05:04 cds56 kernel: em1: Tx Queue Status = 0
>> Aug 30 23:05:04 cds56 kernel: em1: TX descriptors avail = 1024
>> Aug 30 23:05:04 cds56 kernel: em1: Tx Descriptors avail failure = 0
>> Aug 30 23:05:04 cds56 kernel: em1: RX discarded packets = 0
>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Check = 88
>> Aug 30 23:05:04 cds56 kernel: em1: RX Next to Refresh = 88
>>
>> net.inet.ip.intr_queue_maxlen: 512
>> net.inet.ip.intr_queue_drops: 0
>> dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>> dev.em.0.%driver: em
>> dev.em.0.%location: slot=0 function=0
>> dev.em.0.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9
>> subdevice=0x10d3 class=0x020000
>> dev.em.0.%parent: pci1
>> dev.em.0.nvm: -1
>> dev.em.0.debug: -1
>> dev.em.0.rx_int_delay: 0
>> dev.em.0.tx_int_delay: 66
>> dev.em.0.rx_abs_int_delay: 66
>> dev.em.0.tx_abs_int_delay: 66
>> dev.em.0.rx_processing_limit: 100
>> dev.em.0.flow_control: 3
>> dev.em.0.link_irq: 1096
>> dev.em.0.mbuf_alloc_fail: 0
>> dev.em.0.cluster_alloc_fail: 0
>> dev.em.0.dropped: 0
>> dev.em.0.tx_dma_fail: 0
>> dev.em.0.rx_overruns: 0
>> dev.em.0.watchdog_timeouts: 0
>> dev.em.0.device_control: 1477444168
>> dev.em.0.rx_control: 67141634
>> dev.em.0.fc_high_water: 18432
>> dev.em.0.fc_low_water: 16932
>> dev.em.0.queue0.txd_head: 923
>> dev.em.0.queue0.txd_tail: 923
>> dev.em.0.queue0.tx_irq: 18016443069
>> dev.em.0.queue0.no_desc_avail: 0
>> dev.em.0.queue0.rxd_head: 620
>> dev.em.0.queue0.rxd_tail: 619
>> dev.em.0.queue0.rx_irq: 24617484192
>> dev.em.0.mac_stats.excess_coll: 0
>> dev.em.0.mac_stats.single_coll: 0
>> dev.em.0.mac_stats.multiple_coll: 0
>> dev.em.0.mac_stats.late_coll: 0
>> dev.em.0.mac_stats.collision_count: 0
>> dev.em.0.mac_stats.symbol_errors: 0
>> dev.em.0.mac_stats.sequence_errors: 0
>> dev.em.0.mac_stats.defer_count: 0
>> dev.em.0.mac_stats.missed_packets: 2290
>> dev.em.0.mac_stats.recv_no_buff: 2063
>> dev.em.0.mac_stats.recv_undersize: 0
>> dev.em.0.mac_stats.recv_fragmented: 0
>> dev.em.0.mac_stats.recv_oversize: 0
>> dev.em.0.mac_stats.recv_jabber: 0
>> dev.em.0.mac_stats.recv_errs: 0
>> dev.em.0.mac_stats.crc_errs: 0
>> dev.em.0.mac_stats.alignment_errs: 0
>> dev.em.0.mac_stats.coll_ext_errs: 0
>> dev.em.0.mac_stats.xon_recvd: 0
>> dev.em.0.mac_stats.xon_txd: 34
>> dev.em.0.mac_stats.xoff_recvd: 0
>> dev.em.0.mac_stats.xoff_txd: 2281
>> dev.em.0.mac_stats.total_pkts_recvd: 70347571042
>> dev.em.0.mac_stats.good_pkts_recvd: 70347568752
>> dev.em.0.mac_stats.bcast_pkts_recvd: 49354826
>> dev.em.0.mac_stats.mcast_pkts_recvd: 21430
>> dev.em.0.mac_stats.rx_frames_64: 24097227332
>> dev.em.0.mac_stats.rx_frames_65_127: 26282000524
>> dev.em.0.mac_stats.rx_frames_128_255: 117491895
>> dev.em.0.mac_stats.rx_frames_256_511: 397131263
>> dev.em.0.mac_stats.rx_frames_512_1023: 1048868288
>> dev.em.0.mac_stats.rx_frames_1024_1522: 18404849450
>> dev.em.0.mac_stats.good_octets_recvd: 32288605684532
>> dev.em.0.mac_stats.good_octets_txd: 59508100377248
>> dev.em.0.mac_stats.total_pkts_txd: 53257111032
>> dev.em.0.mac_stats.good_pkts_txd: 53257108716
>> dev.em.0.mac_stats.bcast_pkts_txd: 21098
>> dev.em.0.mac_stats.mcast_pkts_txd: 28465
>> dev.em.0.mac_stats.tx_frames_64: 1243827849
>> dev.em.0.mac_stats.tx_frames_65_127: 12126816593
>> dev.em.0.mac_stats.tx_frames_128_255: 260192405
>> dev.em.0.mac_stats.tx_frames_256_511: 196901153
>> dev.em.0.mac_stats.tx_frames_512_1023: 565384449
>> dev.em.0.mac_stats.tx_frames_1024_1522: 38863986268
>> dev.em.0.mac_stats.tso_txd: 0
>> dev.em.0.mac_stats.tso_ctx_fail: 0
>> dev.em.0.interrupts.asserts: 571
>> dev.em.0.interrupts.rx_pkt_timer: 0
>> dev.em.0.interrupts.rx_abs_timer: 0
>> dev.em.0.interrupts.tx_pkt_timer: 0
>> dev.em.0.interrupts.tx_abs_timer: 0
>> dev.em.0.interrupts.tx_queue_empty: 0
>> dev.em.0.interrupts.tx_queue_min_thresh: 0
>> dev.em.0.interrupts.rx_desc_min_thresh: 0
>> dev.em.0.interrupts.rx_overrun: 0
>> dev.em.1.%desc: Intel(R) PRO/1000 Network Connection 7.1.9
>> dev.em.1.%driver: em
>> dev.em.1.%location: slot=0 function=0
>> dev.em.1.%pnpinfo: vendor=0x8086 device=0x10d3 subvendor=0x15d9
>> subdevice=0x10d3 class=0x020000
>> dev.em.1.%parent: pci2
>> dev.em.1.nvm: -1
>> dev.em.1.debug: -1
>> dev.em.1.rx_int_delay: 0
>> dev.em.1.tx_int_delay: 66
>> dev.em.1.rx_abs_int_delay: 66
>> dev.em.1.tx_abs_int_delay: 66
>> dev.em.1.rx_processing_limit: 100
>> dev.em.1.flow_control: 3
>> dev.em.1.link_irq: 3
>> dev.em.1.mbuf_alloc_fail: 0
>> dev.em.1.cluster_alloc_fail: 0
>> dev.em.1.dropped: 0
>> dev.em.1.tx_dma_fail: 0
>> dev.em.1.rx_overruns: 0
>> dev.em.1.watchdog_timeouts: 0
>> dev.em.1.device_control: 1477444168
>> dev.em.1.rx_control: 67141634
>> dev.em.1.fc_high_water: 18432
>> dev.em.1.fc_low_water: 16932
>> dev.em.1.queue0.txd_head: 78
>> dev.em.1.queue0.txd_tail: 78
>> dev.em.1.queue0.tx_irq: 17831483878
>> dev.em.1.queue0.no_desc_avail: 0
>> dev.em.1.queue0.rxd_head: 104
>> dev.em.1.queue0.rxd_tail: 103
>> dev.em.1.queue0.rx_irq: 49440805
>> dev.em.1.mac_stats.excess_coll: 0
>> dev.em.1.mac_stats.single_coll: 0
>> dev.em.1.mac_stats.multiple_coll: 0
>> dev.em.1.mac_stats.late_coll: 0
>> dev.em.1.mac_stats.collision_count: 0
>> dev.em.1.mac_stats.symbol_errors: 0
>> dev.em.1.mac_stats.sequence_errors: 0
>> dev.em.1.mac_stats.defer_count: 0
>> dev.em.1.mac_stats.missed_packets: 0
>> dev.em.1.mac_stats.recv_no_buff: 0
>> dev.em.1.mac_stats.recv_undersize: 0
>> dev.em.1.mac_stats.recv_fragmented: 0
>> dev.em.1.mac_stats.recv_oversize: 0
>> dev.em.1.mac_stats.recv_jabber: 0
>> dev.em.1.mac_stats.recv_errs: 0
>> dev.em.1.mac_stats.crc_errs: 0
>> dev.em.1.mac_stats.alignment_errs: 0
>> dev.em.1.mac_stats.coll_ext_errs: 0
>> dev.em.1.mac_stats.xon_recvd: 0
>> dev.em.1.mac_stats.xon_txd: 0
>> dev.em.1.mac_stats.xoff_recvd: 0
>> dev.em.1.mac_stats.xoff_txd: 0
>> dev.em.1.mac_stats.total_pkts_recvd: 49440891
>> dev.em.1.mac_stats.good_pkts_recvd: 49440891
>> dev.em.1.mac_stats.bcast_pkts_recvd: 49419308
>> dev.em.1.mac_stats.mcast_pkts_recvd: 21444
>> dev.em.1.mac_stats.rx_frames_64: 49419319
>> dev.em.1.mac_stats.rx_frames_65_127: 21536
>> dev.em.1.mac_stats.rx_frames_128_255: 1
>> dev.em.1.mac_stats.rx_frames_256_511: 11
>> dev.em.1.mac_stats.rx_frames_512_1023: 13
>> dev.em.1.mac_stats.rx_frames_1024_1522: 11
>> dev.em.1.mac_stats.good_octets_recvd: 3165480294
>> dev.em.1.mac_stats.good_octets_txd: 58735098276348
>> dev.em.1.mac_stats.total_pkts_txd: 50500079972
>> dev.em.1.mac_stats.good_pkts_txd: 50500079972
>> dev.em.1.mac_stats.bcast_pkts_txd: 0
>> dev.em.1.mac_stats.mcast_pkts_txd: 5
>> dev.em.1.mac_stats.tx_frames_64: 1267032327
>> dev.em.1.mac_stats.tx_frames_65_127: 9722353368
>> dev.em.1.mac_stats.tx_frames_128_255: 265847363
>> dev.em.1.mac_stats.tx_frames_256_511: 198177596
>> dev.em.1.mac_stats.tx_frames_512_1023: 568826323
>> dev.em.1.mac_stats.tx_frames_1024_1522: 38477842995
>> dev.em.1.mac_stats.tso_txd: 0
>> dev.em.1.mac_stats.tso_ctx_fail: 0
>> dev.em.1.interrupts.asserts: 4
>> dev.em.1.interrupts.rx_pkt_timer: 0
>> dev.em.1.interrupts.rx_abs_timer: 0
>> dev.em.1.interrupts.tx_pkt_timer: 0
>> dev.em.1.interrupts.tx_abs_timer: 0
>> dev.em.1.interrupts.tx_queue_empty: 0
>> dev.em.1.interrupts.tx_queue_min_thresh: 0
>> dev.em.1.interrupts.rx_desc_min_thresh: 0
>> dev.em.1.interrupts.rx_overrun: 0
>>
>> hostb0@pci0:0:0:0: class=0x060000 card=0x00008086 chip=0x34068086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub to ESI Port'
>> class = bridge
>> subclass = HOST-PCI
>> pcib1@pci0:0:1:0: class=0x060400 card=0x00008086 chip=0x34088086 rev=0x22
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 1'
>> class = bridge
>> subclass = PCI-PCI
>> pcib2@pci0:0:2:0: class=0x060400 card=0x00008086 chip=0x34098086 rev=0x22
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 2'
>> class = bridge
>> subclass = PCI-PCI
>> pcib3@pci0:0:3:0: class=0x060400 card=0x00008086 chip=0x340a8086 rev=0x22
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 3'
>> class = bridge
>> subclass = PCI-PCI
>> pcib4@pci0:0:5:0: class=0x060400 card=0x00008086 chip=0x340c8086 rev=0x22
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 5'
>> class = bridge
>> subclass = PCI-PCI
>> pcib5@pci0:0:7:0: class=0x060400 card=0x00008086 chip=0x340e8086 rev=0x22
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub PCI Express Root Port 7'
>> class = bridge
>> subclass = PCI-PCI
>> ioapic0@pci0:0:19:0: class=0x080020 card=0x00000000 chip=0x342d8086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub I/OxAPIC Interrupt Controller'
>> class = base peripheral
>> subclass = interrupt controller
>> bar [10] = type Memory, range 32, base 0xfec8a000, size 4096, enabled
>> none0@pci0:0:20:0: class=0x080000 card=0x00000000 chip=0x342e8086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub System Management Registers'
>> class = base peripheral
>> subclass = interrupt controller
>> none1@pci0:0:20:1: class=0x080000 card=0x00000000 chip=0x34228086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub GPIO and Scratch Pad Registers'
>> class = base peripheral
>> subclass = interrupt controller
>> none2@pci0:0:20:2: class=0x080000 card=0x00000000 chip=0x34238086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub Control Status and RAS Registers'
>> class = base peripheral
>> subclass = interrupt controller
>> none3@pci0:0:20:3: class=0x080000 card=0x00000000 chip=0x34388086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'QuickPath Architecture I/O Hub Throttle Registers'
>> class = base peripheral
>> subclass = interrupt controller
>> none4@pci0:0:22:0: class=0x088000 card=0x000715d9 chip=0x34308086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbed8000, size 16384, enabled
>> none5@pci0:0:22:1: class=0x088000 card=0x000715d9 chip=0x34318086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbedc000, size 16384, enabled
>> none6@pci0:0:22:2: class=0x088000 card=0x000715d9 chip=0x34328086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbee0000, size 16384, enabled
>> none7@pci0:0:22:3: class=0x088000 card=0x000715d9 chip=0x34338086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbee4000, size 16384, enabled
>> none8@pci0:0:22:4: class=0x088000 card=0x000715d9 chip=0x34298086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbee8000, size 16384, enabled
>> none9@pci0:0:22:5: class=0x088000 card=0x000715d9 chip=0x342a8086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbeec000, size 16384, enabled
>> none10@pci0:0:22:6: class=0x088000 card=0x000715d9 chip=0x342b8086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbef0000, size 16384, enabled
>> none11@pci0:0:22:7: class=0x088000 card=0x000715d9 chip=0x342c8086
>> rev=0x22
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'DMA Engine'
>> class = base peripheral
>> bar [10] = type Memory, range 64, base 0xfbef4000, size 16384, enabled
>> none12@pci0:0:26:0: class=0x0c0300 card=0x000715d9 chip=0x3a378086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *4'
>> class = serial bus
>> subclass = USB
>> none13@pci0:0:26:1: class=0x0c0300 card=0x000715d9 chip=0x3a388086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *5'
>> class = serial bus
>> subclass = USB
>> none14@pci0:0:26:2: class=0x0c0300 card=0x000715d9 chip=0x3a398086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *6'
>> class = serial bus
>> subclass = USB
>> none15@pci0:0:26:7: class=0x0c0320 card=0x000715d9 chip=0x3a3c8086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB EHCI Controller *2'
>> class = serial bus
>> subclass = USB
>> none16@pci0:0:29:0: class=0x0c0300 card=0x000715d9 chip=0x3a348086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *1'
>> class = serial bus
>> subclass = USB
>> none17@pci0:0:29:1: class=0x0c0300 card=0x000715d9 chip=0x3a358086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *2'
>> class = serial bus
>> subclass = USB
>> none18@pci0:0:29:2: class=0x0c0300 card=0x000715d9 chip=0x3a368086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB UHCI Controller *3'
>> class = serial bus
>> subclass = USB
>> none19@pci0:0:29:7: class=0x0c0320 card=0x000715d9 chip=0x3a3a8086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'USB EHCI Controller *1'
>> class = serial bus
>> subclass = USB
>> pcib6@pci0:0:30:0: class=0x060401 card=0x000715d9 chip=0x244e8086
>> rev=0x90
>> hdr=0x01
>> vendor = 'Intel Corporation'
>> device = '82801 Family (ICH2/3/4/5/6/7/8/9,63xxESB) Hub Interface to PCI
>> Bridge'
>> class = bridge
>> subclass = PCI-PCI
>> isab0@pci0:0:31:0: class=0x060100 card=0x000715d9 chip=0x3a188086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'LPC Interface Controller'
>> class = bridge
>> subclass = PCI-ISA
>> atapci0@pci0:0:31:2: class=0x01018f card=0x000715d9 chip=0x3a208086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'SATA2(4Port2) (ICH10 Family)'
>> class = mass storage
>> subclass = ATA
>> bar [10] = type I/O Port, range 32, base 0xbc00, size 8, enabled
>> bar [14] = type I/O Port, range 32, base 0xb880, size 4, enabled
>> bar [18] = type I/O Port, range 32, base 0xb800, size 8, enabled
>> bar [1c] = type I/O Port, range 32, base 0xb480, size 4, enabled
>> bar [20] = type I/O Port, range 32, base 0xb400, size 16, enabled
>> bar [24] = type I/O Port, range 32, base 0xb080, size 16, enabled
>> none20@pci0:0:31:3: class=0x0c0500 card=0x000715d9 chip=0x3a308086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'SMB controller (50011458)'
>> class = serial bus
>> subclass = SMBus
>> bar [10] = type Memory, range 64, base 0xfbefa000, size 256, enabled
>> bar [20] = type I/O Port, range 32, base 0x400, size 32, enabled
>> atapci1@pci0:0:31:5: class=0x010185 card=0x000715d9 chip=0x3a268086
>> rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'SATA2(2Port2) (ICH10 Family)'
>> class = mass storage
>> subclass = ATA
>> bar [10] = type I/O Port, range 32, base 0xac00, size 8, enabled
>> bar [14] = type I/O Port, range 32, base 0xa880, size 4, enabled
>> bar [18] = type I/O Port, range 32, base 0xa800, size 8, enabled
>> bar [1c] = type I/O Port, range 32, base 0xa480, size 4, enabled
>> bar [20] = type I/O Port, range 32, base 0xa400, size 16, enabled
>> bar [24] = type I/O Port, range 32, base 0xa080, size 16, enabled
>> em0@pci0:1:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>> class = network
>> subclass = ethernet
>> bar [10] = type Memory, range 32, base 0xfbbe0000, size 131072, enabled
>> bar [18] = type I/O Port, range 32, base 0xcc00, size 32, enabled
>> bar [1c] = type Memory, range 32, base 0xfbbdc000, size 16384, enabled
>> em1@pci0:2:0:0: class=0x020000 card=0x10d315d9 chip=0x10d38086 rev=0x00
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> device = 'Intel 82574L Gigabit Ethernet Controller (82574L)'
>> class = network
>> subclass = ethernet
>> bar [10] = type Memory, range 32, base 0xfbce0000, size 131072, enabled
>> bar [18] = type I/O Port, range 32, base 0xdc00, size 32, enabled
>> bar [1c] = type Memory, range 32, base 0xfbcdc000, size 16384, enabled
>> mps0@pci0:4:0:0: class=0x010700 card=0x040015d9 chip=0x00721000 rev=0x02
>> hdr=0x00
>> vendor = 'LSI Logic (Was: Symbios Logic, NCR)'
>> class = mass storage
>> subclass = SAS
>> bar [10] = type I/O Port, range 32, base 0xe000, size 256, enabled
>> bar [14] = type Memory, range 64, base 0xfbd3c000, size 16384, enabled
>> bar [1c] = type Memory, range 64, base 0xfbd40000, size 262144, enabled
>> vgapci0@pci0:6:1:0: class=0x030000 card=0x000715d9 chip=0x0532102b
>> rev=0x0a
>> hdr=0x00
>> vendor = 'Matrox Electronic Systems Ltd.'
>> class = display
>> subclass = VGA
>> bar [10] = type Prefetchable Memory, range 32, base 0xf9000000, size
>> 16777216, enabled
>> bar [14] = type Memory, range 32, base 0xfaffc000, size 16384, enabled
>> bar [18] = type Memory, range 32, base 0xfb000000, size 8388608, enabled
>> hostb1@pci0:255:0:0: class=0x060000 card=0x80868086 chip=0x2c708086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb2@pci0:255:0:1: class=0x060000 card=0x80868086 chip=0x2d818086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb3@pci0:255:2:0: class=0x060000 card=0x80868086 chip=0x2d908086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb4@pci0:255:2:1: class=0x060000 card=0x80868086 chip=0x2d918086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb5@pci0:255:2:2: class=0x060000 card=0x80868086 chip=0x2d928086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb6@pci0:255:2:3: class=0x060000 card=0x80868086 chip=0x2d938086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb7@pci0:255:2:4: class=0x060000 card=0x80868086 chip=0x2d948086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb8@pci0:255:2:5: class=0x060000 card=0x80868086 chip=0x2d958086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb9@pci0:255:3:0: class=0x060000 card=0x80868086 chip=0x2d988086
>> rev=0x02
>> hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb10@pci0:255:3:1: class=0x060000 card=0x80868086 chip=0x2d998086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb11@pci0:255:3:2: class=0x060000 card=0x80868086 chip=0x2d9a8086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb12@pci0:255:3:4: class=0x060000 card=0x80868086 chip=0x2d9c8086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb13@pci0:255:4:0: class=0x060000 card=0x80868086 chip=0x2da08086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb14@pci0:255:4:1: class=0x060000 card=0x80868086 chip=0x2da18086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb15@pci0:255:4:2: class=0x060000 card=0x80868086 chip=0x2da28086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb16@pci0:255:4:3: class=0x060000 card=0x80868086 chip=0x2da38086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb17@pci0:255:5:0: class=0x060000 card=0x80868086 chip=0x2da88086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb18@pci0:255:5:1: class=0x060000 card=0x80868086 chip=0x2da98086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb19@pci0:255:5:2: class=0x060000 card=0x80868086 chip=0x2daa8086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb20@pci0:255:5:3: class=0x060000 card=0x80868086 chip=0x2dab8086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb21@pci0:255:6:0: class=0x060000 card=0x80868086 chip=0x2db08086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb22@pci0:255:6:1: class=0x060000 card=0x80868086 chip=0x2db18086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb23@pci0:255:6:2: class=0x060000 card=0x80868086 chip=0x2db28086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>> hostb24@pci0:255:6:3: class=0x060000 card=0x80868086 chip=0x2db38086
>> rev=0x02 hdr=0x00
>> vendor = 'Intel Corporation'
>> class = bridge
>> subclass = HOST-PCI
>>
>> Thank you in advance sirs!
>> Jason Wolfe
>> _______________________________________________
>> freebsd-net@freebsd.org mailing list
>> http://lists.freebsd.org/mailman/listinfo/freebsd-net
>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>>
>
>



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAAAm0r2MoFrGE_ubB_CX8jrV9cxobR-rsrZbRiRqBiLO_-Py4w>