Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 01 Dec 2014 23:54:31 -0200
From:      Marcelo Gondim <gondim@bsdinfo.com.br>
To:        "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Subject:   Re: Problems with Intel X520-SR2
Message-ID:  <547D1BD7.90502@bsdinfo.com.br>
In-Reply-To: <2A35EA60C3C77D438915767F458D65687E987C2A@ORSMSX111.amr.corp.intel.com>
References:  <547B3BFB.5000503@bsdinfo.com.br> <547B4033.1060504@FreeBSD.org> <CAJ-Vmo=Q8kvQY4E7Bru0Em7-J9xQU9JGzbP4UHJjU7OwVMZnug@mail.gmail.com> <CAFOYbcnEs0B7hW6K=9zjnpg7yWRwE%2BZ81kdVgvscb2hY0wB-TA@mail.gmail.com> <547BB862.6080801@bsdinfo.com.br> <547CC35A.1080108@bsdinfo.com.br> <2A35EA60C3C77D438915767F458D65687E987C2A@ORSMSX111.amr.corp.intel.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Hi Jeffrey,

On 01/12/2014 19:29, Pieper, Jeffrey E wrote:
> Hi Marcelo,
>
> A couple of questions - you are using 1310nm fiber on ix0, correct? The difference seems to be that ix0 is LR and ix1 is SR. Also, is there a reason that the interrupt rate is set higher for ix0?
>
> dev.ix.0.queue0.interrupt_rate: 50000
> dev.ix.1.queue0.interrupt_rate: 11627
Yep ix0 is LR because it is connected with a distant Operator and ix1 
with another Operator in same room. I have two clear channels one in 
each 10GbE port.
I try to do a manual balancing with BGP but still traffic on ix0 is 
slightly larger than the ix1.
Maybe that's why this difference in dev.ix.0.queue0.interrupt_rate and 
dev.ix.1.queue0.interrupt_rate.

My consumption of current band is 2.7Gbpsand I have 3Gbps 
downstream/upstream.

>
> Jeff
>
> -----Original Message-----
> From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd-net@freebsd.org] On Behalf Of Marcelo Gondim
> Sent: Monday, December 01, 2014 11:37 AM
> To: freebsd-net@freebsd.org
> Subject: Re: Problems with Intel X520-SR2
>
> On 30/11/2014 22:37, Marcelo Gondim wrote:
>> Hi Jack,
>>
>> On 30/11/2014 16:20, Jack Vogel wrote:
>>> Good suggestions, do you ever see any 'interrupt throttled' messages?
>>> You
>>> might
>>> want to change the storm threshold to 0 and disable it.
>> I can try this:
>>
>> sysctl hw.intr_storm_threshold=0
> Hi Jack,
>
> Same problem with hw.intr_storm_threshold=0
> I still think it might be something in my traffic that the driver is not
> dealing properly.
>
> # netstat -idn
> .
> .
> .
> ix0    1500 <Link#9>      00:1b:21:89:25:32 18446739080975184057   268
> 5876340155018 18446742570019979938 0     0     0
> ix0       - fe80::21b:21f fe80::21b:21ff:fe        0     - -
> 1     -     -     -
> ix1    1500 <Link#10>     00:1b:21:89:25:33 18446730999135967066     0
> 13653533351669 18446742457148273271 0     0     0
> ix1       - fe80::21b:21f fe80::21b:21ff:fe        0     - -
> 0     -     -     -
> .
> .
> .
>
> Are 5876340155018 dropped packets in ix0 and 13653533351669 dropped
> packets in ix1
>
> # w -n
>    5:35PM  up 15 days, 20:29, 2 users, load averages: 8.96, 9.03, 8.84
> USER       TTY      FROM                      LOGIN@  IDLE WHAT
> gondim     pts/1    186.xxx.48.8              5:22PM     - w -n
>
>
>>> I too would like to know if there are any messages when the 'hang'
>>> happens.
>> Nope. No message.  :(
>>
>>> I don't know much about lagg, is it responsible for link events?? Its
>>> not a
>>> normal
>>> situation to be having so many :(
>>>
>>> Jack
>>>
>>>
>>> On Sun, Nov 30, 2014 at 10:01 AM, Adrian Chadd <adrian@freebsd.org>
>>> wrote:
>>>
>>>> Your link_irq value is way too high. I think you're exposing some
>>>> unhandled corner case in the driver (as I had this issue when I had
>>>> some badly cabled up ixgbe NICs) but it doesn't happen when the ixgbe
>>>> driver isn't getting link events.
>>>>
>>>> My test setup at home has link_irq=1 on both sides, and it runs
>>>> full-duplex 10GE (1 mil pps transmit/receive on each NIC) traffic for
>>>> RSS testing for weeks at a time. I have no issues and no hiccups.
>>>> So, I think there's two problems:
>>>>
>>>> * you're still seeing way too many link_irq events; and
>>>> * i think there's some bad handling when it comes to link_irq events.
>>>>
>>>> I wonder if we're still clearing some of the interrupt register bits
>>>> incorrectly in ixgbe_msix_link().
>>>>
>>>>
>>>> -adrian
>>>>
>>>>
>>>>
>>>>
>>>> -adrian
>>>>
>>>>
>>>> On 30 November 2014 at 08:05, Alexander V. Chernikov
>>>> <melifaro@freebsd.org> wrote:
>>>>> On 30.11.2014 18:47, Marcelo Gondim wrote:
>>>>>> Dear,
>>>>>>
>>>>>> Unfortunately I have more options to resolve this problem I'm having
>>>> with
>>>>>> Intel X520-SR2. Have we changed the X520, we exchange the optical
>>>>>> cords,
>>>>>> exchanged optical modules, we changed the entire server, we reduce
>>>>>> the
>>>>>> temperature inside the equipment, made some attempts to tunning
>>>>>> the site
>>>>>> calomel[1]. We spend a lot of money and do not solve the problem.
>>>>>>
>>>>>> What happens is that when there is a traffic above 1.2Gbps with PPS
>>>> above
>>>>>> 700kpps in sometimes almost daily there is a lock in two 10GbE
>>>>>> ports the
>>>>>> X520-SR interface. Where I am obliged to leave a script running in
>>>>>> the
>>>>>> background doing just that:
>>>>> What does this "lock" looks like?
>>>>> Do you using jumbo frames?
>>>>> Is this IPv4 or IPv4+IPv6 ?
>>>>> Can you share "netstat -m" output?
>>>>> Do you use ipfw dynamic states?
>>>>> Are sure you're not hitting "net.inet.ip.fw.dyn_max=65536" ?
>>>>>
>>>>> dev.ix.0.queue0.no_desc_avail: 3322269
>>>>> dev.ix.0.queue1.no_desc_avail: 5254761
>>>>>
>>>>> Looks suspicious. Either you're running out of mbufs due to total mbuf
>>>>> number is small, or system is very busy sometimes.
>>>>> What does you "top -HPSzs1" output look like?
>>>>>
>>>>>
>>>>>> ifconfig ix0 down; ifconfig ix0 up; ifconfig ix1 down; ifconfig
>>>>>> ix1 up
>>>>>>
>>>>>> Made it back to the interface function normally. It's already so for
>>>>>> months and have not tried the latest driver from Intel because I
>>>>>> do not
>>>> see
>>>>>> anything related to this issue.
>>>>>>
>>>>>> These 2-port 10GbE are my backbone linking the four cities that
>>>>>> attend
>>>> to
>>>>>> our main router. One is backup to other but when the problem occurs,
>>>> the two
>>>>>> ports stop working and at the moment I have a break in my Internet
>>>>>>
>>>>>> I can only conclude that the problem is one of the things below:
>>>>>>
>>>>>> 1 - Intel Interface X520-SR2 has a problem with certain types of
>>>>>> traffic
>>>>>> and then hangs.
>>>>>> 2 - The ixgbe driver has a bug that is causing it.
>>>>>> 3 - Problem with FreeBSD 10.x. Not tested with FreeBSD 9.3 because it
>>>>>> would be a regression and the equipment is very far away from me if I
>>>> need
>>>>>> to move me.
>>>>>>
>>>>>> Honestly I'm almost going on a Juniper closed solution. I would
>>>>>> not want
>>>>>> to do this because I love FreeBSD and I can not believe that he
>>>>>> does not
>>>>>> support a 2.7Gbps traffic, which is my peak traffic without getting
>>>> having
>>>>>> these falls. My hardware today is this:
>>>>>>
>>>>>> hw.machine: amd64
>>>>>> hw.model: Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz
>>>>>> hw.ncpu: 12
>>>>>> hw.byteorder: 1234
>>>>>> hw.physmem: 17083641856
>>>>>> hw.usermem: 15741001728
>>>>>>
>>>>>> Hardware all Intel with motherboard S2600COE [2] and with network
>>>>>> interfaces offboard:
>>>>>>
>>>>>> 1x - X520-SR2 [3]
>>>>>> 2x - I350-T2 [4]
>>>>>>
>>>>>> My loader.conf:
>>>>>>
>>>>>> loader_logo="beastie"
>>>>>> if_lagg_load="YES"
>>>>>> speaker_load="YES"
>>>>>> aio_load="YES"
>>>>>> autoboot_delay="5"
>>>>>> net.fibs=1
>>>>>>
>>>>>> My sysctl.conf:
>>>>>>
>>>>>> net.inet.ip.forwarding=1
>>>>>> net.inet.ip.fastforwarding=1
>>>>>> net.inet6.ip6.forwarding=1
>>>>>> kern.ipc.somaxconn=4096
>>>>>> net.inet.tcp.syncookies=1
>>>>>> net.inet.ip.redirect=1
>>>>>> net.inet.ip.accept_sourceroute=0
>>>>>> net.inet.ip.sourceroute=0
>>>>>> net.inet.tcp.drop_synfin=1
>>>>>> net.inet.udp.blackhole=1
>>>>>> net.inet.tcp.blackhole=2
>>>>>> security.bsd.see_other_uids=0
>>>>>> net.inet.ip.fw.dyn_buckets=65536
>>>>>> net.inet.ip.fw.dyn_max=65536
>>>>>> hw.intr_storm_threshold=9000
>>>>>> net.inet.ip.dummynet.pipe_slot_limit=800
>>>>>> net.inet.icmp.icmplim=2000
>>>>>>
>>>>>> # sysctl dev.ix.
>>>>>> dev.ix.%parent:
>>>>>> dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver,
>>>>>> Version -
>>>>>> 2.5.15
>>>>>> dev.ix.0.%driver: ix
>>>>>> dev.ix.0.%location: slot=0 function=0 handle=\_SB_.PCI1.BR42.S4F0
>>>>>> dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086
>>>>>> subdevice=0x7a11 class=0x020000
>>>>>> dev.ix.0.%parent: pci129
>>>>>> dev.ix.0.fc: 3
>>>>>> dev.ix.0.enable_aim: 1
>>>>>> dev.ix.0.advertise_speed: 0
>>>>>> dev.ix.0.dropped: 0
>>>>>> dev.ix.0.mbuf_defrag_failed: 0
>>>>>> dev.ix.0.watchdog_events: 0
>>>>>> dev.ix.0.link_irq: 193783
>>>>>> dev.ix.0.queue0.interrupt_rate: 50000
>>>>>> dev.ix.0.queue0.irqs: 12029604413
>>>>>> dev.ix.0.queue0.txd_head: 1517
>>>>>> dev.ix.0.queue0.txd_tail: 1517
>>>>>> dev.ix.0.queue0.tso_tx: 85
>>>>>> dev.ix.0.queue0.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue0.no_desc_avail: 3322269
>>>>>> dev.ix.0.queue0.tx_packets: 15392658033
>>>>>> dev.ix.0.queue0.rxd_head: 709
>>>>>> dev.ix.0.queue0.rxd_tail: 707
>>>>>> dev.ix.0.queue0.rx_packets: 21762427837
>>>>>> dev.ix.0.queue0.rx_bytes: 56918345381
>>>>>> dev.ix.0.queue0.rx_copies: 124289013
>>>>>> dev.ix.0.queue0.lro_queued: 0
>>>>>> dev.ix.0.queue0.lro_flushed: 0
>>>>>> dev.ix.0.queue1.interrupt_rate: 500000
>>>>>> dev.ix.0.queue1.irqs: 11482146431
>>>>>> dev.ix.0.queue1.txd_head: 731
>>>>>> dev.ix.0.queue1.txd_tail: 731
>>>>>> dev.ix.0.queue1.tso_tx: 1442
>>>>>> dev.ix.0.queue1.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue1.no_desc_avail: 5254761
>>>>>> dev.ix.0.queue1.tx_packets: 15835062632
>>>>>> dev.ix.0.queue1.rxd_head: 685
>>>>>> dev.ix.0.queue1.rxd_tail: 681
>>>>>> dev.ix.0.queue1.rx_packets: 21220715209
>>>>>> dev.ix.0.queue1.rx_bytes: 54351679461
>>>>>> dev.ix.0.queue1.rx_copies: 120833356
>>>>>> dev.ix.0.queue1.lro_queued: 0
>>>>>> dev.ix.0.queue1.lro_flushed: 0
>>>>>> dev.ix.0.queue2.interrupt_rate: 5319
>>>>>> dev.ix.0.queue2.irqs: 11532560324
>>>>>> dev.ix.0.queue2.txd_head: 501
>>>>>> dev.ix.0.queue2.txd_tail: 501
>>>>>> dev.ix.0.queue2.tso_tx: 2474
>>>>>> dev.ix.0.queue2.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue2.no_desc_avail: 429244
>>>>>> dev.ix.0.queue2.tx_packets: 15772209238
>>>>>> dev.ix.0.queue2.rxd_head: 246
>>>>>> dev.ix.0.queue2.rxd_tail: 244
>>>>>> dev.ix.0.queue2.rx_packets: 21408648299
>>>>>> dev.ix.0.queue2.rx_bytes: 56862350194
>>>>>> dev.ix.0.queue2.rx_copies: 124973551
>>>>>> dev.ix.0.queue2.lro_queued: 0
>>>>>> dev.ix.0.queue2.lro_flushed: 0
>>>>>> dev.ix.0.queue3.interrupt_rate: 20833
>>>>>> dev.ix.0.queue3.irqs: 11557466322
>>>>>> dev.ix.0.queue3.txd_head: 773
>>>>>> dev.ix.0.queue3.txd_tail: 773
>>>>>> dev.ix.0.queue3.tso_tx: 40
>>>>>> dev.ix.0.queue3.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue3.no_desc_avail: 665620
>>>>>> dev.ix.0.queue3.tx_packets: 16479111658
>>>>>> dev.ix.0.queue3.rxd_head: 1858
>>>>>> dev.ix.0.queue3.rxd_tail: 1854
>>>>>> dev.ix.0.queue3.rx_packets: 21412821769
>>>>>> dev.ix.0.queue3.rx_bytes: 52796089467
>>>>>> dev.ix.0.queue3.rx_copies: 127385950
>>>>>> dev.ix.0.queue3.lro_queued: 0
>>>>>> dev.ix.0.queue3.lro_flushed: 0
>>>>>> dev.ix.0.queue4.interrupt_rate: 11363
>>>>>> dev.ix.0.queue4.irqs: 10824852635
>>>>>> dev.ix.0.queue4.txd_head: 1711
>>>>>> dev.ix.0.queue4.txd_tail: 1713
>>>>>> dev.ix.0.queue4.tso_tx: 581
>>>>>> dev.ix.0.queue4.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue4.no_desc_avail: 115346803
>>>>>> dev.ix.0.queue4.tx_packets: 16100396810
>>>>>> dev.ix.0.queue4.rxd_head: 244
>>>>>> dev.ix.0.queue4.rxd_tail: 243
>>>>>> dev.ix.0.queue4.rx_packets: 21240995210
>>>>>> dev.ix.0.queue4.rx_bytes: 58726730771
>>>>>> dev.ix.0.queue4.rx_copies: 124872141
>>>>>> dev.ix.0.queue4.lro_queued: 0
>>>>>> dev.ix.0.queue4.lro_flushed: 0
>>>>>> dev.ix.0.queue5.interrupt_rate: 500000
>>>>>> dev.ix.0.queue5.irqs: 10955464761
>>>>>> dev.ix.0.queue5.txd_head: 75
>>>>>> dev.ix.0.queue5.txd_tail: 77
>>>>>> dev.ix.0.queue5.tso_tx: 1758
>>>>>> dev.ix.0.queue5.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue5.no_desc_avail: 4759
>>>>>> dev.ix.0.queue5.tx_packets: 16267888038
>>>>>> dev.ix.0.queue5.rxd_head: 905
>>>>>> dev.ix.0.queue5.rxd_tail: 904
>>>>>> dev.ix.0.queue5.rx_packets: 21381144028
>>>>>> dev.ix.0.queue5.rx_bytes: 61800291690
>>>>>> dev.ix.0.queue5.rx_copies: 129684798
>>>>>> dev.ix.0.queue5.lro_queued: 0
>>>>>> dev.ix.0.queue5.lro_flushed: 0
>>>>>> dev.ix.0.queue6.interrupt_rate: 33333
>>>>>> dev.ix.0.queue6.irqs: 11081350674
>>>>>> dev.ix.0.queue6.txd_head: 1744
>>>>>> dev.ix.0.queue6.txd_tail: 1746
>>>>>> dev.ix.0.queue6.tso_tx: 38
>>>>>> dev.ix.0.queue6.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue6.no_desc_avail: 18381
>>>>>> dev.ix.0.queue6.tx_packets: 15376961749
>>>>>> dev.ix.0.queue6.rxd_head: 1783
>>>>>> dev.ix.0.queue6.rxd_tail: 1782
>>>>>> dev.ix.0.queue6.rx_packets: 21381814216
>>>>>> dev.ix.0.queue6.rx_bytes: 56828960117
>>>>>> dev.ix.0.queue6.rx_copies: 130194429
>>>>>> dev.ix.0.queue6.lro_queued: 0
>>>>>> dev.ix.0.queue6.lro_flushed: 0
>>>>>> dev.ix.0.queue7.interrupt_rate: 5319
>>>>>> dev.ix.0.queue7.irqs: 11014043865
>>>>>> dev.ix.0.queue7.txd_head: 1545
>>>>>> dev.ix.0.queue7.txd_tail: 1545
>>>>>> dev.ix.0.queue7.tso_tx: 59
>>>>>> dev.ix.0.queue7.no_tx_dma_setup: 0
>>>>>> dev.ix.0.queue7.no_desc_avail: 5497
>>>>>> dev.ix.0.queue7.tx_packets: 15283534142
>>>>>> dev.ix.0.queue7.rxd_head: 184
>>>>>> dev.ix.0.queue7.rxd_tail: 182
>>>>>> dev.ix.0.queue7.rx_packets: 21431994087
>>>>>> dev.ix.0.queue7.rx_bytes: 57942270182
>>>>>> dev.ix.0.queue7.rx_copies: 128363306
>>>>>> dev.ix.0.queue7.lro_queued: 0
>>>>>> dev.ix.0.queue7.lro_flushed: 0
>>>>>> dev.ix.0.mac_stats.crc_errs: 268
>>>>>> dev.ix.0.mac_stats.ill_errs: 33
>>>>>> dev.ix.0.mac_stats.byte_errs: 55
>>>>>> dev.ix.0.mac_stats.short_discards: 0
>>>>>> dev.ix.0.mac_stats.local_faults: 3484
>>>>>> dev.ix.0.mac_stats.remote_faults: 121
>>>>>> dev.ix.0.mac_stats.rec_len_errs: 0
>>>>>> dev.ix.0.mac_stats.xon_txd: 1602713563748
>>>>>> dev.ix.0.mac_stats.xon_recvd: 0
>>>>>> dev.ix.0.mac_stats.xoff_txd: 108342810167
>>>>>> dev.ix.0.mac_stats.xoff_recvd: 0
>>>>>> dev.ix.0.mac_stats.total_octets_rcvd: 63648882812602
>>>>>> dev.ix.0.mac_stats.good_octets_rcvd: 63546482402023
>>>>>> dev.ix.0.mac_stats.total_pkts_rcvd: 171545277533
>>>>>> dev.ix.0.mac_stats.good_pkts_rcvd: 18446739236268246350
>>>>>> dev.ix.0.mac_stats.mcast_pkts_rcvd: 3724952
>>>>>> dev.ix.0.mac_stats.bcast_pkts_rcvd: 467054852
>>>>>> dev.ix.0.mac_stats.rx_frames_64: 5356098
>>>>>> dev.ix.0.mac_stats.rx_frames_65_127: 122019038388
>>>>>> dev.ix.0.mac_stats.rx_frames_128_255: 7578829973
>>>>>> dev.ix.0.mac_stats.rx_frames_256_511: 3450564281
>>>>>> dev.ix.0.mac_stats.rx_frames_512_1023: 5011796430
>>>>>> dev.ix.0.mac_stats.rx_frames_1024_1522: 33195848924
>>>>>> dev.ix.0.mac_stats.recv_undersized: 0
>>>>>> dev.ix.0.mac_stats.recv_fragmented: 0
>>>>>> dev.ix.0.mac_stats.recv_oversized: 244078
>>>>>> dev.ix.0.mac_stats.recv_jabberd: 4
>>>>>> dev.ix.0.mac_stats.management_pkts_rcvd: 0
>>>>>> dev.ix.0.mac_stats.management_pkts_drpd: 0
>>>>>> dev.ix.0.mac_stats.checksum_errs: 897344641
>>>>>> dev.ix.0.mac_stats.good_octets_txd: 126768678455085
>>>>>> dev.ix.0.mac_stats.total_pkts_txd: 126508073823
>>>>>> dev.ix.0.mac_stats.good_pkts_txd: 18446742557880728233
>>>>>> dev.ix.0.mac_stats.bcast_pkts_txd: 1828364
>>>>>> dev.ix.0.mac_stats.mcast_pkts_txd: 18446742431373346680
>>>>>> dev.ix.0.mac_stats.management_pkts_txd: 0
>>>>>> dev.ix.0.mac_stats.tx_frames_64: 18446742440306683787
>>>>>> dev.ix.0.mac_stats.tx_frames_65_127: 24188318255
>>>>>> dev.ix.0.mac_stats.tx_frames_128_255: 5808482194
>>>>>> dev.ix.0.mac_stats.tx_frames_256_511: 2729252777
>>>>>> dev.ix.0.mac_stats.tx_frames_512_1023: 3029688617
>>>>>> dev.ix.0.mac_stats.tx_frames_1024_1522: 81818302620
>>>>>> dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver,
>>>>>> Version -
>>>>>> 2.5.15
>>>>>> dev.ix.1.%driver: ix
>>>>>> dev.ix.1.%location: slot=0 function=1 handle=\_SB_.PCI1.BR42.S4F1
>>>>>> dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086
>>>>>> subdevice=0x7a11 class=0x020000
>>>>>> dev.ix.1.%parent: pci129
>>>>>> dev.ix.1.fc: 3
>>>>>> dev.ix.1.enable_aim: 1
>>>>>> dev.ix.1.advertise_speed: 0
>>>>>> dev.ix.1.dropped: 0
>>>>>> dev.ix.1.mbuf_defrag_failed: 0
>>>>>> dev.ix.1.watchdog_events: 0
>>>>>> dev.ix.1.link_irq: 127925
>>>>>> dev.ix.1.queue0.interrupt_rate: 11627
>>>>>> dev.ix.1.queue0.irqs: 6686088831
>>>>>> dev.ix.1.queue0.txd_head: 1618
>>>>>> dev.ix.1.queue0.txd_tail: 1620
>>>>>> dev.ix.1.queue0.tso_tx: 28
>>>>>> dev.ix.1.queue0.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue0.no_desc_avail: 0
>>>>>> dev.ix.1.queue0.tx_packets: 13527334563
>>>>>> dev.ix.1.queue0.rxd_head: 1715
>>>>>> dev.ix.1.queue0.rxd_tail: 1714
>>>>>> dev.ix.1.queue0.rx_packets: 1503775702
>>>>>> dev.ix.1.queue0.rx_bytes: 1069295301
>>>>>> dev.ix.1.queue0.rx_copies: 2983480
>>>>>> dev.ix.1.queue0.lro_queued: 0
>>>>>> dev.ix.1.queue0.lro_flushed: 0
>>>>>> dev.ix.1.queue1.interrupt_rate: 5319
>>>>>> dev.ix.1.queue1.irqs: 6546967336
>>>>>> dev.ix.1.queue1.txd_head: 1812
>>>>>> dev.ix.1.queue1.txd_tail: 1812
>>>>>> dev.ix.1.queue1.tso_tx: 6
>>>>>> dev.ix.1.queue1.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue1.no_desc_avail: 0
>>>>>> dev.ix.1.queue1.tx_packets: 13475453794
>>>>>> dev.ix.1.queue1.rxd_head: 1246
>>>>>> dev.ix.1.queue1.rxd_tail: 1245
>>>>>> dev.ix.1.queue1.rx_packets: 1506444917
>>>>>> dev.ix.1.queue1.rx_bytes: 783064190
>>>>>> dev.ix.1.queue1.rx_copies: 2881513
>>>>>> dev.ix.1.queue1.lro_queued: 0
>>>>>> dev.ix.1.queue1.lro_flushed: 0
>>>>>> dev.ix.1.queue2.interrupt_rate: 5319
>>>>>> dev.ix.1.queue2.irqs: 6574615190
>>>>>> dev.ix.1.queue2.txd_head: 1494
>>>>>> dev.ix.1.queue2.txd_tail: 1494
>>>>>> dev.ix.1.queue2.tso_tx: 33
>>>>>> dev.ix.1.queue2.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue2.no_desc_avail: 0
>>>>>> dev.ix.1.queue2.tx_packets: 13555495169
>>>>>> dev.ix.1.queue2.rxd_head: 438
>>>>>> dev.ix.1.queue2.rxd_tail: 437
>>>>>> dev.ix.1.queue2.rx_packets: 1501380848
>>>>>> dev.ix.1.queue2.rx_bytes: 1008544082
>>>>>> dev.ix.1.queue2.rx_copies: 2660960
>>>>>> dev.ix.1.queue2.lro_queued: 0
>>>>>> dev.ix.1.queue2.lro_flushed: 0
>>>>>> dev.ix.1.queue3.interrupt_rate: 5319
>>>>>> dev.ix.1.queue3.irqs: 6617964401
>>>>>> dev.ix.1.queue3.txd_head: 1853
>>>>>> dev.ix.1.queue3.txd_tail: 1855
>>>>>> dev.ix.1.queue3.tso_tx: 10
>>>>>> dev.ix.1.queue3.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue3.no_desc_avail: 0
>>>>>> dev.ix.1.queue3.tx_packets: 13561212942
>>>>>> dev.ix.1.queue3.rxd_head: 429
>>>>>> dev.ix.1.queue3.rxd_tail: 428
>>>>>> dev.ix.1.queue3.rx_packets: 1498117903
>>>>>> dev.ix.1.queue3.rx_bytes: 784881986
>>>>>> dev.ix.1.queue3.rx_copies: 2695475
>>>>>> dev.ix.1.queue3.lro_queued: 0
>>>>>> dev.ix.1.queue3.lro_flushed: 0
>>>>>> dev.ix.1.queue4.interrupt_rate: 5319
>>>>>> dev.ix.1.queue4.irqs: 6575752163
>>>>>> dev.ix.1.queue4.txd_head: 902
>>>>>> dev.ix.1.queue4.txd_tail: 902
>>>>>> dev.ix.1.queue4.tso_tx: 5
>>>>>> dev.ix.1.queue4.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue4.no_desc_avail: 0
>>>>>> dev.ix.1.queue4.tx_packets: 13478514009
>>>>>> dev.ix.1.queue4.rxd_head: 536
>>>>>> dev.ix.1.queue4.rxd_tail: 535
>>>>>> dev.ix.1.queue4.rx_packets: 1476720084
>>>>>> dev.ix.1.queue4.rx_bytes: 944967171
>>>>>> dev.ix.1.queue4.rx_copies: 2650672
>>>>>> dev.ix.1.queue4.lro_queued: 0
>>>>>> dev.ix.1.queue4.lro_flushed: 0
>>>>>> dev.ix.1.queue5.interrupt_rate: 10416
>>>>>> dev.ix.1.queue5.irqs: 6578099670
>>>>>> dev.ix.1.queue5.txd_head: 1996
>>>>>> dev.ix.1.queue5.txd_tail: 1996
>>>>>> dev.ix.1.queue5.tso_tx: 663
>>>>>> dev.ix.1.queue5.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue5.no_desc_avail: 0
>>>>>> dev.ix.1.queue5.tx_packets: 13516483196
>>>>>> dev.ix.1.queue5.rxd_head: 1296
>>>>>> dev.ix.1.queue5.rxd_tail: 1295
>>>>>> dev.ix.1.queue5.rx_packets: 1496584151
>>>>>> dev.ix.1.queue5.rx_bytes: 810434347
>>>>>> dev.ix.1.queue5.rx_copies: 2899315
>>>>>> dev.ix.1.queue5.lro_queued: 0
>>>>>> dev.ix.1.queue5.lro_flushed: 0
>>>>>> dev.ix.1.queue6.interrupt_rate: 5319
>>>>>> dev.ix.1.queue6.irqs: 6624395782
>>>>>> dev.ix.1.queue6.txd_head: 1058
>>>>>> dev.ix.1.queue6.txd_tail: 1058
>>>>>> dev.ix.1.queue6.tso_tx: 20
>>>>>> dev.ix.1.queue6.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue6.no_desc_avail: 0
>>>>>> dev.ix.1.queue6.tx_packets: 13491315217
>>>>>> dev.ix.1.queue6.rxd_head: 1550
>>>>>> dev.ix.1.queue6.rxd_tail: 1549
>>>>>> dev.ix.1.queue6.rx_packets: 1510907490
>>>>>> dev.ix.1.queue6.rx_bytes: 719914325
>>>>>> dev.ix.1.queue6.rx_copies: 2712955
>>>>>> dev.ix.1.queue6.lro_queued: 0
>>>>>> dev.ix.1.queue6.lro_flushed: 0
>>>>>> dev.ix.1.queue7.interrupt_rate: 29411
>>>>>> dev.ix.1.queue7.irqs: 6573304834
>>>>>> dev.ix.1.queue7.txd_head: 784
>>>>>> dev.ix.1.queue7.txd_tail: 786
>>>>>> dev.ix.1.queue7.tso_tx: 2
>>>>>> dev.ix.1.queue7.no_tx_dma_setup: 0
>>>>>> dev.ix.1.queue7.no_desc_avail: 0
>>>>>> dev.ix.1.queue7.tx_packets: 13587681458
>>>>>> dev.ix.1.queue7.rxd_head: 1489
>>>>>> dev.ix.1.queue7.rxd_tail: 1488
>>>>>> dev.ix.1.queue7.rx_packets: 1504712031
>>>>>> dev.ix.1.queue7.rx_bytes: 1216803328
>>>>>> dev.ix.1.queue7.rx_copies: 2976103
>>>>>> dev.ix.1.queue7.lro_queued: 0
>>>>>> dev.ix.1.queue7.lro_flushed: 0
>>>>>> dev.ix.1.mac_stats.crc_errs: 0
>>>>>> dev.ix.1.mac_stats.ill_errs: 0
>>>>>> dev.ix.1.mac_stats.byte_errs: 0
>>>>>> dev.ix.1.mac_stats.short_discards: 0
>>>>>> dev.ix.1.mac_stats.local_faults: 0
>>>>>> dev.ix.1.mac_stats.remote_faults: 12
>>>>>> dev.ix.1.mac_stats.rec_len_errs: 0
>>>>>> dev.ix.1.mac_stats.xon_txd: 1714791401322
>>>>>> dev.ix.1.mac_stats.xon_recvd: 0
>>>>>> dev.ix.1.mac_stats.xoff_txd: 41095995010
>>>>>> dev.ix.1.mac_stats.xoff_recvd: 0
>>>>>> dev.ix.1.mac_stats.total_octets_rcvd: 4335824523464
>>>>>> dev.ix.1.mac_stats.good_octets_rcvd: 4335686239235
>>>>>> dev.ix.1.mac_stats.total_pkts_rcvd: 12020354631
>>>>>> dev.ix.1.mac_stats.good_pkts_rcvd: 18446730999130315370
>>>>>> dev.ix.1.mac_stats.mcast_pkts_rcvd: 737
>>>>>> dev.ix.1.mac_stats.bcast_pkts_rcvd: 295580
>>>>>> dev.ix.1.mac_stats.rx_frames_64: 73447
>>>>>> dev.ix.1.mac_stats.rx_frames_65_127: 8714296833
>>>>>> dev.ix.1.mac_stats.rx_frames_128_255: 478134642
>>>>>> dev.ix.1.mac_stats.rx_frames_256_511: 232994605
>>>>>> dev.ix.1.mac_stats.rx_frames_512_1023: 341753974
>>>>>> dev.ix.1.mac_stats.rx_frames_1024_1522: 2251178850
>>>>>> dev.ix.1.mac_stats.recv_undersized: 0
>>>>>> dev.ix.1.mac_stats.recv_fragmented: 0
>>>>>> dev.ix.1.mac_stats.recv_oversized: 0
>>>>>> dev.ix.1.mac_stats.recv_jabberd: 0
>>>>>> dev.ix.1.mac_stats.management_pkts_rcvd: 0
>>>>>> dev.ix.1.mac_stats.management_pkts_drpd: 0
>>>>>> dev.ix.1.mac_stats.checksum_errs: 85432477
>>>>>> dev.ix.1.mac_stats.good_octets_txd: 110334688606644
>>>>>> dev.ix.1.mac_stats.total_pkts_txd: 108193846110
>>>>>> dev.ix.1.mac_stats.good_pkts_txd: 18446742447490837867
>>>>>> dev.ix.1.mac_stats.bcast_pkts_txd: 595976
>>>>>> dev.ix.1.mac_stats.mcast_pkts_txd: 18446742339297559869
>>>>>> dev.ix.1.mac_stats.management_pkts_txd: 0
>>>>>> dev.ix.1.mac_stats.tx_frames_64: 18446742346194685024
>>>>>> dev.ix.1.mac_stats.tx_frames_65_127: 19859540709
>>>>>> dev.ix.1.mac_stats.tx_frames_128_255: 5129619113
>>>>>> dev.ix.1.mac_stats.tx_frames_256_511: 2384651426
>>>>>> dev.ix.1.mac_stats.tx_frames_512_1023: 2651547352
>>>>>> dev.ix.1.mac_stats.tx_frames_1024_1522: 71270794251
>>>>>>
>>>>>> # cat /var/run/dmesg.boot
>>>>>>
>>>>>> Copyright (c) 1992-2014 The FreeBSD Project.
>>>>>> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992,
>>>>>> 1993, 1994
>>>>>>           The Regents of the University of California. All rights
>>>> reserved.
>>>>>> FreeBSD is a registered trademark of The FreeBSD Foundation.
>>>>>> FreeBSD 10.1-RELEASE #2 r274375: Tue Nov 11 10:24:44 BRST 2014
>>>>>>       root@rt01.intnet.com.br:/usr/obj/usr/src/sys/INTNET10 amd64
>>>>>> FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032)
>>>>>> 20140512
>>>>>> CPU: Intel(R) Xeon(R) CPU E5-2630 v2 @ 2.60GHz (2593.80-MHz K8-class
>>>> CPU)
>>>>>>     Origin = "GenuineIntel"  Id = 0x306e4  Family = 0x6  Model = 0x3e
>>>>>> Stepping = 4
>>>>>>
>>>>>>
>>>> Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>>>>
>>>> Features2=0x7fbee3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
>>>>
>>>>>>     AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
>>>>>>     AMD Features2=0x1<LAHF>
>>>>>>     Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
>>>>>>     VT-x: (disabled in BIOS)
>>>>>> PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
>>>>>>     TSC: P-state invariant, performance statistics
>>>>>> real memory  = 17179869184 (16384 MB)
>>>>>> avail memory = 16515358720 (15750 MB)
>>>>>> Event timer "LAPIC" quality 600
>>>>>> ACPI APIC Table: <INTEL  S2600CO>
>>>>>> FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs
>>>>>> FreeBSD/SMP: 2 package(s) x 6 core(s)
>>>>>>    cpu0 (BSP): APIC ID:  0
>>>>>>    cpu1 (AP): APIC ID:  2
>>>>>>    cpu2 (AP): APIC ID:  4
>>>>>>    cpu3 (AP): APIC ID:  6
>>>>>>    cpu4 (AP): APIC ID:  8
>>>>>>    cpu5 (AP): APIC ID: 10
>>>>>>    cpu6 (AP): APIC ID: 32
>>>>>>    cpu7 (AP): APIC ID: 34
>>>>>>    cpu8 (AP): APIC ID: 36
>>>>>>    cpu9 (AP): APIC ID: 38
>>>>>>    cpu10 (AP): APIC ID: 40
>>>>>>    cpu11 (AP): APIC ID: 42
>>>>>> ACPI BIOS Warning (bug): Invalid length for FADT/Pm1aControlBlock:
>>>>>> 32,
>>>>>> using default 16 (20130823/tbfadt-682)
>>>>>> ioapic0 <Version 2.0> irqs 0-23 on motherboard
>>>>>> ioapic1 <Version 2.0> irqs 24-47 on motherboard
>>>>>> ioapic2 <Version 2.0> irqs 48-71 on motherboard
>>>>>> kbd1 at kbdmux0
>>>>>> random: <Software, Yarrow> initialized
>>>>>> cryptosoft0: <software crypto> on motherboard
>>>>>> acpi0: <INTEL S2600CO> on motherboard
>>>>>> acpi0: Power Button (fixed)
>>>>>> acpi0: reservation of 0, 9d000 (3) failed
>>>>>> cpu0: <ACPI CPU> on acpi0
>>>>>> cpu1: <ACPI CPU> on acpi0
>>>>>> cpu2: <ACPI CPU> on acpi0
>>>>>> cpu3: <ACPI CPU> on acpi0
>>>>>> cpu4: <ACPI CPU> on acpi0
>>>>>> cpu5: <ACPI CPU> on acpi0
>>>>>> cpu6: <ACPI CPU> on acpi0
>>>>>> cpu7: <ACPI CPU> on acpi0
>>>>>> cpu8: <ACPI CPU> on acpi0
>>>>>> cpu9: <ACPI CPU> on acpi0
>>>>>> cpu10: <ACPI CPU> on acpi0
>>>>>> cpu11: <ACPI CPU> on acpi0
>>>>>> hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on
>>>>>> acpi0
>>>>>> Timecounter "HPET" frequency 14318180 Hz quality 950
>>>>>> Event timer "HPET" frequency 14318180 Hz quality 350
>>>>>> Event timer "HPET1" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET2" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET3" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET4" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET5" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET6" frequency 14318180 Hz quality 340
>>>>>> Event timer "HPET7" frequency 14318180 Hz quality 340
>>>>>> atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
>>>>>> atrtc0: Warning: Couldn't map I/O.
>>>>>> Event timer "RTC" frequency 32768 Hz quality 0
>>>>>> attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
>>>>>> Timecounter "i8254" frequency 1193182 Hz quality 0
>>>>>> Event timer "i8254" frequency 1193182 Hz quality 100
>>>>>> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
>>>>>> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
>>>>>> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
>>>>>> pci0: <ACPI PCI bus> on pcib0
>>>>>> pcib1: <ACPI PCI-PCI bridge> irq 47 at device 1.0 on pci0
>>>>>> pci1: <ACPI PCI bus> on pcib1
>>>>>> pcib2: <ACPI PCI-PCI bridge> irq 47 at device 1.1 on pci0
>>>>>> pci2: <ACPI PCI bus> on pcib2
>>>>>> igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
>>>>>> 0x1060-0x107f mem 0xd0f60000-0xd0f7ffff,0xd0fb0000-0xd0fb3fff irq
>>>>>> 27 at
>>>>>> device 0.0 on pci2
>>>>>> igb0: Using MSIX interrupts with 9 vectors
>>>>>> igb0: Ethernet address: 00:1e:67:9a:d5:88
>>>>>> igb0: Bound queue 0 to cpu 0
>>>>>> igb0: Bound queue 1 to cpu 1
>>>>>> igb0: Bound queue 2 to cpu 2
>>>>>> igb0: Bound queue 3 to cpu 3
>>>>>> igb0: Bound queue 4 to cpu 4
>>>>>> igb0: Bound queue 5 to cpu 5
>>>>>> igb0: Bound queue 6 to cpu 6
>>>>>> igb0: Bound queue 7 to cpu 7
>>>>>> igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
>>>>>> 0x1040-0x105f mem 0xd0f40000-0xd0f5ffff,0xd0fa0000-0xd0fa3fff irq
>>>>>> 30 at
>>>>>> device 0.1 on pci2
>>>>>> igb1: Using MSIX interrupts with 9 vectors
>>>>>> igb1: Ethernet address: 00:1e:67:9a:d5:89
>>>>>> igb1: Bound queue 0 to cpu 8
>>>>>> igb1: Bound queue 1 to cpu 9
>>>>>> igb1: Bound queue 2 to cpu 10
>>>>>> igb1: Bound queue 3 to cpu 11
>>>>>> igb1: Bound queue 4 to cpu 0
>>>>>> igb1: Bound queue 5 to cpu 1
>>>>>> igb1: Bound queue 6 to cpu 2
>>>>>> igb1: Bound queue 7 to cpu 3
>>>>>> igb2: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
>>>>>> 0x1020-0x103f mem 0xd0f20000-0xd0f3ffff,0xd0f90000-0xd0f93fff irq
>>>>>> 28 at
>>>>>> device 0.2 on pci2
>>>>>> igb2: Using MSIX interrupts with 9 vectors
>>>>>> igb2: Ethernet address: 00:1e:67:9a:d5:8a
>>>>>> igb2: Bound queue 0 to cpu 4
>>>>>> igb2: Bound queue 1 to cpu 5
>>>>>> igb2: Bound queue 2 to cpu 6
>>>>>> igb2: Bound queue 3 to cpu 7
>>>>>> igb2: Bound queue 4 to cpu 8
>>>>>> igb2: Bound queue 5 to cpu 9
>>>>>> igb2: Bound queue 6 to cpu 10
>>>>>> igb2: Bound queue 7 to cpu 11
>>>>>> igb3: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port
>>>>>> 0x1000-0x101f mem 0xd0f00000-0xd0f1ffff,0xd0f80000-0xd0f83fff irq
>>>>>> 29 at
>>>>>> device 0.3 on pci2
>>>>>> igb3: Using MSIX interrupts with 9 vectors
>>>>>> igb3: Ethernet address: 00:1e:67:9a:d5:8b
>>>>>> igb3: Bound queue 0 to cpu 0
>>>>>> igb3: Bound queue 1 to cpu 1
>>>>>> igb3: Bound queue 2 to cpu 2
>>>>>> igb3: Bound queue 3 to cpu 3
>>>>>> igb3: Bound queue 4 to cpu 4
>>>>>> igb3: Bound queue 5 to cpu 5
>>>>>> igb3: Bound queue 6 to cpu 6
>>>>>> igb3: Bound queue 7 to cpu 7
>>>>>> pcib3: <ACPI PCI-PCI bridge> irq 47 at device 2.0 on pci0
>>>>>> pci4: <ACPI PCI bus> on pcib3
>>>>>> igb4: <Intel(R) PRO/1000 Network Connection version - 2.4.0> mem
>>>>>> 0xd0d00000-0xd0dfffff,0xd0e10000-0xd0e13fff irq 32 at device 0.0
>>>>>> on pci4
>>>>>> igb4: Using MSIX interrupts with 9 vectors
>>>>>> igb4: Ethernet address: a0:36:9f:37:82:7e
>>>>>> igb4: Bound queue 0 to cpu 8
>>>>>> igb4: Bound queue 1 to cpu 9
>>>>>> igb4: Bound queue 2 to cpu 10
>>>>>> igb4: Bound queue 3 to cpu 11
>>>>>> igb4: Bound queue 4 to cpu 0
>>>>>> igb4: Bound queue 5 to cpu 1
>>>>>> igb4: Bound queue 6 to cpu 2
>>>>>> igb4: Bound queue 7 to cpu 3
>>>>>> igb5: <Intel(R) PRO/1000 Network Connection version - 2.4.0> mem
>>>>>> 0xd0c00000-0xd0cfffff,0xd0e00000-0xd0e03fff irq 36 at device 0.1
>>>>>> on pci4
>>>>>> igb5: Using MSIX interrupts with 9 vectors
>>>>>> igb5: Ethernet address: a0:36:9f:37:82:7f
>>>>>> igb5: Bound queue 0 to cpu 4
>>>>>> igb5: Bound queue 1 to cpu 5
>>>>>> igb5: Bound queue 2 to cpu 6
>>>>>> igb5: Bound queue 3 to cpu 7
>>>>>> igb5: Bound queue 4 to cpu 8
>>>>>> igb5: Bound queue 5 to cpu 9
>>>>>> igb5: Bound queue 6 to cpu 10
>>>>>> igb5: Bound queue 7 to cpu 11
>>>>>> pcib4: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
>>>>>> pci6: <ACPI PCI bus> on pcib4
>>>>>> igb6: <Intel(R) PRO/1000 Network Connection version - 2.4.0> mem
>>>>>> 0xd0a00000-0xd0afffff,0xd0b10000-0xd0b13fff irq 40 at device 0.0
>>>>>> on pci6
>>>>>> igb6: Using MSIX interrupts with 9 vectors
>>>>>> igb6: Ethernet address: a0:36:9f:37:82:8a
>>>>>> igb6: Bound queue 0 to cpu 0
>>>>>> igb6: Bound queue 1 to cpu 1
>>>>>> igb6: Bound queue 2 to cpu 2
>>>>>> igb6: Bound queue 3 to cpu 3
>>>>>> igb6: Bound queue 4 to cpu 4
>>>>>> igb6: Bound queue 5 to cpu 5
>>>>>> igb6: Bound queue 6 to cpu 6
>>>>>> igb6: Bound queue 7 to cpu 7
>>>>>> igb7: <Intel(R) PRO/1000 Network Connection version - 2.4.0> mem
>>>>>> 0xd0900000-0xd09fffff,0xd0b00000-0xd0b03fff irq 44 at device 0.1
>>>>>> on pci6
>>>>>> igb7: Using MSIX interrupts with 9 vectors
>>>>>> igb7: Ethernet address: a0:36:9f:37:82:8b
>>>>>> igb7: Bound queue 0 to cpu 8
>>>>>> igb7: Bound queue 1 to cpu 9
>>>>>> igb7: Bound queue 2 to cpu 10
>>>>>> igb7: Bound queue 3 to cpu 11
>>>>>> igb7: Bound queue 4 to cpu 0
>>>>>> igb7: Bound queue 5 to cpu 1
>>>>>> igb7: Bound queue 6 to cpu 2
>>>>>> igb7: Bound queue 7 to cpu 3
>>>>>> pcib5: <ACPI PCI-PCI bridge> irq 16 at device 17.0 on pci0
>>>>>> pci8: <ACPI PCI bus> on pcib5
>>>>>> pci0: <simple comms> at device 22.0 (no driver attached)
>>>>>> pci0: <simple comms> at device 22.1 (no driver attached)
>>>>>> ehci0: <EHCI (generic) USB 2.0 controller> mem
>>>>>> 0xd1220000-0xd12203ff irq
>>>>>> 22 at device 26.0 on pci0
>>>>>> usbus0: EHCI version 1.0
>>>>>> usbus0 on ehci0
>>>>>> pcib6: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
>>>>>> pci9: <ACPI PCI bus> on pcib6
>>>>>> pcib7: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0
>>>>>> pci10: <ACPI PCI bus> on pcib7
>>>>>> pci10: <serial bus, FireWire> at device 0.0 (no driver attached)
>>>>>> pcib8: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0
>>>>>> pci11: <ACPI PCI bus> on pcib8
>>>>>> vgapci0: <VGA-compatible display> mem
>>>>>> 0xea000000-0xeaffffff,0xd0810000-0xd0813fff,0xd0000000-0xd07fffff irq
>>>> 19 at
>>>>>> device 0.0 on pci11
>>>>>> vgapci0: Boot video device
>>>>>> ehci1: <EHCI (generic) USB 2.0 controller> mem
>>>>>> 0xd1210000-0xd12103ff irq
>>>>>> 20 at device 29.0 on pci0
>>>>>> usbus1: EHCI version 1.0
>>>>>> usbus1 on ehci1
>>>>>> pcib9: <ACPI PCI-PCI bridge> at device 30.0 on pci0
>>>>>> pci12: <ACPI PCI bus> on pcib9
>>>>>> isab0: <PCI-ISA bridge> at device 31.0 on pci0
>>>>>> isa0: <ISA bus> on isab0
>>>>>> ahci0: <Intel Patsburg AHCI SATA controller> port
>>>>>> 0x2070-0x2077,0x2060-0x2063,0x2050-0x2057,0x2040-0x2043,0x2020-0x203f
>>>> mem
>>>>>> 0xd1200000-0xd12007ff irq 21 at device 31.2 on pci0
>>>>>> ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
>>>>>> ahcich0: <AHCI channel> at channel 0 on ahci0
>>>>>> ahcich1: <AHCI channel> at channel 1 on ahci0
>>>>>> ahcich2: <AHCI channel> at channel 2 on ahci0
>>>>>> ahcich3: <AHCI channel> at channel 3 on ahci0
>>>>>> ahcich4: <AHCI channel> at channel 4 on ahci0
>>>>>> ahcich5: <AHCI channel> at channel 5 on ahci0
>>>>>> ahciem0: <AHCI enclosure management bridge> on ahci0
>>>>>> pcib10: <ACPI Host-PCI bridge> on acpi0
>>>>>> pci128: <ACPI PCI bus> on pcib10
>>>>>> pcib11: <ACPI PCI-PCI bridge> irq 71 at device 1.0 on pci128
>>>>>> pci129: <ACPI PCI bus> on pcib11
>>>>>> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version -
>>>>>> 2.5.15>
>>>>>> port 0xc020-0xc03f mem 0xec180000-0xec1fffff,0xec210000-0xec213fff
>>>>>> irq
>>>> 50 at
>>>>>> device 0.0 on pci129
>>>>>> ix0: Using MSIX interrupts with 9 vectors
>>>>>> ix0: Ethernet address: 00:1b:21:89:25:32
>>>>>> ix0: PCI Express Bus: Speed 5.0GT/s Width x8
>>>>>> ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version -
>>>>>> 2.5.15>
>>>>>> port 0xc000-0xc01f mem 0xec080000-0xec0fffff,0xec200000-0xec203fff
>>>>>> irq
>>>> 52 at
>>>>>> device 0.1 on pci129
>>>>>> ix1: Using MSIX interrupts with 9 vectors
>>>>>> ix1: Ethernet address: 00:1b:21:89:25:33
>>>>>> ix1: PCI Express Bus: Speed 5.0GT/s Width x8
>>>>>> pcib12: <ACPI PCI-PCI bridge> irq 71 at device 2.0 on pci128
>>>>>> pci131: <ACPI PCI bus> on pcib12
>>>>>> pcib13: <ACPI PCI-PCI bridge> irq 71 at device 3.0 on pci128
>>>>>> pci132: <ACPI PCI bus> on pcib13
>>>>>> acpi_button0: <Sleep Button> on acpi0
>>>>>> pcib14: <ACPI Host-PCI bridge> on acpi0
>>>>>> pci127: <ACPI PCI bus> on pcib14
>>>>>> pcib15: <ACPI Host-PCI bridge> on acpi0
>>>>>> pci255: <ACPI PCI bus> on pcib15
>>>>>> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on
>>>>>> acpi0
>>>>>> uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
>>>>>> orm0: <ISA Option ROMs> at iomem
>>>>>>
>>>> 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xcc000-0xccfff,0xcd000-0xcdfff,0xce000-0xcefff,0xcf000-0xcffff
>>>>
>>>>>> on isa0
>>>>>> sc0: <System console> at flags 0x100 on isa0
>>>>>> sc0: VGA <16 virtual consoles, flags=0x300>
>>>>>> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on
>>>> isa0
>>>>>> est0: <Enhanced SpeedStep Frequency Control> on cpu0
>>>>>> p4tcc0: <CPU Frequency Thermal Control> on cpu0
>>>>>> est1: <Enhanced SpeedStep Frequency Control> on cpu1
>>>>>> p4tcc1: <CPU Frequency Thermal Control> on cpu1
>>>>>> est2: <Enhanced SpeedStep Frequency Control> on cpu2
>>>>>> p4tcc2: <CPU Frequency Thermal Control> on cpu2
>>>>>> est3: <Enhanced SpeedStep Frequency Control> on cpu3
>>>>>> p4tcc3: <CPU Frequency Thermal Control> on cpu3
>>>>>> est4: <Enhanced SpeedStep Frequency Control> on cpu4
>>>>>> p4tcc4: <CPU Frequency Thermal Control> on cpu4
>>>>>> est5: <Enhanced SpeedStep Frequency Control> on cpu5
>>>>>> p4tcc5: <CPU Frequency Thermal Control> on cpu5
>>>>>> est6: <Enhanced SpeedStep Frequency Control> on cpu6
>>>>>> p4tcc6: <CPU Frequency Thermal Control> on cpu6
>>>>>> est7: <Enhanced SpeedStep Frequency Control> on cpu7
>>>>>> p4tcc7: <CPU Frequency Thermal Control> on cpu7
>>>>>> est8: <Enhanced SpeedStep Frequency Control> on cpu8
>>>>>> p4tcc8: <CPU Frequency Thermal Control> on cpu8
>>>>>> est9: <Enhanced SpeedStep Frequency Control> on cpu9
>>>>>> p4tcc9: <CPU Frequency Thermal Control> on cpu9
>>>>>> est10: <Enhanced SpeedStep Frequency Control> on cpu10
>>>>>> p4tcc10: <CPU Frequency Thermal Control> on cpu10
>>>>>> est11: <Enhanced SpeedStep Frequency Control> on cpu11
>>>>>> p4tcc11: <CPU Frequency Thermal Control> on cpu11
>>>>>> random: unblocking device.
>>>>>> usbus0: 480Mbps High Speed USB v2.0
>>>>>> Timecounters tick every 1.000 msec
>>>>>> IPsec: Initialized Security Association Processing.
>>>>>> ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to
>>>> accept,
>>>>>> logging disabled
>>>>>> usbus1: 480Mbps High Speed USB v2.0
>>>>>> ugen1.1: <Intel> at usbus1
>>>>>> uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on
>>>>>> usbus1
>>>>>> ugen0.1: <Intel> at usbus0
>>>>>> uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on
>>>>>> usbus0
>>>>>> ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
>>>>>> ada0: <Samsung SSD 840 EVO 120GB EXT0BB6Q> ATA-9 SATA 3.x device
>>>>>> ada0: Serial Number S1D5NSAF687077K
>>>>>> ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
>>>>>> ada0: Command Queueing enabled
>>>>>> ada0: 114473MB (234441648 512 byte sectors: 16H 63S/T 16383C)
>>>>>> ada0: quirks=0x1<4K>
>>>>>> ada0: Previously was known as ad4
>>>>>> ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
>>>>>> ses0: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
>>>>>> ses0: SEMB SES Device
>>>>>> SMP: AP CPU #6 Launched!
>>>>>> SMP: AP CPU #3 Launched!
>>>>>> SMP: AP CPU #11 Launched!
>>>>>> SMP: AP CPU #5 Launched!
>>>>>> SMP: AP CPU #9 Launched!
>>>>>> SMP: AP CPU #1 Launched!
>>>>>> SMP: AP CPU #10 Launched!
>>>>>> SMP: AP CPU #2 Launched!
>>>>>> SMP: AP CPU #8 Launched!
>>>>>> SMP: AP CPU #4 Launched!
>>>>>> SMP: AP CPU #7 Launched!
>>>>>> Timecounter "TSC-low" frequency 1296902002 Hz quality 1000
>>>>>> Root mount waiting for: usbus1 usbus0
>>>>>> uhub1: 2 ports with 2 removable, self powered
>>>>>> uhub0: 2 ports with 2 removable, self powered
>>>>>> Root mount waiting for: usbus1 usbus0
>>>>>> ugen1.2: <vendor 0x8087> at usbus1
>>>>>> uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00,
>>>>>> addr 2>
>>>> on
>>>>>> usbus1
>>>>>> ugen0.2: <vendor 0x8087> at usbus0
>>>>>> uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00,
>>>>>> addr 2>
>>>> on
>>>>>> usbus0
>>>>>> Root mount waiting for: usbus1 usbus0
>>>>>> uhub3: 6 ports with 6 removable, self powered
>>>>>> uhub2: 8 ports with 8 removable, self powered
>>>>>> ugen1.3: <American Megatrends Inc.> at usbus1
>>>>>> ukbd0: <Keyboard Interface> on usbus1
>>>>>> kbd0 at ukbd0
>>>>>> Root mount waiting for: usbus1
>>>>>> ugen1.4: <USB> at usbus1
>>>>>> ukbd1: <USB USB Keykoard, class 0/0, rev 1.10/1.10, addr 4> on usbus1
>>>>>> kbd2 at ukbd1
>>>>>> Trying to mount root from ufs:/dev/label/rootfs [rw]...
>>>>>> lagg0: IPv6 addresses on igb6 have been removed before adding it as a
>>>>>> member to prevent IPv6 address scope violation.
>>>>>> lagg0: IPv6 addresses on igb7 have been removed before adding it as a
>>>>>> member to prevent IPv6 address scope violation.
>>>>>> ums0: <Mouse Interface> on usbus1
>>>>>> ums0: 3 buttons and [Z] coordinates ID=0
>>>>>> uhid0: <USB USB Keykoard, class 0/0, rev 1.10/1.10, addr 4> on usbus1
>>>>>>
>>>>>> # uname -a
>>>>>> FreeBSD rt01.xxxxx.com.br 10.1-RELEASE FreeBSD 10.1-RELEASE #2
>>>>>> r274375:
>>>>>> Tue Nov 11 10:24:44 BRST 2014
>>>>>> root@rt01.xxxxx.com.br:/usr/obj/usr/src/sys/GONDIM10 amd64
>>>>>>
>>>>>> [1] https://calomel.org/freebsd_network_tuning.html
>>>>>> [2] http://ark.intel.com/products/63157
>>>>>> [3]
>>>>>>





Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?547D1BD7.90502>