Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 28 May 2015 23:32:02 +0430
From:      Babak Farrokhi <babak@farrokhi.net>
To:        Guy Helmer <guy.helmer@gmail.com>
Cc:        freebsd-net@freebsd.org
Subject:   Re: FreeBSD 9.3 - Intel X520-SR2 stops passing packets
Message-ID:  <5567662A.9060406@farrokhi.net>
In-Reply-To: <51002FF3-06BF-4CDB-9D78-A25EA15DF263@gmail.com>
References:  <C8B78CF4-184C-4BFE-B848-37A91A3B696B@gmail.com> <5560C395.8020807@farrokhi.net> <51002FF3-06BF-4CDB-9D78-A25EA15DF263@gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
If you are having high interrupt rate, it will be same on latest 10-STABLE.
Are you using an unsupported SFP?

> Guy Helmer <mailto:guy.helmer@gmail.com>
> May 28, 2015 at 6:24 PM
>> On May 23, 2015, at 1:14 PM, Babak Farrokhi <babak@farrokhi.net> wrote:
>>
>> Look at the interrupts per queue. 500,000 is the maximum and it is the reason your interface is not accepting new packets.
>
> Thanks for the insight. Is there any possible mitigation for this issue?
>
> Regards,
> Guy
>
>>> Guy Helmer <mailto:guy.helmer@gmail.com>	May 21, 2015 at 6:03 PM
>>> I’ve noticed that there have been reports of problems with Intel X520-SR2 network interfaces stopping working. I think I’m seeing a similar issue where the 10Gb interfaces stop receiving traffic (they’re being used in promiscuous mode to sniff traffic from a tap). ifconfig shows the interfaces are still active and the links are OK. ifconfig down/up restores activity. I’ve changed hw.intr_storm_threshold=8000 but I couldn’t tell if the interrupt storm threshold had been triggered at the time the interfaces stopped passing traffic.
>>>
>>> Output from sysctl:
>>>
>>> # sysctl dev.ix.0
>>> dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15
>>> dev.ix.0.%driver: ix
>>> dev.ix.0.%location: slot=0 function=0
>>> dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 subdevice=0x0003 class=0x020000
>>> dev.ix.0.%parent: pci4
>>> dev.ix.0.fc: 0
>>> dev.ix.0.enable_aim: 1
>>> dev.ix.0.advertise_speed: 0
>>> dev.ix.0.dropped: 0
>>> dev.ix.0.mbuf_defrag_failed: 0
>>> dev.ix.0.watchdog_events: 0
>>> dev.ix.0.link_irq: 3
>>> dev.ix.0.queue0.interrupt_rate: 500000
>>> dev.ix.0.queue0.irqs: 454449470
>>> dev.ix.0.queue0.txd_head: 0
>>> dev.ix.0.queue0.txd_tail: 0
>>> dev.ix.0.queue0.tso_tx: 0
>>> dev.ix.0.queue0.no_tx_dma_setup: 0
>>> dev.ix.0.queue0.no_desc_avail: 0
>>> dev.ix.0.queue0.tx_packets: 0
>>> dev.ix.0.queue0.rxd_head: 1437
>>> dev.ix.0.queue0.rxd_tail: 1436
>>> dev.ix.0.queue0.rx_packets: 547499168
>>> dev.ix.0.queue0.rx_bytes: 87201112584
>>> dev.ix.0.queue0.rx_copies: 7934870
>>> dev.ix.0.queue0.lro_queued: 0
>>> dev.ix.0.queue0.lro_flushed: 0
>>> dev.ix.0.queue1.interrupt_rate: 500000
>>> dev.ix.0.queue1.irqs: 466235043
>>> dev.ix.0.queue1.txd_head: 0
>>> dev.ix.0.queue1.txd_tail: 0
>>> dev.ix.0.queue1.tso_tx: 0
>>> dev.ix.0.queue1.no_tx_dma_setup: 0
>>> dev.ix.0.queue1.no_desc_avail: 0
>>> dev.ix.0.queue1.tx_packets: 0
>>> dev.ix.0.queue1.rxd_head: 277
>>> dev.ix.0.queue1.rxd_tail: 276
>>> dev.ix.0.queue1.rx_packets: 547668680
>>> dev.ix.0.queue1.rx_bytes: 86205679601
>>> dev.ix.0.queue1.rx_copies: 7846653
>>> dev.ix.0.queue1.lro_queued: 0
>>> dev.ix.0.queue1.lro_flushed: 0
>>> dev.ix.0.queue2.interrupt_rate: 500000
>>> dev.ix.0.queue2.irqs: 473958473
>>> dev.ix.0.queue2.txd_head: 0
>>> dev.ix.0.queue2.txd_tail: 0
>>> dev.ix.0.queue2.tso_tx: 0
>>> dev.ix.0.queue2.no_tx_dma_setup: 0
>>> dev.ix.0.queue2.no_desc_avail: 0
>>> dev.ix.0.queue2.tx_packets: 0
>>> dev.ix.0.queue2.rxd_head: 576
>>> dev.ix.0.queue2.rxd_tail: 575
>>> dev.ix.0.queue2.rx_packets: 555704840
>>> dev.ix.0.queue2.rx_bytes: 87294164455
>>> dev.ix.0.queue2.rx_copies: 8297211
>>> dev.ix.0.queue2.lro_queued: 0
>>> dev.ix.0.queue2.lro_flushed: 0
>>> dev.ix.0.queue3.interrupt_rate: 500000
>>> dev.ix.0.queue3.irqs: 477587504
>>> dev.ix.0.queue3.txd_head: 0
>>> dev.ix.0.queue3.txd_tail: 0
>>> dev.ix.0.queue3.tso_tx: 0
>>> dev.ix.0.queue3.no_tx_dma_setup: 0
>>> dev.ix.0.queue3.no_desc_avail: 0
>>> dev.ix.0.queue3.tx_packets: 0
>>> dev.ix.0.queue3.rxd_head: 267
>>> dev.ix.0.queue3.rxd_tail: 266
>>> dev.ix.0.queue3.rx_packets: 559921557
>>> dev.ix.0.queue3.rx_bytes: 86832161258
>>> dev.ix.0.queue3.rx_copies: 7918011
>>> dev.ix.0.queue3.lro_queued: 0
>>> dev.ix.0.queue3.lro_flushed: 0
>>> dev.ix.0.queue4.interrupt_rate: 500000
>>> dev.ix.0.queue4.irqs: 558339677
>>> dev.ix.0.queue4.txd_head: 0
>>> dev.ix.0.queue4.txd_tail: 0
>>> dev.ix.0.queue4.tso_tx: 0
>>> dev.ix.0.queue4.no_tx_dma_setup: 0
>>> dev.ix.0.queue4.no_desc_avail: 0
>>> dev.ix.0.queue4.tx_packets: 0
>>> dev.ix.0.queue4.rxd_head: 1240
>>> dev.ix.0.queue4.rxd_tail: 1239
>>> dev.ix.0.queue4.rx_packets: 646909190
>>> dev.ix.0.queue4.rx_bytes: 87117307815
>>> dev.ix.0.queue4.rx_copies: 7944848
>>> dev.ix.0.queue4.lro_queued: 0
>>> dev.ix.0.queue4.lro_flushed: 0
>>> dev.ix.0.queue5.interrupt_rate: 500000
>>> dev.ix.0.queue5.irqs: 467836647
>>> dev.ix.0.queue5.txd_head: 0
>>> dev.ix.0.queue5.txd_tail: 0
>>> dev.ix.0.queue5.tso_tx: 0
>>> dev.ix.0.queue5.no_tx_dma_setup: 0
>>> dev.ix.0.queue5.no_desc_avail: 0
>>> dev.ix.0.queue5.tx_packets: 0
>>> dev.ix.0.queue5.rxd_head: 1411
>>> dev.ix.0.queue5.rxd_tail: 1410
>>> dev.ix.0.queue5.rx_packets: 549666835
>>> dev.ix.0.queue5.rx_bytes: 84671540121
>>> dev.ix.0.queue5.rx_copies: 8258025
>>> dev.ix.0.queue5.lro_queued: 0
>>> dev.ix.0.queue5.lro_flushed: 0
>>> dev.ix.0.queue6.interrupt_rate: 500000
>>> dev.ix.0.queue6.irqs: 490798561
>>> dev.ix.0.queue6.txd_head: 0
>>> dev.ix.0.queue6.txd_tail: 0
>>> dev.ix.0.queue6.tso_tx: 0
>>> dev.ix.0.queue6.no_tx_dma_setup: 0
>>> dev.ix.0.queue6.no_desc_avail: 0
>>> dev.ix.0.queue6.tx_packets: 0
>>> dev.ix.0.queue6.rxd_head: 160
>>> dev.ix.0.queue6.rxd_tail: 159
>>> dev.ix.0.queue6.rx_packets: 590187606
>>> dev.ix.0.queue6.rx_bytes: 92115960421
>>> dev.ix.0.queue6.rx_copies: 8262802
>>> dev.ix.0.queue6.lro_queued: 0
>>> dev.ix.0.queue6.lro_flushed: 0
>>> dev.ix.0.queue7.interrupt_rate: 500000
>>> dev.ix.0.queue7.irqs: 471051540
>>> dev.ix.0.queue7.txd_head: 0
>>> dev.ix.0.queue7.txd_tail: 0
>>> dev.ix.0.queue7.tso_tx: 0
>>> dev.ix.0.queue7.no_tx_dma_setup: 0
>>> dev.ix.0.queue7.no_desc_avail: 0
>>> dev.ix.0.queue7.tx_packets: 0
>>> dev.ix.0.queue7.rxd_head: 640
>>> dev.ix.0.queue7.rxd_tail: 639
>>> dev.ix.0.queue7.rx_packets: 553362982
>>> dev.ix.0.queue7.rx_bytes: 84470102891
>>> dev.ix.0.queue7.rx_copies: 7954102
>>> dev.ix.0.queue7.lro_queued: 0
>>> dev.ix.0.queue7.lro_flushed: 0
>>> dev.ix.0.mac_stats.crc_errs: 2091
>>> dev.ix.0.mac_stats.ill_errs: 26
>>> dev.ix.0.mac_stats.byte_errs: 140
>>> dev.ix.0.mac_stats.short_discards: 0
>>> dev.ix.0.mac_stats.local_faults: 0
>>> dev.ix.0.mac_stats.remote_faults: 0
>>> dev.ix.0.mac_stats.rec_len_errs: 0
>>> dev.ix.0.mac_stats.xon_txd: 0
>>> dev.ix.0.mac_stats.xon_recvd: 0
>>> dev.ix.0.mac_stats.xoff_txd: 0
>>> dev.ix.0.mac_stats.xoff_recvd: 0
>>> dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225
>>> dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409
>>> dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335
>>> dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350
>>> dev.ix.0.mac_stats.mcast_pkts_rcvd: 0
>>> dev.ix.0.mac_stats.bcast_pkts_rcvd: 0
>>> dev.ix.0.mac_stats.rx_frames_64: 721599526
>>> dev.ix.0.mac_stats.rx_frames_65_127: 950131946
>>> dev.ix.0.mac_stats.rx_frames_128_255: 918463009
>>> dev.ix.0.mac_stats.rx_frames_256_511: 291858186
>>> dev.ix.0.mac_stats.rx_frames_512_1023: 237479208
>>> dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925
>>> dev.ix.0.mac_stats.recv_undersized: 0
>>> dev.ix.0.mac_stats.recv_fragmented: 0
>>> dev.ix.0.mac_stats.recv_oversized: 0
>>> dev.ix.0.mac_stats.recv_jabberd: 5
>>> dev.ix.0.mac_stats.management_pkts_rcvd: 0
>>> dev.ix.0.mac_stats.management_pkts_drpd: 0
>>> dev.ix.0.mac_stats.checksum_errs: 4379061
>>> dev.ix.0.mac_stats.good_octets_txd: 0
>>> dev.ix.0.mac_stats.total_pkts_txd: 0
>>> dev.ix.0.mac_stats.good_pkts_txd: 0
>>> dev.ix.0.mac_stats.bcast_pkts_txd: 0
>>> dev.ix.0.mac_stats.mcast_pkts_txd: 0
>>> dev.ix.0.mac_stats.management_pkts_txd: 0
>>> dev.ix.0.mac_stats.tx_frames_64: 0
>>> dev.ix.0.mac_stats.tx_frames_65_127: 0
>>> dev.ix.0.mac_stats.tx_frames_128_255: 0
>>> dev.ix.0.mac_stats.tx_frames_256_511: 0
>>> dev.ix.0.mac_stats.tx_frames_512_1023: 0
>>> dev.ix.0.mac_stats.tx_frames_1024_1522: 0
>>>
>>> # sysctl dev.ix.1
>>> dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 2.5.15
>>> dev.ix.1.%driver: ix
>>> dev.ix.1.%location: slot=0 function=1
>>> dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086 subdevice=0x0003 class=0x020000
>>> dev.ix.1.%parent: pci4
>>> dev.ix.1.fc: 0
>>> dev.ix.1.enable_aim: 1
>>> dev.ix.1.advertise_speed: 0
>>> dev.ix.1.dropped: 0
>>> dev.ix.1.mbuf_defrag_failed: 0
>>> dev.ix.1.watchdog_events: 0
>>> dev.ix.1.link_irq: 3
>>> dev.ix.1.queue0.interrupt_rate: 500000
>>> dev.ix.1.queue0.irqs: 537134504
>>> dev.ix.1.queue0.txd_head: 0
>>> dev.ix.1.queue0.txd_tail: 0
>>> dev.ix.1.queue0.tso_tx: 0
>>> dev.ix.1.queue0.no_tx_dma_setup: 0
>>> dev.ix.1.queue0.no_desc_avail: 0
>>> dev.ix.1.queue0.tx_packets: 0
>>> dev.ix.1.queue0.rxd_head: 1757
>>> dev.ix.1.queue0.rxd_tail: 1756
>>> dev.ix.1.queue0.rx_packets: 565486932
>>> dev.ix.1.queue0.rx_bytes: 7763122874
>>> dev.ix.1.queue0.rx_copies: 40953968
>>> dev.ix.1.queue0.lro_queued: 0
>>> dev.ix.1.queue0.lro_flushed: 0
>>> dev.ix.1.queue1.interrupt_rate: 500000
>>> dev.ix.1.queue1.irqs: 561383741
>>> dev.ix.1.queue1.txd_head: 0
>>> dev.ix.1.queue1.txd_tail: 0
>>> dev.ix.1.queue1.tso_tx: 0
>>> dev.ix.1.queue1.no_tx_dma_setup: 0
>>> dev.ix.1.queue1.no_desc_avail: 0
>>> dev.ix.1.queue1.tx_packets: 0
>>> dev.ix.1.queue1.rxd_head: 138
>>> dev.ix.1.queue1.rxd_tail: 137
>>> dev.ix.1.queue1.rx_packets: 577262064
>>> dev.ix.1.queue1.rx_bytes: 8709306631
>>> dev.ix.1.queue1.rx_copies: 40844466
>>> dev.ix.1.queue1.lro_queued: 0
>>> dev.ix.1.queue1.lro_flushed: 0
>>> dev.ix.1.queue2.interrupt_rate: 500000
>>> dev.ix.1.queue2.irqs: 547852317
>>> dev.ix.1.queue2.txd_head: 0
>>> dev.ix.1.queue2.txd_tail: 0
>>> dev.ix.1.queue2.tso_tx: 0
>>> dev.ix.1.queue2.no_tx_dma_setup: 0
>>> dev.ix.1.queue2.no_desc_avail: 0
>>> dev.ix.1.queue2.tx_packets: 0
>>> dev.ix.1.queue2.rxd_head: 386
>>> dev.ix.1.queue2.rxd_tail: 385
>>> dev.ix.1.queue2.rx_packets: 562301518
>>> dev.ix.1.queue2.rx_bytes: 6698895889
>>> dev.ix.1.queue2.rx_copies: 40867897
>>> dev.ix.1.queue2.lro_queued: 0
>>> dev.ix.1.queue2.lro_flushed: 0
>>> dev.ix.1.queue3.interrupt_rate: 500000
>>> dev.ix.1.queue3.irqs: 551254360
>>> dev.ix.1.queue3.txd_head: 0
>>> dev.ix.1.queue3.txd_tail: 0
>>> dev.ix.1.queue3.tso_tx: 0
>>> dev.ix.1.queue3.no_tx_dma_setup: 0
>>> dev.ix.1.queue3.no_desc_avail: 0
>>> dev.ix.1.queue3.tx_packets: 0
>>> dev.ix.1.queue3.rxd_head: 1446
>>> dev.ix.1.queue3.rxd_tail: 1445
>>> dev.ix.1.queue3.rx_packets: 566052657
>>> dev.ix.1.queue3.rx_bytes: 8010009389
>>> dev.ix.1.queue3.rx_copies: 41116971
>>> dev.ix.1.queue3.lro_queued: 0
>>> dev.ix.1.queue3.lro_flushed: 0
>>> dev.ix.1.queue4.interrupt_rate: 500000
>>> dev.ix.1.queue4.irqs: 546581703
>>> dev.ix.1.queue4.txd_head: 0
>>> dev.ix.1.queue4.txd_tail: 0
>>> dev.ix.1.queue4.tso_tx: 0
>>> dev.ix.1.queue4.no_tx_dma_setup: 0
>>> dev.ix.1.queue4.no_desc_avail: 0
>>> dev.ix.1.queue4.tx_packets: 0
>>> dev.ix.1.queue4.rxd_head: 965
>>> dev.ix.1.queue4.rxd_tail: 964
>>> dev.ix.1.queue4.rx_packets: 561519824
>>> dev.ix.1.queue4.rx_bytes: 7656671816
>>> dev.ix.1.queue4.rx_copies: 41183608
>>> dev.ix.1.queue4.lro_queued: 0
>>> dev.ix.1.queue4.lro_flushed: 0
>>> dev.ix.1.queue5.interrupt_rate: 500000
>>> dev.ix.1.queue5.irqs: 557099892
>>> dev.ix.1.queue5.txd_head: 0
>>> dev.ix.1.queue5.txd_tail: 0
>>> dev.ix.1.queue5.tso_tx: 0
>>> dev.ix.1.queue5.no_tx_dma_setup: 0
>>> dev.ix.1.queue5.no_desc_avail: 0
>>> dev.ix.1.queue5.tx_packets: 0
>>> dev.ix.1.queue5.rxd_head: 1788
>>> dev.ix.1.queue5.rxd_tail: 1787
>>> dev.ix.1.queue5.rx_packets: 572588639
>>> dev.ix.1.queue5.rx_bytes: 7259699024
>>> dev.ix.1.queue5.rx_copies: 43207640
>>> dev.ix.1.queue5.lro_queued: 0
>>> dev.ix.1.queue5.lro_flushed: 0
>>> dev.ix.1.queue6.interrupt_rate: 500000
>>> dev.ix.1.queue6.irqs: 574139280
>>> dev.ix.1.queue6.txd_head: 0
>>> dev.ix.1.queue6.txd_tail: 0
>>> dev.ix.1.queue6.tso_tx: 0
>>> dev.ix.1.queue6.no_tx_dma_setup: 0
>>> dev.ix.1.queue6.no_desc_avail: 0
>>> dev.ix.1.queue6.tx_packets: 0
>>> dev.ix.1.queue6.rxd_head: 45
>>> dev.ix.1.queue6.rxd_tail: 44
>>> dev.ix.1.queue6.rx_packets: 589160795
>>> dev.ix.1.queue6.rx_bytes: 7475849844
>>> dev.ix.1.queue6.rx_copies: 40589940
>>> dev.ix.1.queue6.lro_queued: 0
>>> dev.ix.1.queue6.lro_flushed: 0
>>> dev.ix.1.queue7.interrupt_rate: 500000
>>> dev.ix.1.queue7.irqs: 552769977
>>> dev.ix.1.queue7.txd_head: 0
>>> dev.ix.1.queue7.txd_tail: 0
>>> dev.ix.1.queue7.tso_tx: 0
>>> dev.ix.1.queue7.no_tx_dma_setup: 0
>>> dev.ix.1.queue7.no_desc_avail: 0
>>> dev.ix.1.queue7.tx_packets: 0
>>> dev.ix.1.queue7.rxd_head: 1050
>>> dev.ix.1.queue7.rxd_tail: 1049
>>> dev.ix.1.queue7.rx_packets: 567580543
>>> dev.ix.1.queue7.rx_bytes: 7210216689
>>> dev.ix.1.queue7.rx_copies: 41856967
>>> dev.ix.1.queue7.lro_queued: 0
>>> dev.ix.1.queue7.lro_flushed: 0
>>> dev.ix.1.mac_stats.crc_errs: 40044743
>>> dev.ix.1.mac_stats.ill_errs: 4347098
>>> dev.ix.1.mac_stats.byte_errs: 7192103
>>> dev.ix.1.mac_stats.short_discards: 49169
>>> dev.ix.1.mac_stats.local_faults: 0
>>> dev.ix.1.mac_stats.remote_faults: 0
>>> dev.ix.1.mac_stats.rec_len_errs: 41772
>>> dev.ix.1.mac_stats.xon_txd: 0
>>> dev.ix.1.mac_stats.xon_recvd: 0
>>> dev.ix.1.mac_stats.xoff_txd: 0
>>> dev.ix.1.mac_stats.xoff_recvd: 0
>>> dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146
>>> dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961
>>> dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520
>>> dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527
>>> dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746
>>> dev.ix.1.mac_stats.bcast_pkts_rcvd: 0
>>> dev.ix.1.mac_stats.rx_frames_64: 3314959123
>>> dev.ix.1.mac_stats.rx_frames_65_127: 4610233544
>>> dev.ix.1.mac_stats.rx_frames_128_255: 256517169
>>> dev.ix.1.mac_stats.rx_frames_256_511: 304326606
>>> dev.ix.1.mac_stats.rx_frames_512_1023: 223999237
>>> dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680
>>> dev.ix.1.mac_stats.recv_undersized: 0
>>> dev.ix.1.mac_stats.recv_fragmented: 0
>>> dev.ix.1.mac_stats.recv_oversized: 0
>>> dev.ix.1.mac_stats.recv_jabberd: 71008
>>> dev.ix.1.mac_stats.management_pkts_rcvd: 0
>>> dev.ix.1.mac_stats.management_pkts_drpd: 0
>>> dev.ix.1.mac_stats.checksum_errs: 3901883
>>> dev.ix.1.mac_stats.good_octets_txd: 0
>>> dev.ix.1.mac_stats.total_pkts_txd: 0
>>> dev.ix.1.mac_stats.good_pkts_txd: 0
>>> dev.ix.1.mac_stats.bcast_pkts_txd: 0
>>> dev.ix.1.mac_stats.mcast_pkts_txd: 0
>>> dev.ix.1.mac_stats.management_pkts_txd: 0
>>> dev.ix.1.mac_stats.tx_frames_64: 0
>>> dev.ix.1.mac_stats.tx_frames_65_127: 0
>>> dev.ix.1.mac_stats.tx_frames_128_255: 0
>>> dev.ix.1.mac_stats.tx_frames_256_511: 0
>>> dev.ix.1.mac_stats.tx_frames_512_1023: 0
>>> dev.ix.1.mac_stats.tx_frames_1024_1522: 0
>>> _______________________________________________
>>> freebsd-net@freebsd.org <mailto:freebsd-net@freebsd.org> mailing list
>>> http://lists.freebsd.org/mailman/listinfo/freebsd-net <http://lists.freebsd.org/mailman/listinfo/freebsd-net>;
>>> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" <mailto:freebsd-net-unsubscribe@freebsd.org>
>> -- 
>> Babak Farrokhi
>>
>
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
> Babak Farrokhi <mailto:babak@farrokhi.net>
> May 23, 2015 at 10:44 PM
> Look at the interrupts per queue. 500,000 is the maximum and it is the
> reason your interface is not accepting new packets.
>
>
>
> Guy Helmer <mailto:guy.helmer@gmail.com>
> May 21, 2015 at 6:03 PM
> I’ve noticed that there have been reports of problems with Intel
> X520-SR2 network interfaces stopping working. I think I’m seeing a
> similar issue where the 10Gb interfaces stop receiving traffic
> (they’re being used in promiscuous mode to sniff traffic from a tap).
> ifconfig shows the interfaces are still active and the links are OK.
> ifconfig down/up restores activity. I’ve changed
> hw.intr_storm_threshold=8000 but I couldn’t tell if the interrupt
> storm threshold had been triggered at the time the interfaces stopped
> passing traffic.
>
> Output from sysctl:
>
> # sysctl dev.ix.0
> dev.ix.0.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version
> - 2.5.15
> dev.ix.0.%driver: ix
> dev.ix.0.%location: slot=0 function=0
> dev.ix.0.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086
> subdevice=0x0003 class=0x020000
> dev.ix.0.%parent: pci4
> dev.ix.0.fc: 0
> dev.ix.0.enable_aim: 1
> dev.ix.0.advertise_speed: 0
> dev.ix.0.dropped: 0
> dev.ix.0.mbuf_defrag_failed: 0
> dev.ix.0.watchdog_events: 0
> dev.ix.0.link_irq: 3
> dev.ix.0.queue0.interrupt_rate: 500000
> dev.ix.0.queue0.irqs: 454449470
> dev.ix.0.queue0.txd_head: 0
> dev.ix.0.queue0.txd_tail: 0
> dev.ix.0.queue0.tso_tx: 0
> dev.ix.0.queue0.no_tx_dma_setup: 0
> dev.ix.0.queue0.no_desc_avail: 0
> dev.ix.0.queue0.tx_packets: 0
> dev.ix.0.queue0.rxd_head: 1437
> dev.ix.0.queue0.rxd_tail: 1436
> dev.ix.0.queue0.rx_packets: 547499168
> dev.ix.0.queue0.rx_bytes: 87201112584
> dev.ix.0.queue0.rx_copies: 7934870
> dev.ix.0.queue0.lro_queued: 0
> dev.ix.0.queue0.lro_flushed: 0
> dev.ix.0.queue1.interrupt_rate: 500000
> dev.ix.0.queue1.irqs: 466235043
> dev.ix.0.queue1.txd_head: 0
> dev.ix.0.queue1.txd_tail: 0
> dev.ix.0.queue1.tso_tx: 0
> dev.ix.0.queue1.no_tx_dma_setup: 0
> dev.ix.0.queue1.no_desc_avail: 0
> dev.ix.0.queue1.tx_packets: 0
> dev.ix.0.queue1.rxd_head: 277
> dev.ix.0.queue1.rxd_tail: 276
> dev.ix.0.queue1.rx_packets: 547668680
> dev.ix.0.queue1.rx_bytes: 86205679601
> dev.ix.0.queue1.rx_copies: 7846653
> dev.ix.0.queue1.lro_queued: 0
> dev.ix.0.queue1.lro_flushed: 0
> dev.ix.0.queue2.interrupt_rate: 500000
> dev.ix.0.queue2.irqs: 473958473
> dev.ix.0.queue2.txd_head: 0
> dev.ix.0.queue2.txd_tail: 0
> dev.ix.0.queue2.tso_tx: 0
> dev.ix.0.queue2.no_tx_dma_setup: 0
> dev.ix.0.queue2.no_desc_avail: 0
> dev.ix.0.queue2.tx_packets: 0
> dev.ix.0.queue2.rxd_head: 576
> dev.ix.0.queue2.rxd_tail: 575
> dev.ix.0.queue2.rx_packets: 555704840
> dev.ix.0.queue2.rx_bytes: 87294164455
> dev.ix.0.queue2.rx_copies: 8297211
> dev.ix.0.queue2.lro_queued: 0
> dev.ix.0.queue2.lro_flushed: 0
> dev.ix.0.queue3.interrupt_rate: 500000
> dev.ix.0.queue3.irqs: 477587504
> dev.ix.0.queue3.txd_head: 0
> dev.ix.0.queue3.txd_tail: 0
> dev.ix.0.queue3.tso_tx: 0
> dev.ix.0.queue3.no_tx_dma_setup: 0
> dev.ix.0.queue3.no_desc_avail: 0
> dev.ix.0.queue3.tx_packets: 0
> dev.ix.0.queue3.rxd_head: 267
> dev.ix.0.queue3.rxd_tail: 266
> dev.ix.0.queue3.rx_packets: 559921557
> dev.ix.0.queue3.rx_bytes: 86832161258
> dev.ix.0.queue3.rx_copies: 7918011
> dev.ix.0.queue3.lro_queued: 0
> dev.ix.0.queue3.lro_flushed: 0
> dev.ix.0.queue4.interrupt_rate: 500000
> dev.ix.0.queue4.irqs: 558339677
> dev.ix.0.queue4.txd_head: 0
> dev.ix.0.queue4.txd_tail: 0
> dev.ix.0.queue4.tso_tx: 0
> dev.ix.0.queue4.no_tx_dma_setup: 0
> dev.ix.0.queue4.no_desc_avail: 0
> dev.ix.0.queue4.tx_packets: 0
> dev.ix.0.queue4.rxd_head: 1240
> dev.ix.0.queue4.rxd_tail: 1239
> dev.ix.0.queue4.rx_packets: 646909190
> dev.ix.0.queue4.rx_bytes: 87117307815
> dev.ix.0.queue4.rx_copies: 7944848
> dev.ix.0.queue4.lro_queued: 0
> dev.ix.0.queue4.lro_flushed: 0
> dev.ix.0.queue5.interrupt_rate: 500000
> dev.ix.0.queue5.irqs: 467836647
> dev.ix.0.queue5.txd_head: 0
> dev.ix.0.queue5.txd_tail: 0
> dev.ix.0.queue5.tso_tx: 0
> dev.ix.0.queue5.no_tx_dma_setup: 0
> dev.ix.0.queue5.no_desc_avail: 0
> dev.ix.0.queue5.tx_packets: 0
> dev.ix.0.queue5.rxd_head: 1411
> dev.ix.0.queue5.rxd_tail: 1410
> dev.ix.0.queue5.rx_packets: 549666835
> dev.ix.0.queue5.rx_bytes: 84671540121
> dev.ix.0.queue5.rx_copies: 8258025
> dev.ix.0.queue5.lro_queued: 0
> dev.ix.0.queue5.lro_flushed: 0
> dev.ix.0.queue6.interrupt_rate: 500000
> dev.ix.0.queue6.irqs: 490798561
> dev.ix.0.queue6.txd_head: 0
> dev.ix.0.queue6.txd_tail: 0
> dev.ix.0.queue6.tso_tx: 0
> dev.ix.0.queue6.no_tx_dma_setup: 0
> dev.ix.0.queue6.no_desc_avail: 0
> dev.ix.0.queue6.tx_packets: 0
> dev.ix.0.queue6.rxd_head: 160
> dev.ix.0.queue6.rxd_tail: 159
> dev.ix.0.queue6.rx_packets: 590187606
> dev.ix.0.queue6.rx_bytes: 92115960421
> dev.ix.0.queue6.rx_copies: 8262802
> dev.ix.0.queue6.lro_queued: 0
> dev.ix.0.queue6.lro_flushed: 0
> dev.ix.0.queue7.interrupt_rate: 500000
> dev.ix.0.queue7.irqs: 471051540
> dev.ix.0.queue7.txd_head: 0
> dev.ix.0.queue7.txd_tail: 0
> dev.ix.0.queue7.tso_tx: 0
> dev.ix.0.queue7.no_tx_dma_setup: 0
> dev.ix.0.queue7.no_desc_avail: 0
> dev.ix.0.queue7.tx_packets: 0
> dev.ix.0.queue7.rxd_head: 640
> dev.ix.0.queue7.rxd_tail: 639
> dev.ix.0.queue7.rx_packets: 553362982
> dev.ix.0.queue7.rx_bytes: 84470102891
> dev.ix.0.queue7.rx_copies: 7954102
> dev.ix.0.queue7.lro_queued: 0
> dev.ix.0.queue7.lro_flushed: 0
> dev.ix.0.mac_stats.crc_errs: 2091
> dev.ix.0.mac_stats.ill_errs: 26
> dev.ix.0.mac_stats.byte_errs: 140
> dev.ix.0.mac_stats.short_discards: 0
> dev.ix.0.mac_stats.local_faults: 0
> dev.ix.0.mac_stats.remote_faults: 0
> dev.ix.0.mac_stats.rec_len_errs: 0
> dev.ix.0.mac_stats.xon_txd: 0
> dev.ix.0.mac_stats.xon_recvd: 0
> dev.ix.0.mac_stats.xoff_txd: 0
> dev.ix.0.mac_stats.xoff_recvd: 0
> dev.ix.0.mac_stats.total_octets_rcvd: 17956217280225
> dev.ix.0.mac_stats.good_octets_rcvd: 17945313085409
> dev.ix.0.mac_stats.total_pkts_rcvd: 15243381335
> dev.ix.0.mac_stats.good_pkts_rcvd: 4550864350
> dev.ix.0.mac_stats.mcast_pkts_rcvd: 0
> dev.ix.0.mac_stats.bcast_pkts_rcvd: 0
> dev.ix.0.mac_stats.rx_frames_64: 721599526
> dev.ix.0.mac_stats.rx_frames_65_127: 950131946
> dev.ix.0.mac_stats.rx_frames_128_255: 918463009
> dev.ix.0.mac_stats.rx_frames_256_511: 291858186
> dev.ix.0.mac_stats.rx_frames_512_1023: 237479208
> dev.ix.0.mac_stats.rx_frames_1024_1522: 12114578925
> dev.ix.0.mac_stats.recv_undersized: 0
> dev.ix.0.mac_stats.recv_fragmented: 0
> dev.ix.0.mac_stats.recv_oversized: 0
> dev.ix.0.mac_stats.recv_jabberd: 5
> dev.ix.0.mac_stats.management_pkts_rcvd: 0
> dev.ix.0.mac_stats.management_pkts_drpd: 0
> dev.ix.0.mac_stats.checksum_errs: 4379061
> dev.ix.0.mac_stats.good_octets_txd: 0
> dev.ix.0.mac_stats.total_pkts_txd: 0
> dev.ix.0.mac_stats.good_pkts_txd: 0
> dev.ix.0.mac_stats.bcast_pkts_txd: 0
> dev.ix.0.mac_stats.mcast_pkts_txd: 0
> dev.ix.0.mac_stats.management_pkts_txd: 0
> dev.ix.0.mac_stats.tx_frames_64: 0
> dev.ix.0.mac_stats.tx_frames_65_127: 0
> dev.ix.0.mac_stats.tx_frames_128_255: 0
> dev.ix.0.mac_stats.tx_frames_256_511: 0
> dev.ix.0.mac_stats.tx_frames_512_1023: 0
> dev.ix.0.mac_stats.tx_frames_1024_1522: 0
>
> # sysctl dev.ix.1
> dev.ix.1.%desc: Intel(R) PRO/10GbE PCI-Express Network Driver, Version
> - 2.5.15
> dev.ix.1.%driver: ix
> dev.ix.1.%location: slot=0 function=1
> dev.ix.1.%pnpinfo: vendor=0x8086 device=0x10fb subvendor=0x8086
> subdevice=0x0003 class=0x020000
> dev.ix.1.%parent: pci4
> dev.ix.1.fc: 0
> dev.ix.1.enable_aim: 1
> dev.ix.1.advertise_speed: 0
> dev.ix.1.dropped: 0
> dev.ix.1.mbuf_defrag_failed: 0
> dev.ix.1.watchdog_events: 0
> dev.ix.1.link_irq: 3
> dev.ix.1.queue0.interrupt_rate: 500000
> dev.ix.1.queue0.irqs: 537134504
> dev.ix.1.queue0.txd_head: 0
> dev.ix.1.queue0.txd_tail: 0
> dev.ix.1.queue0.tso_tx: 0
> dev.ix.1.queue0.no_tx_dma_setup: 0
> dev.ix.1.queue0.no_desc_avail: 0
> dev.ix.1.queue0.tx_packets: 0
> dev.ix.1.queue0.rxd_head: 1757
> dev.ix.1.queue0.rxd_tail: 1756
> dev.ix.1.queue0.rx_packets: 565486932
> dev.ix.1.queue0.rx_bytes: 7763122874
> dev.ix.1.queue0.rx_copies: 40953968
> dev.ix.1.queue0.lro_queued: 0
> dev.ix.1.queue0.lro_flushed: 0
> dev.ix.1.queue1.interrupt_rate: 500000
> dev.ix.1.queue1.irqs: 561383741
> dev.ix.1.queue1.txd_head: 0
> dev.ix.1.queue1.txd_tail: 0
> dev.ix.1.queue1.tso_tx: 0
> dev.ix.1.queue1.no_tx_dma_setup: 0
> dev.ix.1.queue1.no_desc_avail: 0
> dev.ix.1.queue1.tx_packets: 0
> dev.ix.1.queue1.rxd_head: 138
> dev.ix.1.queue1.rxd_tail: 137
> dev.ix.1.queue1.rx_packets: 577262064
> dev.ix.1.queue1.rx_bytes: 8709306631
> dev.ix.1.queue1.rx_copies: 40844466
> dev.ix.1.queue1.lro_queued: 0
> dev.ix.1.queue1.lro_flushed: 0
> dev.ix.1.queue2.interrupt_rate: 500000
> dev.ix.1.queue2.irqs: 547852317
> dev.ix.1.queue2.txd_head: 0
> dev.ix.1.queue2.txd_tail: 0
> dev.ix.1.queue2.tso_tx: 0
> dev.ix.1.queue2.no_tx_dma_setup: 0
> dev.ix.1.queue2.no_desc_avail: 0
> dev.ix.1.queue2.tx_packets: 0
> dev.ix.1.queue2.rxd_head: 386
> dev.ix.1.queue2.rxd_tail: 385
> dev.ix.1.queue2.rx_packets: 562301518
> dev.ix.1.queue2.rx_bytes: 6698895889
> dev.ix.1.queue2.rx_copies: 40867897
> dev.ix.1.queue2.lro_queued: 0
> dev.ix.1.queue2.lro_flushed: 0
> dev.ix.1.queue3.interrupt_rate: 500000
> dev.ix.1.queue3.irqs: 551254360
> dev.ix.1.queue3.txd_head: 0
> dev.ix.1.queue3.txd_tail: 0
> dev.ix.1.queue3.tso_tx: 0
> dev.ix.1.queue3.no_tx_dma_setup: 0
> dev.ix.1.queue3.no_desc_avail: 0
> dev.ix.1.queue3.tx_packets: 0
> dev.ix.1.queue3.rxd_head: 1446
> dev.ix.1.queue3.rxd_tail: 1445
> dev.ix.1.queue3.rx_packets: 566052657
> dev.ix.1.queue3.rx_bytes: 8010009389
> dev.ix.1.queue3.rx_copies: 41116971
> dev.ix.1.queue3.lro_queued: 0
> dev.ix.1.queue3.lro_flushed: 0
> dev.ix.1.queue4.interrupt_rate: 500000
> dev.ix.1.queue4.irqs: 546581703
> dev.ix.1.queue4.txd_head: 0
> dev.ix.1.queue4.txd_tail: 0
> dev.ix.1.queue4.tso_tx: 0
> dev.ix.1.queue4.no_tx_dma_setup: 0
> dev.ix.1.queue4.no_desc_avail: 0
> dev.ix.1.queue4.tx_packets: 0
> dev.ix.1.queue4.rxd_head: 965
> dev.ix.1.queue4.rxd_tail: 964
> dev.ix.1.queue4.rx_packets: 561519824
> dev.ix.1.queue4.rx_bytes: 7656671816
> dev.ix.1.queue4.rx_copies: 41183608
> dev.ix.1.queue4.lro_queued: 0
> dev.ix.1.queue4.lro_flushed: 0
> dev.ix.1.queue5.interrupt_rate: 500000
> dev.ix.1.queue5.irqs: 557099892
> dev.ix.1.queue5.txd_head: 0
> dev.ix.1.queue5.txd_tail: 0
> dev.ix.1.queue5.tso_tx: 0
> dev.ix.1.queue5.no_tx_dma_setup: 0
> dev.ix.1.queue5.no_desc_avail: 0
> dev.ix.1.queue5.tx_packets: 0
> dev.ix.1.queue5.rxd_head: 1788
> dev.ix.1.queue5.rxd_tail: 1787
> dev.ix.1.queue5.rx_packets: 572588639
> dev.ix.1.queue5.rx_bytes: 7259699024
> dev.ix.1.queue5.rx_copies: 43207640
> dev.ix.1.queue5.lro_queued: 0
> dev.ix.1.queue5.lro_flushed: 0
> dev.ix.1.queue6.interrupt_rate: 500000
> dev.ix.1.queue6.irqs: 574139280
> dev.ix.1.queue6.txd_head: 0
> dev.ix.1.queue6.txd_tail: 0
> dev.ix.1.queue6.tso_tx: 0
> dev.ix.1.queue6.no_tx_dma_setup: 0
> dev.ix.1.queue6.no_desc_avail: 0
> dev.ix.1.queue6.tx_packets: 0
> dev.ix.1.queue6.rxd_head: 45
> dev.ix.1.queue6.rxd_tail: 44
> dev.ix.1.queue6.rx_packets: 589160795
> dev.ix.1.queue6.rx_bytes: 7475849844
> dev.ix.1.queue6.rx_copies: 40589940
> dev.ix.1.queue6.lro_queued: 0
> dev.ix.1.queue6.lro_flushed: 0
> dev.ix.1.queue7.interrupt_rate: 500000
> dev.ix.1.queue7.irqs: 552769977
> dev.ix.1.queue7.txd_head: 0
> dev.ix.1.queue7.txd_tail: 0
> dev.ix.1.queue7.tso_tx: 0
> dev.ix.1.queue7.no_tx_dma_setup: 0
> dev.ix.1.queue7.no_desc_avail: 0
> dev.ix.1.queue7.tx_packets: 0
> dev.ix.1.queue7.rxd_head: 1050
> dev.ix.1.queue7.rxd_tail: 1049
> dev.ix.1.queue7.rx_packets: 567580543
> dev.ix.1.queue7.rx_bytes: 7210216689
> dev.ix.1.queue7.rx_copies: 41856967
> dev.ix.1.queue7.lro_queued: 0
> dev.ix.1.queue7.lro_flushed: 0
> dev.ix.1.mac_stats.crc_errs: 40044743
> dev.ix.1.mac_stats.ill_errs: 4347098
> dev.ix.1.mac_stats.byte_errs: 7192103
> dev.ix.1.mac_stats.short_discards: 49169
> dev.ix.1.mac_stats.local_faults: 0
> dev.ix.1.mac_stats.remote_faults: 0
> dev.ix.1.mac_stats.rec_len_errs: 41772
> dev.ix.1.mac_stats.xon_txd: 0
> dev.ix.1.mac_stats.xon_recvd: 0
> dev.ix.1.mac_stats.xoff_txd: 0
> dev.ix.1.mac_stats.xoff_recvd: 0
> dev.ix.1.mac_stats.total_octets_rcvd: 1741353301146
> dev.ix.1.mac_stats.good_octets_rcvd: 1704100700961
> dev.ix.1.mac_stats.total_pkts_rcvd: 9354020520
> dev.ix.1.mac_stats.good_pkts_rcvd: 4561867527
> dev.ix.1.mac_stats.mcast_pkts_rcvd: 139746
> dev.ix.1.mac_stats.bcast_pkts_rcvd: 0
> dev.ix.1.mac_stats.rx_frames_64: 3314959123
> dev.ix.1.mac_stats.rx_frames_65_127: 4610233544
> dev.ix.1.mac_stats.rx_frames_128_255: 256517169
> dev.ix.1.mac_stats.rx_frames_256_511: 304326606
> dev.ix.1.mac_stats.rx_frames_512_1023: 223999237
> dev.ix.1.mac_stats.rx_frames_1024_1522: 591102680
> dev.ix.1.mac_stats.recv_undersized: 0
> dev.ix.1.mac_stats.recv_fragmented: 0
> dev.ix.1.mac_stats.recv_oversized: 0
> dev.ix.1.mac_stats.recv_jabberd: 71008
> dev.ix.1.mac_stats.management_pkts_rcvd: 0
> dev.ix.1.mac_stats.management_pkts_drpd: 0
> dev.ix.1.mac_stats.checksum_errs: 3901883
> dev.ix.1.mac_stats.good_octets_txd: 0
> dev.ix.1.mac_stats.total_pkts_txd: 0
> dev.ix.1.mac_stats.good_pkts_txd: 0
> dev.ix.1.mac_stats.bcast_pkts_txd: 0
> dev.ix.1.mac_stats.mcast_pkts_txd: 0
> dev.ix.1.mac_stats.management_pkts_txd: 0
> dev.ix.1.mac_stats.tx_frames_64: 0
> dev.ix.1.mac_stats.tx_frames_65_127: 0
> dev.ix.1.mac_stats.tx_frames_128_255: 0
> dev.ix.1.mac_stats.tx_frames_256_511: 0
> dev.ix.1.mac_stats.tx_frames_512_1023: 0
> dev.ix.1.mac_stats.tx_frames_1024_1522: 0
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"


-- 
Babak Farrokhi




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5567662A.9060406>