From owner-freebsd-net@FreeBSD.ORG Thu Oct 27 14:50:57 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 13E541065676 for ; Thu, 27 Oct 2011 14:50:57 +0000 (UTC) (envelope-from lacombar@gmail.com) Received: from mail-wy0-f182.google.com (mail-wy0-f182.google.com [74.125.82.182]) by mx1.freebsd.org (Postfix) with ESMTP id 8D2398FC13 for ; Thu, 27 Oct 2011 14:50:56 +0000 (UTC) Received: by wyi40 with SMTP id 40so3867214wyi.13 for ; Thu, 27 Oct 2011 07:50:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=h8pfh8UeoQI0wNMmRUqtzk+kgL8879z3M24AjHD4Opo=; b=G18tWyNawh+lu9H3Z+RJXBEH4S0QH+ACEVtc2/wlmjRnEy08FtNdWmkJOVjLrWMrae Kq/+KDLsb44KBTbdujZF8MidguE5aN1pHycjw77s4Q0oN923/TGFN9atInwFDZUdP9TN rKHnlTMpFqhpeFM8THPYYGozedMlYizlAClDY= MIME-Version: 1.0 Received: by 10.227.203.132 with SMTP id fi4mr17057702wbb.6.1319727055142; Thu, 27 Oct 2011 07:50:55 -0700 (PDT) Received: by 10.180.105.162 with HTTP; Thu, 27 Oct 2011 07:50:54 -0700 (PDT) In-Reply-To: <4EA8FA40.7010504@hotplug.ru> References: <4E8F157A.40702@sentex.net> <4E8F51D4.1060509@sentex.net> <4EA7E203.3020306@sepehrs.com> <4EA80818.3030504@sentex.net> <4EA80F88.4000400@hotplug.ru> <4EA82715.2000404@gmail.com> <4EA8FA40.7010504@hotplug.ru> Date: Thu, 27 Oct 2011 10:50:54 -0400 Message-ID: From: Arnaud Lacombe To: Emil Muratov Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org, Jason Wolfe , Hooman Fazaeli Subject: Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 27 Oct 2011 14:50:57 -0000 Hi, On Thu, Oct 27, 2011 at 2:29 AM, Emil Muratov wrote: > > >> Hi, >> >> Can yan you pls post the output of these command _when_ the problem >> happens? >> >> uname -a >> sysctl dev.em >> netstat -ind >> ifconfig >> > > Hi Hooman > > Here is what I've got when the script triggered just in time when the > interface was locked > > > 11.10.26-23:39:10 ... interface em0 is down... > > FreeBSD ion.hotplug.ru 8.2-STABLE FreeBSD 8.2-STABLE #0: Thu Oct 20 20:20= :25 > Please upgrade to 8-STABLE, similar issues have been fixed there. Thanks, - Arnaud > MSD 2011 =A0 =A0 root@epia.home > .lan:/usr/obj/usr/src/sys/ION6debug =A0amd64 > 11:39PM =A0up =A01:12, 2 users, load averages: 0.26, 0.48, 0.58 > > > =A0=3D=3D vmstat -i =3D=3D > interrupt =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0total =A0 = =A0 =A0 rate > irq22: nfe0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 16644480 =A0 =A0 =A0 = 3865 > cpu0: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A08610122 =A0 =A0 = =A0 1999 > irq256: ahci0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 606705 =A0 =A0 =A0 = =A0140 > irq257: em0:rx 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 3896622 =A0 =A0 =A0 =A09= 04 > irq258: em0:tx 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 2762957 =A0 =A0 =A0 =A06= 41 > irq259: em0:link =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 620 =A0 =A0 =A0 = =A0 =A00 > cpu3: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A08609499 =A0 =A0 = =A0 1999 > cpu1: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A08609499 =A0 =A0 = =A0 1999 > cpu2: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A08609499 =A0 =A0 = =A0 1999 > Total =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 58350003 =A0 = =A0 =A013550 > > =A0=3D=3D netstat -ind =3D=3D > Name =A0 =A0Mtu Network =A0 =A0 =A0 Address =A0 =A0 =A0 =A0 =A0 =A0 =A0Ip= kts Ierrs Idrop =A0 =A0Opkts > Oerrs =A0Coll Drop > usbus =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 0 =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A00 > =A0 0 =A0 =A0 0 =A0 =A00 > usbus =A0 =A0 0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 0 =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A00 > =A0 0 =A0 =A0 0 =A0 =A00 > nfe0 =A0 1500 =A0 =A0 =A000:25:22:21:86:89 =A07157140 =A0 =A0 0 = =A0 =A0 0 12266747 > =A0 0 =A0 =A0 0 =A0 =A00 > nfe0 =A0 1500 fe80::225:22f fe80::225:22ff:fe =A0 =A0 =A0 =A00 =A0 =A0 - = =A0 =A0 - =A0 =A0 =A0 85 > =A0 - =A0 =A0 - =A0 =A0- > nfe0 =A0 1500 10.16.128.0/1 10.16.189.71 =A0 =A0 =A0 =A0 =A0 =A0 0 =A0 = =A0 - =A0 =A0 - =A0 =A048135 > =A0 - =A0 =A0 - =A0 =A0- > em0 =A0 =A09000 =A0 =A0 =A000:1b:21:ab:bf:4a =A05465087 =A0 623 = =A0 =A0 0 =A02862028 > =A0 0 =A0 =A0 0 =A0113 > em0 =A0 =A09000 192.168.168.0 192.168.168.1 =A0 =A0 =A0 764085 =A0 =A0 - = =A0 =A0 - =A01005078 > =A0 - =A0 =A0 - =A0 =A0- > em0 =A0 =A09000 fe80::21b:21f fe80::21b:21ff:fe =A0 =A0 =A0 45 =A0 =A0 - = =A0 =A0 - =A0 =A0 =A0252 > =A0 - =A0 =A0 - =A0 =A0- > em0 =A0 =A09000 2002:d58d:871 2002:d58d:8715:1: =A0 =A0 =A0 73 =A0 =A0 - = =A0 =A0 - =A0 =A0 =A0 38 > =A0 - =A0 =A0 - =A0 =A0- > wifi =A0 1500 =A0 =A0 =A000:1b:21:ab:bf:4a =A0 =A0 =A0347 =A0 = =A0 0 =A0 =A0 0 =A0 =A0 =A0350 > =A0 0 =A0 =A0 0 =A0 =A00 > wifi =A0 1500 192.168.168.6 192.168.168.65 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 = - =A0 =A0 - =A0 =A0 =A0 =A00 > =A0 - =A0 =A0 - =A0 =A0- > wifi =A0 1500 fe80::225:x fe80::225:x:x =A0 =A0 =A0 =A00 =A0 =A0 - =A0 = =A0 - =A0 =A0 =A0349 =A0 =A0 - > =A0 - =A0 =A0- > wifi =A0 1500 2002:x:x 2002:x:x:2: =A0 =A0 =A0 =A00 =A0 =A0 - =A0 =A0 - = =A0 =A0 =A0 =A00 =A0 =A0 - =A0 =A0 - > =A0- > wifio =A01500 =A0 =A0 =A000:1b:21:ab:bf:4a =A0 =A059559 =A0 =A0 = 0 =A0 =A0 0 =A0 114639 > =A0 0 =A0 =A0 0 =A0 =A00 > wifio =A01500 192.168.168.8 192.168.168.81 =A0 =A0 =A0 =A0 =A0 0 =A0 =A0 = - =A0 =A0 - =A0 =A0 =A0160 > =A0 - =A0 =A0 - =A0 =A0- > wifio =A01500 fe80::225:x fe80::225:x:x =A0 =A0 =A0 =A00 =A0 =A0 - =A0 = =A0 - =A0 =A0 =A0 =A00 =A0 =A0 - > =A0 - =A0 =A0- > stf0 =A0 1280 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A05725 =A0 =A0 0 =A0 =A0 0 =A0 =A0 6125 > 420 =A0 =A0 0 =A0 =A00 > stf0 =A0 1280 2002:x:x 2002:x:x::1 =A0 =A0 1878 =A0 =A0 - =A0 =A0 - =A0 = =A0 1121 =A0 =A0 - =A0 =A0 - > =A0- > ng0* =A0 1500 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A00 =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A00 > =A0 0 =A0 =A0 0 =A0 =A00 > ng1* =A0 1500 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A00 =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A00 > =A0 0 =A0 =A0 0 =A0 =A00 > ng2 =A0 =A01492 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= 7143733 =A0 =A0 0 =A0 =A0 0 12234436 > =A0 0 =A0 =A0 0 =A0 =A00 > ng2 =A0 =A01492 213.141.x.x 213.141.x.x =A0 =A0 4735932 =A0 =A0 - =A0 =A0= - =A08480089 =A0 =A0 - > =A0 - =A0 =A0- > ng2 =A0 =A01492 fe80::x:x fe80::x:x:x =A0 =A0 =A0 =A00 =A0 =A0 - =A0 =A0 = - =A0 =A0 =A0 =A01 =A0 =A0 - =A0 =A0 - > =A0 =A0- > tun0 =A0 1455 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0350 =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0172 > =A0 0 =A0 =A0 0 =A0 =A00 > tun0 =A0 1455 fe80::225:x fe80::225:x:x =A0 =A0 =A0 =A00 =A0 =A0 - =A0 = =A0 - =A0 =A0 =A0 =A02 =A0 =A0 - > =A0 - =A0 =A0- > tun0 =A0 1455 192.168.169.1 192.168.169.1 =A0 =A0 =A0 =A0 =A0117 =A0 =A0 = - =A0 =A0 - =A0 =A0 =A0167 > =A0 - =A0 =A0 - =A0 =A0- > > Oct 26 23:39:11 ion kernel: em0: hw tdh =3D 975, hw tdt =3D 944 > Oct 26 23:39:11 ion kernel: em0: hw rdh =3D 960, hw rdt =3D 959 > Oct 26 23:39:11 ion kernel: em0: Tx Queue Status =3D 1 > Oct 26 23:39:11 ion kernel: em0: TX descriptors avail =3D 31 > Oct 26 23:39:11 ion kernel: em0: Tx Descriptors avail failure =3D 0 > Oct 26 23:39:11 ion kernel: em0: RX discarded packets =3D 0 > Oct 26 23:39:11 ion kernel: em0: RX Next to Check =3D 960 > Oct 26 23:39:11 ion kernel: em0: RX Next to Refresh =3D 959 > > net.inet.ip.intr_queue_maxlen: 4096 > net.inet.ip.intr_queue_drops: 0 > dev.em.0.%desc: Intel(R) PRO/1000 Network Connection 7.2.3 > dev.em.0.%driver: em > dev.em.0.%location: slot=3D0 function=3D0 > dev.em.0.%pnpinfo: vendor=3D0x8086 device=3D0x10d3 subvendor=3D0x8086 > subdevice=3D0xa01f class=3D0x020000 > dev.em.0.%parent: pci2 > dev.em.0.nvm: -1 > dev.em.0.debug: -1 > dev.em.0.rx_int_delay: 200 > dev.em.0.tx_int_delay: 200 > dev.em.0.rx_abs_int_delay: 4096 > dev.em.0.tx_abs_int_delay: 4096 > dev.em.0.rx_processing_limit: 100 > dev.em.0.flow_control: 3 > dev.em.0.eee_control: 0 > dev.em.0.link_irq: 648 > dev.em.0.mbuf_alloc_fail: 0 > dev.em.0.cluster_alloc_fail: 0 > dev.em.0.dropped: 0 > dev.em.0.tx_dma_fail: 0 > dev.em.0.rx_overruns: 0 > dev.em.0.watchdog_timeouts: 0 > dev.em.0.device_control: 1477444168 > dev.em.0.rx_control: 100827170 > dev.em.0.fc_high_water: 11264 > dev.em.0.fc_low_water: 9764 > dev.em.0.queue0.txd_head: 975 > dev.em.0.queue0.txd_tail: 944 > dev.em.0.queue0.tx_irq: 2762762 > dev.em.0.queue0.no_desc_avail: 0 > dev.em.0.queue0.rxd_head: 960 > dev.em.0.queue0.rxd_tail: 959 > dev.em.0.queue0.rx_irq: 3895860 > dev.em.0.mac_stats.excess_coll: 0 > dev.em.0.mac_stats.single_coll: 0 > dev.em.0.mac_stats.multiple_coll: 0 > dev.em.0.mac_stats.late_coll: 0 > dev.em.0.mac_stats.collision_count: 0 > dev.em.0.mac_stats.symbol_errors: 0 > dev.em.0.mac_stats.sequence_errors: 0 > dev.em.0.mac_stats.defer_count: 0 > dev.em.0.mac_stats.missed_packets: 647 > dev.em.0.mac_stats.recv_no_buff: 0 > dev.em.0.mac_stats.recv_undersize: 0 > dev.em.0.mac_stats.recv_fragmented: 0 > dev.em.0.mac_stats.recv_fragmented: 0 > dev.em.0.mac_stats.recv_oversize: 0 > dev.em.0.mac_stats.recv_jabber: 0 > dev.em.0.mac_stats.recv_errs: 0 > dev.em.0.mac_stats.crc_errs: 0 > dev.em.0.mac_stats.alignment_errs: 0 > dev.em.0.mac_stats.coll_ext_errs: 0 > dev.em.0.mac_stats.xon_recvd: 438789 > dev.em.0.mac_stats.xon_txd: 366 > dev.em.0.mac_stats.xoff_recvd: 438789 > dev.em.0.mac_stats.xoff_txd: 1013 > dev.em.0.mac_stats.total_pkts_recvd: 5465524 > dev.em.0.mac_stats.good_pkts_recvd: 4587299 > dev.em.0.mac_stats.bcast_pkts_recvd: 1102 > dev.em.0.mac_stats.mcast_pkts_recvd: 162 > dev.em.0.mac_stats.rx_frames_64: 325765 > dev.em.0.mac_stats.rx_frames_65_127: 1029229 > dev.em.0.mac_stats.rx_frames_128_255: 118432 > dev.em.0.mac_stats.rx_frames_256_511: 11360 > dev.em.0.mac_stats.rx_frames_512_1023: 100708 > dev.em.0.mac_stats.rx_frames_1024_1522: 3001805 > dev.em.0.mac_stats.good_octets_recvd: 4648591681 > dev.em.0.mac_stats.good_octets_txd: 2203060494 > dev.em.0.mac_stats.total_pkts_txd: 3780652 > dev.em.0.mac_stats.good_pkts_txd: 3779273 > dev.em.0.mac_stats.bcast_pkts_txd: 89 > dev.em.0.mac_stats.mcast_pkts_txd: 534 > dev.em.0.mac_stats.tx_frames_64: 1323163 > dev.em.0.mac_stats.tx_frames_65_127: 850801 > dev.em.0.mac_stats.tx_frames_128_255: 193136 > dev.em.0.mac_stats.tx_frames_256_511: 64088 > dev.em.0.mac_stats.tx_frames_512_1023: 47149 > dev.em.0.mac_stats.tx_frames_1024_1522: 1300936 > dev.em.0.mac_stats.tso_txd: 429804 > dev.em.0.mac_stats.tso_ctx_fail: 0 > dev.em.0.interrupts.asserts: 44 > dev.em.0.interrupts.rx_pkt_timer: 0 > dev.em.0.interrupts.rx_abs_timer: 0 > dev.em.0.interrupts.tx_pkt_timer: 0 > dev.em.0.interrupts.tx_abs_timer: 0 > dev.em.0.interrupts.tx_queue_empty: 0 > dev.em.0.interrupts.tx_queue_min_thresh: 0 > dev.em.0.interrupts.rx_desc_min_thresh: 0 > dev.em.0.interrupts.rx_overrun: 0 > > ifconfig em0 > em0: flags=3D8c43 metric = 0 mtu > 9000 > =A0 =A0 =A0 =A0description: LAN > > =A0options=3D219b > =A0 =A0 =A0 =A0ether 00:1b:21:ab:bf:4a > =A0 =A0 =A0 =A0inet 192.168.168.1 netmask 0xffffffc0 broadcast 192.168.16= 8.63 > =A0 =A0 =A0 =A0inet6 fe80::21b:21ff:feab:bf4a%em0 prefixlen 64 scopeid 0x= 4 > =A0 =A0 =A0 =A0inet6 2002:x:x:1::1 prefixlen 64 > =A0 =A0 =A0 =A0nd6 options=3D1 > =A0 =A0 =A0 =A0media: Ethernet autoselect (1000baseT ) > =A0 =A0 =A0 =A0status: active > > > >> >>> I've got almost the same problem with intel 82574L based nic. My platfo= rm >>> is nvidia ion running Atom 1.6 and nic is an external PCI-express adapt= er. >>> Unlike Jason's case mine is always stuck in receiving traffic, it's Ier= rs >>> increasing while Ipkts not. Thanks to Jason's script I can see those lo= cks >>> and interface flapping every several hours. My system is not a heavy lo= aded >>> server but just a home nas/router, usually routing at 100 mbps or less. >>> Nither disabling MSIX nor tuning txd rxd doesn't help me. >>> > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" >