Date: Wed, 26 Oct 2011 17:47:52 +0400 From: Emil Muratov <gpm@hotplug.ru> To: Mike Tancsa <mike@sentex.net> Cc: freebsd-net@freebsd.org, Hooman Fazaeli <fazaeli@sepehrs.com>, Jack Vogel <jfvogel@gmail.com>, Jason Wolfe <nitroboost@gmail.com> Subject: Re: Intel 82574L interface wedging on em 7.1.9/7.2.3 when MSIX enabled Message-ID: <4EA80F88.4000400@hotplug.ru> In-Reply-To: <4EA80818.3030504@sentex.net> References: <CAAAm0r0RXEJo4UiKS=Ui0e5OQTg6sg-xcYf3mYB5%2Bvk8i8557w@mail.gmail.com> <4E8F157A.40702@sentex.net> <CAAAm0r2JH43Rct7UxQK2duH1p43Nepnj5mpb6bXo==DPayhJLg@mail.gmail.com> <4E8F51D4.1060509@sentex.net> <CACqU3MVwLaepFymZJkaVk6p=SpykGhqs=VYFjLh9fP9S=AxDhg@mail.gmail.com> <CAAAm0r1DKvoL9=Ket9up=4%2B5xiCzTTZJK99FhF9jcCA28B0M%2BA@mail.gmail.com> <CAAAm0r3XdsMHZh%2BP_NF-txZasdExzwZ8ymmGQgGhJQds0fOiBQ@mail.gmail.com> <CAAAm0r1iS3z-7CBJ=xYDf%2BJOA1Q2nU0O54Twbyb7FjvgWHjKVw@mail.gmail.com> <4EA7E203.3020306@sepehrs.com> <CAAAm0r3Nr2t8cCetPkFnLQ-3KwqHw_0SpqbtvYPRUkSP=9n8CA@mail.gmail.com> <4EA80818.3030504@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
>> Hooman, >> >> I have run with dev.em.X.flow_control=0, which should have the same result >> as hw.em.fc_setting=0, and net.inet.tcp.tso is also 0. I'm not sure the >> remaining options would be able to produce the scenario I'm seeing, but I'm >> open to giving it a try with no options on the interfaces. I've also added >> ifconfig output to the collection. >> >> options=219b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,WOL_MAGIC> >> ifconfig emX -rxcsum -txcsum -vlanhwtag -tso -wol >> options=88<VLAN_MTU,VLAN_HWCSUM> >> >> It's always TX, but these servers push ~12x what they receive, so I'm >> guessing it could happen to either buffer given the right traffic patterns. >> While looking through commits I also found a patch to add a couple sysctls >> for em, which I'm adding - http://freshbsd.org/commit/freebsd/r223676 > Can you provide some more details as to how traffic flows on these servers ? Are they going through them, or are they generating the traffic ? I wonder given a smaller CPU, it would be easier to trigger the condition somehow. We recently got a Soekris 6501 which has onboard 4 such em nics, but has just a 1Ghz Atom. > Hi All, I've got almost the same problem with intel 82574L based nic. My platform is nvidia ion running Atom 1.6 and nic is an external PCI-express adapter. Unlike Jason's case mine is always stuck in receiving traffic, it's Ierrs increasing while Ipkts not. Thanks to Jason's script I can see those locks and interface flapping every several hours. My system is not a heavy loaded server but just a home nas/router, usually routing at 100 mbps or less. Nither disabling MSIX nor tuning txd rxd doesn't help me.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4EA80F88.4000400>