From owner-freebsd-bugs@freebsd.org Thu Jul 7 19:17:07 2016 Return-Path: Delivered-To: freebsd-bugs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 378FBB8234A for ; Thu, 7 Jul 2016 19:17:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C59B1979 for ; Thu, 7 Jul 2016 19:17:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u67JH6Zl088994 for ; Thu, 7 Jul 2016 19:17:06 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 210901] em0 stores packets somewhere and lets them out slowly under load. Date: Thu, 07 Jul 2016 19:17:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dgilbert@eicat.ca X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Jul 2016 19:17:07 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210901 Bug ID: 210901 Summary: em0 stores packets somewhere and lets them out slowly under load. Product: Base System Version: 10.3-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: dgilbert@eicat.ca CC: freebsd-amd64@FreeBSD.org CC: freebsd-amd64@FreeBSD.org I fully realize that this is going to be a bear to track down. The machine= in question is my home server ... so it runs a bit of everything. The trigger= for the behavior seems to be more than 1000 torrents running. Stats on that la= ter. The kicker is: replace em0 (pcie) with rl0 (motherboard) and it goes away. I have the em0 in the machine because I believe it's a better card. Sigh. SO WHAT HAPPENS? When em0 is misbehaving, the "mild" symptoms are local LAN lag from 500ms to 5000 ms. (this is why I jokingly accuse em0 of storing the packets.) Beyo= nd about 5000ms, it seems the packets are dropped. This can be observed by pinging out from the console of the box or pinging from another box to it. I often first notice the box is having trouble when the UPS monitor looses network connectivity with the UPS. Salient details I can think of? The answer to "netstat -an | grep tcp4 | g= rep -v LISTEN | wc" is 320. 1000 torrents configured doesn't mean that that ma= ny streams happen. It is possible that the behavior is related to the number = of torrent streams in progress... or the number of TCP streams with small tran= smit queues. In among that is some mildly fast SMB service for various media devices around the house. The em0 behavior is 100% related to the large number of torrents (running u= sing rtorrent). Stopping rtorrent makes the host good again, starting rtorrent hoses it. So the machine is: FreeBSD virtual.xxx.xxx 10.3-RELEASE-p5 FreeBSD 10.3-RELEASE-p5 #4 r301872:= Mon Jun 13 14:35:24 EDT 2016 root@virtual.xxx.xxx:/usr/obj/usr/src/sys/GENE= RIC=20 amd64 CPU: AMD FX(tm)-9590 Eight-Core Processor (4716.02-MHz K8-class = CPU) Origin=3D"AuthenticAMD" Id=3D0x600f20 Family=3D0x15 Model=3D0x2 Stepp= ing=3D0 =20 Features=3D0x178bfbff =20 Features2=3D0x3e98320b AMD Features=3D0x2e500800 AMD Features2=3D0x1ebbfff Structured Extended Features=3D0x8 SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=3D65536 TSC: P-state invariant, performance statistics real memory =3D 34359738368 (32768 MB) avail memory =3D 33186353152 (31648 MB) The ethernet cards are: em0: port 0x8000-0x801f mem 0xfe340000-0xfe35ffff,0xfe320000-0xfe33ffff irq 20 at device 0.0 on pci9 em0: Using an MSI interrupt em0: Ethernet address: 00:15:17:0d:04:a8 em0@pci0:9:0:0: class=3D0x020000 card=3D0x10838086 chip=3D0x10b98086 rev=3D= 0x06 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '82572EI Gigabit Ethernet Controller (Copper)' re0: port 0x7000-0x70ff mem 0xd2104000-0xd2104fff,0xd2100000-0xd2103fff irq 21 at dev= ice 0.0 on pci10 re0: Using 1 MSI-X message re0: Chip rev. 0x48000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Using defaults for TSO: 65518/35/2048 re0: Ethernet address: 10:c3:7b:9d:8b:6d re0@pci0:10:0:0: class=3D0x020000 card=3D0x85051043 chip=3D0x816810e= c rev=3D0x09 hdr=3D0x00 vendor =3D 'Realtek Semiconductor Co., Ltd.' device =3D 'RTL8111/8168B PCI Express Gigabit Ethernet controller' --=20 You are receiving this mail because: You are the assignee for the bug.=