Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 07 Jul 2016 19:17:07 +0000
From:      bugzilla-noreply@freebsd.org
To:        freebsd-bugs@FreeBSD.org
Subject:   [Bug 210901] em0 stores packets somewhere and lets them out slowly under load.
Message-ID:  <bug-210901-8@https.bugs.freebsd.org/bugzilla/>

next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210901

            Bug ID: 210901
           Summary: em0 stores packets somewhere and lets them out slowly
                    under load.
           Product: Base System
           Version: 10.3-RELEASE
          Hardware: amd64
                OS: Any
            Status: New
          Severity: Affects Only Me
          Priority: ---
         Component: kern
          Assignee: freebsd-bugs@FreeBSD.org
          Reporter: dgilbert@eicat.ca
                CC: freebsd-amd64@FreeBSD.org
                CC: freebsd-amd64@FreeBSD.org

I fully realize that this is going to be a bear to track down.  The machine=
 in
question is my home server ... so it runs a bit of everything.  The trigger=
 for
the behavior seems to be more than 1000 torrents running.  Stats on that la=
ter.

The kicker is: replace em0 (pcie) with rl0 (motherboard) and it goes away.

I have the em0 in the machine because I believe it's a better card.  Sigh.

SO WHAT HAPPENS?

When em0 is misbehaving, the "mild" symptoms are local LAN lag from 500ms to
5000 ms.  (this is why I jokingly accuse em0 of storing the packets.)  Beyo=
nd
about 5000ms, it seems the packets are dropped.  This can be observed by
pinging out from the console of the box or pinging from another box to it.

I often first notice the box is having trouble when the UPS monitor looses
network connectivity with the UPS.

Salient details I can think of?  The answer to "netstat -an | grep tcp4 | g=
rep
-v LISTEN | wc" is 320.  1000 torrents configured doesn't mean that that ma=
ny
streams happen.  It is possible that the behavior is related to the number =
of
torrent streams in progress... or the number of TCP streams with small tran=
smit
queues.  In among that is some mildly fast SMB service for various media
devices around the house.

The em0 behavior is 100% related to the large number of torrents (running u=
sing
rtorrent).  Stopping rtorrent makes the host good again, starting rtorrent
hoses it.

So the machine is:

FreeBSD virtual.xxx.xxx 10.3-RELEASE-p5 FreeBSD 10.3-RELEASE-p5 #4 r301872:=
 Mon
Jun 13 14:35:24 EDT 2016     root@virtual.xxx.xxx:/usr/obj/usr/src/sys/GENE=
RIC=20
amd64

CPU: AMD FX(tm)-9590 Eight-Core Processor            (4716.02-MHz K8-class =
CPU)
  Origin=3D"AuthenticAMD"  Id=3D0x600f20  Family=3D0x15  Model=3D0x2  Stepp=
ing=3D0
=20
Features=3D0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,=
MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
=20
Features2=3D0x3e98320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,POPC=
NT,AESNI,XSAVE,OSXSAVE,AVX,F16C>
  AMD Features=3D0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
  AMD
Features2=3D0x1ebbfff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,=
IBS,XOP,SKINIT,WDT,LWP,FMA4,TCE,NodeId,TBM,Topology,PCXC,PNXC>
  Structured Extended Features=3D0x8<BMI1>
  SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=3D65536
  TSC: P-state invariant, performance statistics
real memory  =3D 34359738368 (32768 MB)
avail memory =3D 33186353152 (31648 MB)

The ethernet cards are:

em0: <Intel(R) PRO/1000 Network Connection 7.6.1-k> port 0x8000-0x801f mem
0xfe340000-0xfe35ffff,0xfe320000-0xfe33ffff irq 20 at device 0.0 on pci9
em0: Using an MSI interrupt
em0: Ethernet address: 00:15:17:0d:04:a8

em0@pci0:9:0:0: class=3D0x020000 card=3D0x10838086 chip=3D0x10b98086 rev=3D=
0x06
hdr=3D0x00
    vendor     =3D 'Intel Corporation'
    device     =3D '82572EI Gigabit Ethernet Controller (Copper)'

re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port
0x7000-0x70ff mem 0xd2104000-0xd2104fff,0xd2100000-0xd2103fff irq 21 at dev=
ice
0.0 on pci10
re0: Using 1 MSI-X message
re0: Chip rev. 0x48000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX,
100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master,
1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: 10:c3:7b:9d:8b:6d

re0@pci0:10:0:0:        class=3D0x020000 card=3D0x85051043 chip=3D0x816810e=
c rev=3D0x09
hdr=3D0x00
    vendor     =3D 'Realtek Semiconductor Co., Ltd.'
    device     =3D 'RTL8111/8168B PCI Express Gigabit Ethernet controller'

--=20
You are receiving this mail because:
You are the assignee for the bug.=



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-210901-8>