Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 20 Jun 2013 10:34:46 +0000
From:      "Eggert, Lars" <lars@netapp.com>
To:        "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>
Cc:        Jack Vogel <jfvogel@gmail.com>
Subject:   hw.igb.num_queues default
Message-ID:  <843F7891-FD87-4F16-A279-B45D4A674F4E@netapp.com>

next in thread | raw e-mail | index | archive | help
Hi,

I just popped a new four-port igb card into a -STABLE system and encountere=
d severe issues even when unloaded right after boot, to the point where I c=
ouldn't even ssh into the system anymore. The box has 2x4 cores:

CPU: Intel(R) Xeon(R) CPU           X5450  @ 3.00GHz (2992.60-MHz K8-class =
CPU)
  Origin =3D "GenuineIntel"  Id =3D 0x10676  Family =3D 0x6  Model =3D 0x17=
  Stepping =3D 6
  Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PG=
E,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=3D0xce3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PD=
CM,DCA,SSE4.1>
  AMD Features=3D0x20100800<SYSCALL,NX,LM>
  AMD Features2=3D0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  =3D 8589934592 (8192 MB)
avail memory =3D 8239513600 (7857 MB)
MPTable: <DELL     PE 01B2     >
Event timer "LAPIC" quality 400
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 2 package(s) x 4 core(s)

By default, the igb driver seems to set up one queue per detected CPU. Goog=
ling around, people seemed to suggest that limiting the number of queues ma=
kes things work better. I can confirm that setting hw.igb.num_queues=3D2 se=
ems to have fixed the issue. (Two was the first value I tried, maybe other =
values other than 0 would work, too.)

In order to uphold POLA, should the igb driver maybe default to a conservat=
ive value for hw.igb.num_queues that may not deliver optimal performance, b=
ut at least works out of the box?

Lars=



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?843F7891-FD87-4F16-A279-B45D4A674F4E>