Date: Thu, 14 Oct 2010 21:58:50 -0400 (EDT) From: Terry Kennedy <TERRY@tmk.com> To: Jack Vogel <jfvogel@gmail.com> Cc: freebsd-stable@freebsd.org Subject: Re: Bogus "igb1: Could not setup receive structures" in 8-STABLE Message-ID: <01NT25TZHDDY008CFX@tmk.com> In-Reply-To: "Your message dated Thu, 14 Oct 2010 16:36:02 -0700" <AANLkTimAiQH9Esu=YUkf%2BAF9JX5ZTYhPn-Q1C7kbwxSY@mail.gmail.com> References: <01NT1YE1I98Q008KN2@tmk.com>
next in thread | previous in thread | raw e-mail | index | archive | help
> The problem is mbuf resources, the driver is autoconfiguring the number of
> queues based on the number of cores, on newer systems with lots of them
> this is outstripping the mbuf resource pool.
That would make sense, as these systems have 16 cores (dual E5520's).
> I have decided to hard limit the queues to 8, you can fix the number
> manually
> by searching for num_queues in if_igb.c and setting it to something other
> than
> 0 for now.
I changed it to 8, and saw the same problem. I noted that the igb boot
messages changed from:
Oct 14 18:28:02 rz1m kernel: igb0: Using MSIX interrupts with 10 vectors
Oct 14 18:28:02 rz1m kernel: igb1: Using MSIX interrupts with 10 vectors
to:
Oct 14 21:53:44 rz1m kernel: igb0: Using MSIX interrupts with 9 vectors
Oct 14 21:53:44 rz1m kernel: igb1: Using MSIX interrupts with 9 vectors
So I dropped the value to 3 (on the assumption that the system uses one
more than the specified value per interface), and got:
igb0: Using MSIX interrupts with 4 vectors
igb1: Using MSIX interrupts with 4 vectors
and both igb interfaces came up. I didn't try to find the maximum
number of queues that would work.
> I am at work on a number of issues with igb and em right now which is why
> there has not been an MFC yet.
Understood. Thanks for the quick response and workaround.
Terry Kennedy http://www.tmk.com
terry@tmk.com New York, NY USA
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?01NT25TZHDDY008CFX>