Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 21 Nov 2014 20:34:03 +0000
From:      David DeSimone <ddesimone@verio.net>
To:        Jack Vogel <jfvogel@gmail.com>
Cc:        FreeBSD Net <freebsd-net@freebsd.org>
Subject:   RE: igb Could not setup receive structures (again)
Message-ID:  <4a92a47b86474b92b5b4fd7601df9cc2@BLUPR0801MB674.namprd08.prod.outlook.com>
In-Reply-To: <CAFOYbcnNMFneGN9GhHQDia4GYfhdYjoSMgGF_0_V7RbLMUyNWQ@mail.gmail.com>
References:  <20141121114852.8b7d9a6c071c3e0799d5f30c@aei.mpg.de> <CAFOYbcnNMFneGN9GhHQDia4GYfhdYjoSMgGF_0_V7RbLMUyNWQ@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Would it be possible for the driver to report how many clusters it calculat=
ed that it needs, whenever it runs into this memory shortage during attach?=
  That way an administrator might have some idea how much to increase their=
 tunables in order to meet the driver's requirements.

As it is, it's merely a guessing game or requires digging into driver sourc=
e to come up with the right numbers.


-----Original Message-----
From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd-net@freebsd.org] =
On Behalf Of Jack Vogel
Sent: Friday, November 21, 2014 10:23 AM
To: Gerrit K=FChn
Cc: FreeBSD Net
Subject: Re: igb Could not setup receive structures (again)

The message is pretty straightforward, its only cause is the inability
of the driver to get the necessary clusters to populate the RX rings.

After you get the error do a `netstat -m` and see what the state of the
9K jumbo pool is, for that is the size you would be using.

Depending on the specific device type you may have up to 8 rings
per interface, and with a ring size of 1K...

It does seem like you should have enough, but maybe something else
in your system is using the pool? As I said, look at netstat, it should giv=
e
you the truth, and then adjust the allocated size to fit your needs.

Jack


On Fri, Nov 21, 2014 at 2:48 AM, Gerrit K=FChn <gerrit.kuehn@aei.mpg.de>
wrote:

> Hi all,
>
> I get the error message above when trying to go for jumbo frames (mtu
> 9000) on a system here. I found a lot of comments on this, but they all
> state that this is due to a too low setting for mbufs in FreeBSD8/9
> settings.
> However, I have 10-stable here, and the settings look rather high to me:
>
> kern.ipc.nmbclusters: 1014856
> kern.ipc.maxmbufmem: 8313700352
> kern.ipc.nmbufs: 6495090
> kern.ipc.nmbjumbop: 507428
> kern.ipc.nmbjumbo9: 451047
> kern.ipc.nmbjumbo16: 338284
>
> FreeBSD mclane 10.0-STABLE FreeBSD 10.0-STABLE #5 r261710: Mon Feb 10
> 16:55:29 CET 2014 root@mclane.rt.aei.uni-hannover.de:/usr/obj/usr/src/sys=
/GENERIC
> amd64
>
>
> Is this still too low? I have a 6core machine with 6 igb interfaces, and =
I
> cannot even get one of these set to mtu 9000 without getting "Could not
> setup receive structures".
>
>
> cu
>   Gerrit
> _______________________________________________
> freebsd-net@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-net
> To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
>
_______________________________________________
freebsd-net@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-net
To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"
This email message is intended for the use of the person to whom it has bee=
n sent, and may contain information that is confidential or legally protect=
ed. If you are not the intended recipient or have received this message in =
error, you are not authorized to copy, distribute, or otherwise use this me=
ssage or its attachments. Please notify the sender immediately by return e-=
mail and permanently delete this message and any attachments. Verio Inc. ma=
kes no warranty that this email is error or virus free. Thank you.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4a92a47b86474b92b5b4fd7601df9cc2>