Date: Fri, 29 Aug 2014 15:32:33 -0700 From: John-Mark Gurney <jmg@funkthat.com> To: "Eggert, Lars" <lars@netapp.com> Cc: FreeBSD Net <freebsd-net@freebsd.org> Subject: Re: igb "requests for mbufs denied" Message-ID: <20140829223233.GL71691@funkthat.com> In-Reply-To: <B170AAF8-E59B-4758-BF68-A0B18430B0AD@netapp.com> References: <B170AAF8-E59B-4758-BF68-A0B18430B0AD@netapp.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Eggert, Lars wrote this message on Thu, Aug 28, 2014 at 08:31 +0000:
> no matter what value I bump kern.ipc.nmbclusters and kern.ipc.nmbufs to, I still get "requests for mbufs denied" with igb interfaces, and the occasional connection stall, even when dialing down hw.igb.num_queues=1:
Can you post the exact error message? Is this from dmesg? or?
> [root@laurel: ~] netstat -m
> 3070/1355/4425 mbufs in use (current/cache/total)
> 3069/773/3842/8144896 mbuf clusters in use (current/cache/total/max)
> 3069/772 mbuf+clusters out of packet secondary zone in use (current/cache)
> 0/6/6/1018097 4k (page size) jumbo clusters in use (current/cache/total/max)
> 0/0/0/301658 9k jumbo clusters in use (current/cache/total/max)
> 0/0/0/169682 16k jumbo clusters in use (current/cache/total/max)
> 6905K/1908K/8814K bytes allocated to network (current/cache/total)
> 73/3831/3091 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
> 0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
> 6/0/0 requests for jumbo clusters denied (4k/9k/16k)
> 0 requests for sfbufs denied
> 0 requests for sfbufs delayed
> 0 requests for I/O initiated by sendfile
The weird thing to me is that your number of in use and other related
counts are close to my machine which only has two Intel gige (em)
interfaces... The only difference is that I have no denied mbufs or
clusters...
> The box in question has six igb interfaces, 2x 'I210 Gigabit Network Connection' and 4x '82580 Gigabit Network Connection' and is running:
>
> FreeBSD laurel.muccbc.hq.netapp.com 10.0-RELEASE-p7 FreeBSD 10.0-RELEASE-p7 #0: Tue Jul 8 06:37:44 UTC 2014 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
>
> Anyone have any ideas what else to try?
Also, what does sysctl dev.em and sysctl dev.igb show?
--
John-Mark Gurney Voice: +1 415 225 5579
"All that I will do, has been done, All that I have, has not."
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20140829223233.GL71691>