From owner-freebsd-stable@FreeBSD.ORG Thu Apr 14 19:44:50 2011 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D3192106566B; Thu, 14 Apr 2011 19:44:50 +0000 (UTC) (envelope-from elon@emmi.physik-pool.tu-berlin.de) Received: from emmi.physik-pool.tu-berlin.de (emmi.physik-pool.tu-berlin.de [130.149.58.146]) by mx1.freebsd.org (Postfix) with ESMTP id 76D448FC08; Thu, 14 Apr 2011 19:44:50 +0000 (UTC) Received: from emmi.physik-pool.tu-berlin.de (localhost.physik-pool.tu-berlin.de [127.0.0.1]) by emmi.physik-pool.tu-berlin.de (8.14.4/8.14.4) with ESMTP id p3EJimkG008793; Thu, 14 Apr 2011 21:44:48 +0200 (CEST) (envelope-from elon@emmi.physik-pool.tu-berlin.de) Received: (from elon@localhost) by emmi.physik-pool.tu-berlin.de (8.14.4/8.14.4/Submit) id p3EJimSE008792; Thu, 14 Apr 2011 21:44:48 +0200 (CEST) (envelope-from elon) Date: Thu, 14 Apr 2011 21:44:48 +0200 From: Leon =?iso-8859-15?Q?Me=DFner?= To: "K. Macy" Message-ID: <20110414194448.GG9116@emmi.physik-pool.tu-berlin.de> Mail-Followup-To: "K. Macy" , Jack Vogel , Leon =?iso-8859-15?Q?Me=DFner?= , freebsd-stable@freebsd.org References: <20110414130540.GD9116@emmi.physik-pool.tu-berlin.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-15 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) Cc: Leon =?iso-8859-15?Q?Me=DFner?= , freebsd-stable@freebsd.org, Jack Vogel Subject: Re: ixgbe(4) and "Could not setup receive structures" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Apr 2011 19:44:51 -0000 On Thu, Apr 14, 2011 at 08:55:17PM +0200, K. Macy wrote: > That isn't guaranteed to work if he is KVA limited. > > On Thu, Apr 14, 2011 at 6:44 PM, Jack Vogel wrote: > > If you get this message its only for one reason, you don't have enough mbufs > > to > > fill your rings. You must do one of two things, either reduce the number of > > queues, > > or increase the relevant mbuf pool. > > > > Increase the 9K mbuf cluster pool. I did set it to twice the default, and now it works and netstat -m shows: 8192/391/8583/12800 9k jumbo clusters in use (current/cache/total/max) Whats a reasonable amount to set kern.ipc.nmbjumbo9 to and is there any form of auto-tuning (i have absolutely no load on this machine and mbufs are higher than default pool size). Thanks to all, Leon > > On Thu, Apr 14, 2011 at 6:05 AM, Leon Meßner > > wrote: > > > >> Hi, > >> > >> i tried setting the mtu on one of my ixgbe(4) intel NICs to support > >> jumbo frames. This is on a box with RELENG_8 from today. > >> > >> # ifconfig ix0 mtu 9198 > >> > >> I then get the following error: > >> > >> # tail -n 1 /var/log/messages > >> Apr 14 12:48:43 siloneu kernel: ix0: Could not setup receive structures > >> > >> I already tried the following patch because of Jack Vogel's advice given > >> in the following thread on -stable in Oct. last year, which still > >> produces the same error message and leaves the box unpingable: > >> > >> http://lists.freebsd.org/pipermail/freebsd-stable/2010-October/059541.html > >> > >> # cat ~/patches/ixgbe.num_queues_to_4.patch > >> --- /root/.vimbackup/ixgbe.c~   2011-04-12 22:14:27.000000000 +0000 > >> +++ sys/dev/ixgbe/ixgbe.c       2011-04-12 22:14:27.000000000 +0000 > >> @@ -273,7 +273,7 @@ TUNABLE_INT("hw.ixgbe.hdr_split", &ixgbe > >>  * number of cpus. Each queue is a pair > >>    * of RX and TX rings with a msix vector > >>      */ > >>      -static int ixgbe_num_queues = 0; > >>      +static int ixgbe_num_queues = 4; > >>       TUNABLE_INT("hw.ixgbe.num_queues", &ixgbe_num_queues); > >> > >>         /* > >> > >> _______________________________________________ > >> freebsd-stable@freebsd.org mailing list > >> http://lists.freebsd.org/mailman/listinfo/freebsd-stable > >> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > >> > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"