Date: Wed, 20 May 2009 15:07:23 +0900 From: Pyun YongHyeon <pyunyh@gmail.com> To: Pascal Braun <pascal.braun@continum.net> Cc: freebsd-current@freebsd.org Subject: Re: Problems with jumbo frames on nfe Message-ID: <20090520060723.GH9043@michelle.cdnetworks.co.kr> In-Reply-To: <4A12B0B8.5020507@continum.net> References: <4A127C56.6040502@continum.net> <20090519104133.GF4697@michelle.cdnetworks.co.kr> <4A12B0B8.5020507@continum.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--24zk1gE8NUlDmwG9 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Tue, May 19, 2009 at 03:14:32PM +0200, Pascal Braun wrote: > Pyun YongHyeon wrote: > >On Tue, May 19, 2009 at 11:31:02AM +0200, Pascal Braun wrote: > >>Hi, > >> > >>I'm currently testing jumbo frames on a Sunfire 4540 running with > >>FreeBSD 8-Current (build on April 8th). While using the nfe driver I'm > >>having some unexpected problems if i try to bring up the interface with > >>MTU sizes greater than 1970 bytes. > >> > >>The error message (in dmesg) is: > >>nfe2: initialization failed: no memory for rx buffers > >> > > > >It means you've run out of jumbo clusters. Check the output of > >"netstat -m" and see how many jumbo cluster requests were denied. > > 771/1149/1920 mbufs in use (current/cache/total) > 770/680/1450/25600 mbuf clusters in use (current/cache/total/max) > 770/510 mbuf+clusters out of packet secondary zone in use (current/cache) > 0/9/9/12800 4k (page size) jumbo clusters in use (current/cache/total/max) > 0/0/0/16384 9k jumbo clusters in use (current/cache/total/max) > 0/0/0/3200 16k jumbo clusters in use (current/cache/total/max) > 1732K/1683K/3416K bytes allocated to network (current/cache/total) > 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) > 0/0/0 requests for jumbo clusters denied (4k/9k/16k) > 0/0/0 sfbufs in use (current/peak/max) > 0 requests for sfbufs denied > 0 requests for sfbufs delayed > 0 requests for I/O initiated by sendfile > 0 calls to protocol drain routines > > There are no denied requests. MTU size was about 1800. > But I have to add, that i cant even get the interface up if the mtu size > is above 1970. > > >>Does anyone have any ideas how to get jumbo frames working? > >> > > > >How about increasing 9K jumbo clusters(kern.ipc.nmbjumbo9) with > >sysctl(8)? > > sunfire# sysctl -a | grep jumbo > kern.ipc.nmbjumbo16: 3200 > kern.ipc.nmbjumbo9: 16384 > kern.ipc.nmbjumbop: 12800 > > I increased kern.ipc.nmbjumbo9 to 16384 (was 6400) but that didn't seem > to help. Do you have another idea? > Ok, would you try attached patch? --24zk1gE8NUlDmwG9 Content-Type: text/x-diff; charset=us-ascii Content-Disposition: attachment; filename="nfe.jumbo.patch" Index: sys/dev/nfe/if_nfe.c =================================================================== --- sys/dev/nfe/if_nfe.c (revision 192411) +++ sys/dev/nfe/if_nfe.c (working copy) @@ -1153,7 +1153,7 @@ /* Create DMA tag for jumbo Rx buffers. */ error = bus_dma_tag_create(sc->nfe_parent_tag, - PAGE_SIZE, 0, /* alignment, boundary */ + 1, 0, /* alignment, boundary */ BUS_SPACE_MAXADDR, /* lowaddr */ BUS_SPACE_MAXADDR, /* highaddr */ NULL, NULL, /* filter, filterarg */ --24zk1gE8NUlDmwG9--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20090520060723.GH9043>