Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 06 Nov 2009 10:40:20 +0200
From:      Ian FREISLICH <ianf@clue.co.za>
To:        Weldon S Godfrey 3 <weldon@excelsusphoto.com>
Cc:        freebsd-current@FreeBSD.org, Gavin Atkinson <gavin@FreeBSD.org>
Subject:   Re: FreeBSD 8.0 - network stack crashes? 
Message-ID:  <E1N6KMm-000AGE-QC@clue.co.za>
In-Reply-To: <alpine.BSF.2.00.0911031234210.80499@emmett.excelsus.com> 
References:  <alpine.BSF.2.00.0911031234210.80499@emmett.excelsus.com> <alpine.BSF.2.00.0911020747560.80499@emmett.excelsus.com> <1257185816.44755.29.camel@buffy.york.ac.uk> <alpine.BSF.2.00.0911030819410.36102@emmett.excelsus.com> <1257261214.98619.92.camel@buffy.york.ac.uk> <alpine.BSF.2.00.0911031033120.80499@emmett.excelsus.com> 

next in thread | previous in thread | raw e-mail | index | archive | help
Weldon S Godfrey 3 wrote:
> >> OK, at least we've figured out what is going wrong then.  As a
> >> workaround to get the machine to stay up longer, you should be able to
> >> set kern.ipc.nmbclusters=256000 in /boot/loader.conf -but hopefully we
> >> can resolve this soon.
> >>
> 
> I upped it to 256K.  What I am trying to wrap my head around is how it was 
> working somewhat for so long at 24K, but it got to near 65K before I 
> rebooted it with the higher setting.   Or did I reboot too early?  Is 
> there any cleanup that isn't triggered intil it reaches max nmbclusters? 
> I am trying to see if anything on our network has changed to cause this to 
> become cronic.

We have a ngaios server which handles up to 5000 concurrent nsca
daemons and connections which manifested a similar problem on a
Dell R905 (4x4core AMD, 16GB RAM, bce).

Setting the following in /boot/loader.conf sorted out the problem
for us:

kern.ipc.nmbclusters="131072"
kern.maxusers="1024"

mbuf usage is pretty static at:

$ netstat -m
40165/16220/56385 mbufs in use (current/cache/total)
40154/10500/50654/131072 mbuf clusters in use (current/cache/total/max)
40154/3359 mbuf+clusters out of packet secondary zone in use (current/cache)
0/1493/1493/65536 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/32768 9k jumbo clusters in use (current/cache/total/max)
0/0/0/16384 16k jumbo clusters in use (current/cache/total/max)
90349K/31027K/121376K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
0/0/0 sfbufs in use (current/peak/max)
0 requests for sfbufs denied
0 requests for sfbufs delayed
246 requests for I/O initiated by sendfile
0 calls to protocol drain routines

Ian

--
Ian Freislich



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?E1N6KMm-000AGE-QC>