Date: Wed, 09 Jul 2014 16:54:00 +0200 From: Hans Petter Selasky <hps@selasky.org> To: Bob Healey <healer@rpi.edu>, FreeBSD Stable Mailing List <freebsd-stable@freebsd.org> Subject: Re: Interactions with mxge, pf, nfsd, and the kernel Message-ID: <53BD5788.40308@selasky.org> In-Reply-To: <53BD5607.9080406@rpi.edu> References: <2035928323.8860293.1404849282793.JavaMail.root@uoguelph.ca> <53BD5607.9080406@rpi.edu>
next in thread | previous in thread | raw e-mail | index | archive | help
On 07/09/14 16:47, Bob Healey wrote: > These machines primary purpose is to provide nfs services to an HPC > cluster (12 hosts, 384 cores) on a gigabit interconnection. mxge0 is a > 10G link to an HP Procurve 2910al with the hpc nodes connected to it, > existing in RFC 1918 space. bce1 is connected to the public network. > bce0 is only used for accessing the IPMI chipset. 9K packets are > enabled in what appears to be a futile attempt to improve nfs and mpi > performance within the cluster. I can revert back to 1500 byte packets, > and just chalk this up to being things mere mortals are not to meddle with. > > Bob Healey > Systems Administrator > Biocomputation and Bioinformatics Constellation > and Molecularium > healer@rpi.edu > (518) 276-4407 > Hi, Have you tried 4K packets instead of 9K ones? I understand the mbufs are special and must be contiguous in physical memory, so memory allocation fragmentation can lead up to starvation of mbufs. --HPS
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53BD5788.40308>