From owner-freebsd-questions@FreeBSD.ORG Wed Nov 2 23:51:51 2011 Return-Path: Delivered-To: FreeBSD-Questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9578F1065672 for ; Wed, 2 Nov 2011 23:51:51 +0000 (UTC) (envelope-from vince@unsane.co.uk) Received: from unsane.co.uk (unsane-pt.tunnel.tserv5.lon1.ipv6.he.net [IPv6:2001:470:1f08:110::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2BF918FC17 for ; Wed, 2 Nov 2011 23:51:47 +0000 (UTC) Received: from vhoffman-macbooklocal.local ([10.10.10.20]) (authenticated bits=0) by unsane.co.uk (8.14.4/8.14.4) with ESMTP id pA2Npkc1026309 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Wed, 2 Nov 2011 23:51:47 GMT (envelope-from vince@unsane.co.uk) Message-ID: <4EB1D792.8070103@unsane.co.uk> Date: Wed, 02 Nov 2011 23:51:46 +0000 From: Vincent Hoffman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:7.0.1) Gecko/20110929 Thunderbird/7.0.1 MIME-Version: 1.0 To: FreeBSD-Questions@freebsd.org X-Enigmail-Version: 1.3.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: nfs client speed lower than expected. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2011 23:51:51 -0000 Hi all, What kind of speed should I be expecting over an NFS mount from a linux box using a gig interface (igb)? I'm seeing linux clients getting approx 2 or 3 times the throughput rsyncing files from a linux nfs server that i get from a 8-stable FreeBSD client. representative results 7.26MB/s - Freebsd client 21.10MB/s liunx client I've tried a variety of files to try and take caching out of the equation, I've tweaked a few sysctls after much googling kern.ipc.maxsockbuf=4000000 net.inet.tcp.sendbuf_max=16777216 net.inet.tcp.recvbuf_max=16777216 net.inet.tcp.sendbuf_inc=16384 net.inet.tcp.recvbuf_inc=524288 net.inet.udp.recvspace=65535 net.local.stream.recvspace=65535 net.local.stream.sendspace=65535 with no obvious improvement. freebsd mount options ro,noatime,noexec,nosuid,udp,nfsv3,rsize=1024,wsize=1024,bg,hard,intr,timeout=4,retrans=4 linux mount options _netdev,ro,noatime,nodev,noexec,nosuid,proto=udp,vers=3,rsize=1k,wsize=1k,bg,hard,intr,timeo=4,retrans=4 I have seen that using the linux server as an nfs client to write to the NFS server on the freebsd box gives similar performance to a linux client pulling from the linux server so I'm guessing its something to do with the freebsd nfs client? Any suggestions/clues welcome. Thanks, Vince