From owner-freebsd-stable@FreeBSD.ORG Mon Oct 6 13:34:49 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2FE611065686 for ; Mon, 6 Oct 2008 13:34:49 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from QMTA04.westchester.pa.mail.comcast.net (qmta04.westchester.pa.mail.comcast.net [76.96.62.40]) by mx1.freebsd.org (Postfix) with ESMTP id CE0AC8FC1E for ; Mon, 6 Oct 2008 13:34:48 +0000 (UTC) (envelope-from jdc@koitsu.dyndns.org) Received: from OMTA08.westchester.pa.mail.comcast.net ([76.96.62.12]) by QMTA04.westchester.pa.mail.comcast.net with comcast id PPLT1a0060Fqzac54Ranan; Mon, 06 Oct 2008 13:34:47 +0000 Received: from koitsu.dyndns.org ([69.181.141.110]) by OMTA08.westchester.pa.mail.comcast.net with comcast id PRal1a00M2P6wsM3URamYz; Mon, 06 Oct 2008 13:34:47 +0000 X-Authority-Analysis: v=1.0 c=1 a=QycZ5dHgAAAA:8 a=xCLAfTVf16_AdBrQtj4A:9 a=0yB97UTvYxqXqW_0KZYA:7 a=cFwum2nXXA9v4BoTy_MfON0pPfgA:4 a=EoioJ0NPDVgA:10 a=LY0hPdMaydYA:10 Received: by icarus.home.lan (Postfix, from userid 1000) id 83018C9419; Mon, 6 Oct 2008 06:34:45 -0700 (PDT) Date: Mon, 6 Oct 2008 06:34:45 -0700 From: Jeremy Chadwick To: Adam McDougall Message-ID: <20081006133445.GA21479@icarus.home.lan> References: <48E62ABA.6070901@kkip.pl> <20081005075956.GX36572@elvis.mu.org> <48E9B809.5080309@kkip.pl> <48EA06B5.5060604@egr.msu.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <48EA06B5.5060604@egr.msu.edu> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-stable@freebsd.org, Bartosz Stec Subject: Re: fxp performance with POLLING X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Oct 2008 13:34:49 -0000 On Mon, Oct 06, 2008 at 08:38:13AM -0400, Adam McDougall wrote: > Bartosz Stec wrote: > >>>> BTW overall SAMBA performance still sucks on 7.1-pre as much as on >>>> RELENG_5 ...:( - 7.5 MB/s peak. >>>> >>> >>> 7.5MB is 75% effeciency of a 100mbit card. Not amazing, but >>> not "sucks". >>> >>> Where do you see faster performance? >>> >>> Between windows machines on the same hardware or linux server? >>> >>> >> It sucks because it is a peak performance. About 5-6 MB/s average. I >> tried polling only because I found some suggestions on mailing lists, >> that it could improve performance with SAMBA on FreeBSD. As you see at >> the top of this thread - not in my case :) I also tried sysctl tunings, >> and smb.conf settings, also suggested on maling lists, with no or very >> little improvements noticed. Most of suggestions unfortunately end with >> "change OS to Linux if you want to use SAMBA". I think I will try to >> change NIC to 1Gbit - hope that helps :) Or maybe there's some "FreeBSD >> and SAMBA tuning guide" which I didn't found? >> > > Please try experimenting with "socket options" in smb.conf, I've found > that some tuning is desirable on any OS with Samba, but these are the > values that worked best for me with Windows XP clients in mind. Win2003 > clients seemed much faster without tuning (same base code as XP 64bit) > and I suspect it has a different SMB implementation. I'd suggest > starting with "socket options = TCP_NODELAY IPTOS_THROUGHPUT > SO_RCVBUF=8192 SO_SNDBUF=8192" and if you aren't satisfied, experiment > with the numbers and which options are enabled. Be sure that the > client has been disconnected from Samba completely to make sure you are > testing the values in the config file. I'm pretty sure with these > tunings I was able to get closer to 10MB/sec on 100Mbit, which satisfies > me for the average user. Interesting. I use gigE on my home network, and most of my Samba shares consist of very large files (ISO images and HD videos). Setting the buffer sizes to 8KB results in horrible performance; a 420MB ISO image taking ~50 seconds to copy. Copying is from the Samba server to the Windows machine. ZFS is used on FreeBSD, across 4 disks in a raidz1 pool; all disks are SATA300 with 16MByte cache. Increasing the Samba buffers to 64KB (65536) drops the transfer to 30 seconds, and increasing it to 128KB (131072) drops to 15-20 seconds. NICs involved are an Attansic L1E (on Windows XP, with TCP buffer sizes tuned in the registry, ditto with enabling TCP window resizing), and an em(4) (on FreeBSD). There are two switches between the boxes: an HP ProCurve, and a generic D-Link switch. Everything is gigE. Additionally, don't forget about IPTOS_LOWDELAY, and the "write cache size" and "read size" options in smb.conf. -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |