Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 08 Mar 2005 20:22:25 -0600
From:      Eric Anderson <anderson@centtech.com>
To:        Peter Hessler <phessler@coverity.com>
Cc:        freebsd-performance@freebsd.org
Subject:   Re: NFS small files
Message-ID:  <422E5DE1.9040901@centtech.com>
In-Reply-To: <20050309015119.44566908B7@coverity.dreamhost.com>
References:  <20050309005628.5C6D1908B8@coverity.dreamhost.com> <422E541C.8040108@telus.net> <20050309014632.49895908B7@coverity.dreamhost.com> <20050309015119.44566908B7@coverity.dreamhost.com>

next in thread | previous in thread | raw e-mail | index | archive | help
Peter Hessler wrote:
> I should mention that copying the same directory on the nfs server takes
> 15s, rather than the 54s over nfs.


Are you using TCP or UDP NFS connection, version 2 or 3?



> On Tue, 8 Mar 2005 17:46:31 -0800
> Peter Hessler <phessler@coverity.com> wrote:
> 
> : These files are sitting right next to each other on disk, I created
> them
> : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i
> : bs=128 count=128; done""".  Then I timed the copy of that directory.
> : 
> : Does seek really cause an 11x performance penalty?
> : 
> : On Tue, 08 Mar 2005 17:40:44 -0800
> : Peter Kieser <pfak@telus.net> wrote:
> : 
> : : Copying single files are always going to take longer, because the
> : drive 
> : : has to seek more thus latency is introduced.
> : : 
> : : --Peter
> : : 
> : : Peter Hessler wrote:
> : : 
> : : >I'm setting up an NFS server to be used for compiling, and it seems
> : that
> : : >while speeds are acceptable for large files, small files take much
> : : >longer than expected.
> : : >
> : : >Copying 10000 16K files (in a directory) takes 54seconds, while
> : copying
> : : >a 170M single file takes 5s.
> : : >
> : : >Are there any tricks for speeding up small file performance?  I'm
> : : >willing to give up large file performance.
> : : >
> : : >/etc/sysctl.conf:
> : : > vfs.vmiodirenable=1
> : : > kern.ipc.somaxconn=2048
> : : > kern.maxfiles=65536
> : : > net.isr.enable=1
> : : >
> : : >/boot/loader.conf:
> : : > kern.ipc.nmbclusters=32768
> : : >
> : : >Kernel Conf:
> : : > include GENERIC
> : : > ident NFS
> : : > options DEVICE_POLLING
> : : > options HZ=1000
> : : >_______________________________________________
> : : >freebsd-performance@freebsd.org mailing list
> : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : : >To unsubscribe, send any mail to
> : "freebsd-performance-unsubscribe@freebsd.org"
> : : >
> : : >  
> : : >
> : : 
> : : _______________________________________________
> : : freebsd-performance@freebsd.org mailing list
> : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : : To unsubscribe, send any mail to
> : "freebsd-performance-unsubscribe@freebsd.org"
> : _______________________________________________
> : freebsd-performance@freebsd.org mailing list
> : http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> : To unsubscribe, send any mail to
> "freebsd-performance-unsubscribe@freebsd.org"
> _______________________________________________
> freebsd-performance@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-performance
> To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"


-- 
------------------------------------------------------------------------
Eric Anderson        Sr. Systems Administrator        Centaur Technology
I have seen the future and it is just like the present, only longer.
------------------------------------------------------------------------



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?422E5DE1.9040901>