From owner-freebsd-performance@FreeBSD.ORG  Wed Mar  9 00:56:31 2005
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 66ABE16A4CE
	for <freebsd-performance@freebsd.org>;
	Wed,  9 Mar 2005 00:56:31 +0000 (GMT)
Received: from coverity.dreamhost.com (coverity.dreamhost.com [66.33.192.105])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 2444843D53
	for <freebsd-performance@freebsd.org>;
	Wed,  9 Mar 2005 00:56:31 +0000 (GMT)
	(envelope-from phessler@coverity.com)
Received: from foo.coverity.int (64-173-147-27.ded.pacbell.net
	[64.173.147.27])
	by coverity.dreamhost.com (Postfix) with ESMTP id 5C6D1908B8
	for <freebsd-performance@freebsd.org>;
	Tue,  8 Mar 2005 16:56:28 -0800 (PST)
Date: Tue, 8 Mar 2005 16:56:28 -0800
From: Peter Hessler <phessler@coverity.com>
To: freebsd-performance@freebsd.org
Organization: Coverity
X-Mailer: Sylpheed version 0.9.99 (GTK+ 1.2.10; i386-unknown-openbsd3.6)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Message-Id: <20050309005628.5C6D1908B8@coverity.dreamhost.com>
Subject: NFS small files
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Mar 2005 00:56:31 -0000

I'm setting up an NFS server to be used for compiling, and it seems that
while speeds are acceptable for large files, small files take much
longer than expected.

Copying 10000 16K files (in a directory) takes 54seconds, while copying
a 170M single file takes 5s.

Are there any tricks for speeding up small file performance?  I'm
willing to give up large file performance.

/etc/sysctl.conf:
 vfs.vmiodirenable=1
 kern.ipc.somaxconn=2048
 kern.maxfiles=65536
 net.isr.enable=1

/boot/loader.conf:
 kern.ipc.nmbclusters=32768

Kernel Conf:
 include GENERIC
 ident NFS
 options DEVICE_POLLING
 options HZ=1000