From owner-freebsd-stable@FreeBSD.ORG Sun Jan 3 17:12:04 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C563C1065672 for ; Sun, 3 Jan 2010 17:12:04 +0000 (UTC) (envelope-from garrettmoore@gmail.com) Received: from mail-iw0-f177.google.com (mail-iw0-f177.google.com [209.85.223.177]) by mx1.freebsd.org (Postfix) with ESMTP id 8F4D48FC08 for ; Sun, 3 Jan 2010 17:12:04 +0000 (UTC) Received: by iwn7 with SMTP id 7so1426557iwn.7 for ; Sun, 03 Jan 2010 09:11:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:date:message-id:subject :from:to:content-type; bh=JtzTgeIMgrVHfT/Q40zDle5FUTCyxK6LdYEGKoB0H5w=; b=SXYwo/PWeMC5I1OAmW5Yca/Rj+A6nnnts/7SDWzqyapq9HSb9W/n/O3GCkcxeyP6kp swo9QSBvCrHlsHdqvr3KC8lNUXDP1swC8OJp7cw6G0QoTLRAL4dhxUX09NzRx4Agn63i qOs9JXnNq/f3WbaKB3b8D2OuZrfjSG8m5tKKU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=ueTvRJSMQLVhMpinT3OAhUfS/yLcSzWLIg4WPn1AF8JfC/2ZCvDuUaSOQaLNg8yN1V es2OFUX6gZpeBfD6nwJIdAUWjXDHVxdzk2QWG0bkwYVqBpOENMA44Nxd1B28k2TBL9W+ b/VXUfZdo+lEnYKEa89xDEwWdqDmqLeP44Tp4= MIME-Version: 1.0 Received: by 10.231.148.3 with SMTP id n3mr4834242ibv.25.1262536934173; Sun, 03 Jan 2010 08:42:14 -0800 (PST) Date: Sun, 3 Jan 2010 11:42:14 -0500 Message-ID: <7346c5c61001030842r7dc76199y51e4c1c90a3eea6e@mail.gmail.com> From: Garrett Moore To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS performance degradation over time X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Jan 2010 17:12:04 -0000 Hello all, I posted a thread about ZFS performance issues in the General section of the forums and there were other people having the same issue, so I thought that it might be helpful to send the details to the mailing list as well. The thread can be found at: http://forums.freebsd.org/showthread.php?p=59680&posted=1#post59680 My original post: --- I'm having problems with ZFS performance. When my system comes up, read/write speeds are excellent (testing with dd if=/dev/zero of=/tank/bigfile and dd if=/tank/bigfile of=/dev/null); I get at least 100MB/s on both reads and writes, and I'm happy with that. The longer the system is up, the worse my performance gets. Currently my system has been up for 4 days, and read/write performance is down to about 10MB/s at best. The system is only accessed by 3 clients: myself, my roommate, and our HTPC. Usually, only one client will be doing anything at a time, so it is not under heavy load or anything. *Software:* Code: FreeBSD leviathan 8.0-RELEASE FreeBSD 8.0-RELEASE #0: Sat Nov 21 15:02:08 UTC 2009 root@mason.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC amd64 The following apps are running and touching data on the zpool: - rTorrent - read and write, usually active, not doing much for reads (not doing any major seeding) - SABnzbd+ - write only, not always active - Lighttpd - running ruTorrent (web interface for rTorrent); nothing else - samba - all of our clients are running Windows, so we use samba to network-mount the zpool *Hardware:* - AMD Athlon II X2 250 Dual Core Processor Socket AM3 3.0GHZ - Gigabyte MA790GP-UD4H AMD790GX ATX AM2+/AM3 Sideport 2PCI-E Sound GBLAN HDMI CrossFireX Motherboard - Corsair XMS2 TWIN2X4096-6400C5 4GB DDR2 2X2GB - Supermicro AOC-USASLP-L8I LSI 1068E 8-PORT RAID 0/1/10 Uio SATA/SAS Controller W/ 16MB Low Profile - *8x* Western Digital WD15EADS Caviar Green 1.5TB SATA 32MB Cache 3.5IN *ZFS setup:* I have the 1.5TB drives in one RAIDZ pool. All 8 drives are connected to the Supermicro L8I controller. The controller is set to 'disabled', so it isn't doing anything with the drives except presenting them to the system untouched. (So I'm really only using it as an expansion card, for the extra ports). Code: [root@leviathan ~]# zpool status pool: tank state: ONLINE config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz1 ONLINE 0 0 0 da0 ONLINE 0 0 0 da1 ONLINE 0 0 0 da2 ONLINE 0 0 0 da3 ONLINE 0 0 0 da4 ONLINE 0 0 0 da5 ONLINE 0 0 0 da6 ONLINE 0 0 0 da7 ONLINE 0 0 0 errors: No known data errors Any suggestions as to what might be causing the performance to degrade with system uptime? If I missed anything or more information is needed, please let me know. Thanks in advance. --- Also just to note, as suggested by someone in the thread, it's probably not directly related to system uptime, but instead related to usage - the more usage, the worse the performance.