From owner-freebsd-stable@FreeBSD.ORG Sat Jan 23 14:50:53 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A64AB106566C for ; Sat, 23 Jan 2010 14:50:53 +0000 (UTC) (envelope-from jonathan@kc8onw.net) Received: from mail.kc8onw.net (kc8onw.net [206.55.209.81]) by mx1.freebsd.org (Postfix) with ESMTP id 79B688FC13 for ; Sat, 23 Jan 2010 14:50:53 +0000 (UTC) Received: from [10.70.3.187] (c-98-223-164-104.hsd1.in.comcast.net [98.223.164.104]) by mail.kc8onw.net (Postfix) with ESMTPSA id 6D18321158 for ; Sat, 23 Jan 2010 09:50:52 -0500 (EST) Message-ID: <4B5B0C87.6090001@kc8onw.net> Date: Sat, 23 Jan 2010 09:49:43 -0500 From: Jonathan User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1.7) Gecko/20100111 Thunderbird/3.0.1 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <7346c5c61001030842r7dc76199y51e4c1c90a3eea6e@mail.gmail.com> <7346c5c61001091706m45a3a2a5k3ca8bb0c4bec5ea8@mail.gmail.com> <7346c5c61001171521w1ca4738w98e8fcca24643cda@mail.gmail.com> <201001180829.48126.npapke@acm.org> <7346c5c61001190840k31466754i32b2ae833390b79b@mail.gmail.com> <20100119170101.GA80917@icarus.home.lan> In-Reply-To: <20100119170101.GA80917@icarus.home.lan> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: ZFS performance degradation over time X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jan 2010 14:50:53 -0000 On 1/19/2010 12:01 PM, Jeremy Chadwick wrote: > On Tue, Jan 19, 2010 at 11:40:50AM -0500, Garrett Moore wrote: >> I've been watching my memory usage and I have no idea what is consuming >> memory as 'Active'. >> >> Last night I had around 6500MB 'Active' again, 1500MB Wired, no inact, ~30MB >> buf, no free, and ~100MB swap used. My performance copying ZFS->ZFS was >> again slow (<1MB/s). I tried killing rTorrent and no significant amount of >> memory was reclaimed - maybe 100MB. `ps aux` showed no processes using any >> significant amount of memory, and I was definitely nowhere near 6500MB >> usage. >> >> I tried running the perl oneliner again to hog a bunch of memory, and almost >> all of the Active memory was IMMEDIATELY marked as Free, and my performance >> was excellent again. I'm having this same issue, although my performance does not go back to freshly booted levels it still goes from <1MBs to ~11MB/s after running that Perl one liner. I'm running RELENG 8 as of about 2 days ago FreeBSD 8.0-STABLE #2 r202777: Fri Jan 22 00:15:43 EST 2010 [...] amd64 Just to be clear it also seems to be related to something rtorrent does while downloading torrents but it's not rtorrent itself using the memory because quitting rtorrent doesn't release more than 100MB of multiple GB of memory marked as active but running the Perl one liner does. >> I'm not sure what in userland could be causing the issue. The only things >> I've installed are rTorrent, lighttpd, samba, smartmontools, vim, bash, >> Python, Perl, and SABNZBd. There is nothing that *should* be consuming any >> serious amount of memory. > > I've two recommendations: > > 1) Have you considered "upgrading" to RELENG_8 (e.g. 8.0-STABLE) instead > of sticking with 8.0-RELEASE? There's been a recent MFC to RELENG_8 > which pertain to ARC drainage. I'm referring to the commit labelled > revision 1.22.2.2 (RELENG_8): I definitely have that commit, see above. I just checked my arc size and it's only using ~170 of a ~600MB limit. This is after running the Perl script and without the strangely large amount of "active" memory, I forgot to run on before as well. This machine is just a personal file server so I can restart it as needed for testing and I have serial console access to it if needed. Thanks, Jonathan