From owner-freebsd-fs@FreeBSD.ORG Thu Oct 8 12:45:10 2009 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DF4BE1065672; Thu, 8 Oct 2009 12:45:09 +0000 (UTC) (envelope-from bra@fsn.hu) Received: from people.fsn.hu (people.fsn.hu [195.228.252.137]) by mx1.freebsd.org (Postfix) with ESMTP id E31AB8FC0A; Thu, 8 Oct 2009 12:45:08 +0000 (UTC) Received: by people.fsn.hu (Postfix, from userid 1001) id 2C8EE141099; Thu, 8 Oct 2009 14:45:07 +0200 (CEST) X-CRM114-Version: 20090423-BlameSteveJobs ( TRE 0.7.6 (BSD) ) MF-ACE0E1EA [pR: 18.8731] X-CRM114-CacheID: sfid-20091008_14450_05B4CBDC X-CRM114-Status: Good ( pR: 18.8731 ) Message-ID: <4ACDDED0.2070707@fsn.hu> Date: Thu, 08 Oct 2009 14:45:04 +0200 From: Attila Nagy User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.1.23) Gecko/20090817 Thunderbird/2.0.0.23 Mnenhy/0.7.6.0 MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <4ACDA5EA.2010600@fsn.hu> In-Reply-To: <4ACDA5EA.2010600@fsn.hu> X-Stationery: 0.4.10 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.3 (people.fsn.hu); Thu, 08 Oct 2009 14:45:05 +0200 (CEST) Cc: freebsd-fs@FreeBSD.org Subject: Re: ARC size constantly shrinks, then ZFS slows down extremely X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2009 12:45:10 -0000 Attila Nagy wrote: > Hello, > > Pawel Jakub Dawidek wrote: >> On Fri, Oct 02, 2009 at 09:59:03AM +0200, Attila Nagy wrote: >> >>> Backing out this change from the 8-STABLE kernel: >>> http://svn.freebsd.org/viewvc/base/head/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c?r1=191901&r2=191902 >>> >>> >>> makes it survive about half and hour of IMAP searching. Of course >>> only time will tell whether this helps in the long run, but so far >>> 10/10 tries succeeded to kill the machine with this method... >>> >> >> Could you try this patch: >> >> http://people.freebsd.org/~pjd/patches/arc.c.4.patch >> > It seems (after running for two days) that this fixes my problem. And > I see that Kip has came out with a similar version (which I couldn't > yet test, but hope that will also do). It seems that I was a little bit quick regarding this. The machine just stopped with this: last pid: 32358; load averages: 0.01, 0.04, 0.12 up 2+06:33:56 14:36:25 114 processes: 1 running, 112 sleeping, 1 zombie CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 536M Active, 63M Inact, 393M Wired, 8K Cache, 111M Buf Swap: 4096M Total, 15M Used, 4081M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 24025 root 1 44 0 3932K 992K vmwait 0 6:06 0.00% zpool 84190 root 1 44 0 4700K 1592K CPU1 1 4:17 0.00% top 99029 root 1 44 0 4132K 1212K nanslp 1 3:53 0.00% gstat 26317 root 1 44 0 1528K 352K piperd 1 3:38 0.00% readproctitl 49143 125 4 45 0 12248K 3788K sigwai 0 2:50 0.00% milter-greyl 39969 root 1 44 0 1536K 516K vmwait 0 2:50 0.00% supervise 40241 root 1 44 0 1536K 516K vmwait 0 2:47 0.00% supervise 44633 root 1 44 0 1536K 512K vmwait 0 2:43 0.00% supervise 43434 root 1 44 0 1536K 516K vmwait 0 2:43 0.00% supervise 50575 root 1 44 0 1536K 516K vmwait 0 2:42 0.00% supervise 45510 root 1 44 0 1536K 512K vmwait 0 2:42 0.00% supervise 58146 60 1 44 0 264M 8828K pfault 0 2:32 0.00% imapd 47526 389 6 44 0 92688K 2296K ucond 1 1:29 0.00% slapd 5417 root 1 44 0 9396K 1680K pfault 1 1:26 0.00% sshd 13147 root 1 44 0 3340K 860K vmwait 1 0:45 0.00% syslogd 92597 root 1 44 0 9396K 1676K pfault 1 0:39 0.00% sshd 26437 125 1 44 0 6924K 1700K vmwait 0 0:33 0.00% qmgr The above top was refreshing, but every other stuff on different ssh consoles (like a running zpool iostat and gstat) was frozen. Even top stopped when I have resized the window.