From owner-freebsd-fs@FreeBSD.ORG Thu Oct 8 16:07:26 2009 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5DABA106566B; Thu, 8 Oct 2009 16:07:26 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206049004.chello.pl [87.206.49.4]) by mx1.freebsd.org (Postfix) with ESMTP id A13608FC13; Thu, 8 Oct 2009 16:07:25 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id DE49445E9C; Thu, 8 Oct 2009 18:07:23 +0200 (CEST) Received: from localhost (pdawidek.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 7A57D45E97; Thu, 8 Oct 2009 18:07:18 +0200 (CEST) Date: Thu, 8 Oct 2009 18:07:18 +0200 From: Pawel Jakub Dawidek To: Attila Nagy Message-ID: <20091008160718.GB2134@garage.freebsd.pl> References: <4AC1E540.9070001@fsn.hu> <4AC5B2C7.2000200@fsn.hu> <20091002184526.GA1660@garage.freebsd.pl> <4ACDA5EA.2010600@fsn.hu> <4ACDDED0.2070707@fsn.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="T4sUOijqQbZv57TR" Content-Disposition: inline In-Reply-To: <4ACDDED0.2070707@fsn.hu> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 9.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=4.5 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org Subject: Re: ARC size constantly shrinks, then ZFS slows down extremely X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Oct 2009 16:07:26 -0000 --T4sUOijqQbZv57TR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Oct 08, 2009 at 02:45:04PM +0200, Attila Nagy wrote: > Attila Nagy wrote: > >Hello, > > > >Pawel Jakub Dawidek wrote: > >>On Fri, Oct 02, 2009 at 09:59:03AM +0200, Attila Nagy wrote: > >>=20 > >>>Backing out this change from the 8-STABLE kernel: > >>>http://svn.freebsd.org/viewvc/base/head/sys/cddl/contrib/opensolaris/u= ts/common/fs/zfs/arc.c?r1=3D191901&r2=3D191902=20 > >>> > >>> > >>>makes it survive about half and hour of IMAP searching. Of course=20 > >>>only time will tell whether this helps in the long run, but so far=20 > >>>10/10 tries succeeded to kill the machine with this method... > >>> =20 > >> > >>Could you try this patch: > >> > >> http://people.freebsd.org/~pjd/patches/arc.c.4.patch > >> =20 > >It seems (after running for two days) that this fixes my problem. And=20 > >I see that Kip has came out with a similar version (which I couldn't=20 > >yet test, but hope that will also do). > It seems that I was a little bit quick regarding this. > The machine just stopped with this: > last pid: 32358; load averages: 0.01, 0.04, 0.12 up 2+06:33:56 =20 > 14:36:25 > 114 processes: 1 running, 112 sleeping, 1 zombie > CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle > Mem: 536M Active, 63M Inact, 393M Wired, 8K Cache, 111M Buf > Swap: 4096M Total, 15M Used, 4081M Free >=20 > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND > 24025 root 1 44 0 3932K 992K vmwait 0 6:06 0.00% zpool > 84190 root 1 44 0 4700K 1592K CPU1 1 4:17 0.00% top > 99029 root 1 44 0 4132K 1212K nanslp 1 3:53 0.00% gstat > 26317 root 1 44 0 1528K 352K piperd 1 3:38 0.00%=20 > readproctitl > 49143 125 4 45 0 12248K 3788K sigwai 0 2:50 0.00%=20 > milter-greyl > 39969 root 1 44 0 1536K 516K vmwait 0 2:50 0.00% superv= ise > 40241 root 1 44 0 1536K 516K vmwait 0 2:47 0.00% superv= ise > 44633 root 1 44 0 1536K 512K vmwait 0 2:43 0.00% superv= ise > 43434 root 1 44 0 1536K 516K vmwait 0 2:43 0.00% superv= ise > 50575 root 1 44 0 1536K 516K vmwait 0 2:42 0.00% superv= ise > 45510 root 1 44 0 1536K 512K vmwait 0 2:42 0.00% superv= ise > 58146 60 1 44 0 264M 8828K pfault 0 2:32 0.00% imapd > 47526 389 6 44 0 92688K 2296K ucond 1 1:29 0.00% slapd > 5417 root 1 44 0 9396K 1680K pfault 1 1:26 0.00% sshd > 13147 root 1 44 0 3340K 860K vmwait 1 0:45 0.00% syslogd > 92597 root 1 44 0 9396K 1676K pfault 1 0:39 0.00% sshd > 26437 125 1 44 0 6924K 1700K vmwait 0 0:33 0.00% qmgr >=20 > The above top was refreshing, but every other stuff on different ssh=20 > consoles (like a running zpool iostat and gstat) was frozen. > Even top stopped when I have resized the window. Please try Kip's patch that was committed, it changes priorities a bit, which should help. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --T4sUOijqQbZv57TR Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFKzg42ForvXbEpPzQRAo+qAJ47m/rKCxrVyRIZvU7OkhvTTnzNsgCg4qQr kESbsclW6ojZ99eWuMu08Sc= =xAkD -----END PGP SIGNATURE----- --T4sUOijqQbZv57TR--