From owner-freebsd-current@FreeBSD.ORG Fri Apr 17 13:36:44 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B67AE106567B for ; Fri, 17 Apr 2009 13:36:44 +0000 (UTC) (envelope-from freebsd-current@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 3C15E8FC1D for ; Fri, 17 Apr 2009 13:36:43 +0000 (UTC) (envelope-from freebsd-current@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1LuoFE-0004qT-Fp for freebsd-current@freebsd.org; Fri, 17 Apr 2009 13:36:40 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 17 Apr 2009 13:36:40 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 17 Apr 2009 13:36:40 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-current@freebsd.org From: Ivan Voras Date: Fri, 17 Apr 2009 15:36:25 +0200 Lines: 58 Message-ID: References: <20090417145024.205173ighmwi4j0o@webmail.leidinger.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigF636F2BEAD87C797405E3AD2" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.21 (X11/20090318) In-Reply-To: <20090417145024.205173ighmwi4j0o@webmail.leidinger.net> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: ZFS: unlimited arc cache growth? X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Apr 2009 13:36:45 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigF636F2BEAD87C797405E3AD2 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Alexander Leidinger wrote: > Hi, >=20 > to fs@, please CC me, as I'm not subscribed. >=20 > I monitored (by hand) a while the sysctls kstat.zfs.misc.arcstats.size > and kstat.zfs.misc.arcstats.hdr_size. Both grow way higher (at some > point I've seen more than 500M) than what I have configured in > vfs.zfs.arc_max (40M). >=20 > After a while FS operations (e.g. pkgdb -F with about 900 packages... m= y > specific workload is the fixup of gnome packages after the removal of > the obsolete libusb port) get very slow (in my specific example I let > the pkgdb run several times over night and it still is not finished). >=20 > The big problem with this is, that at some point in time the machine > reboots (panic, page fault, page not present, during a fork1). I have > the impression (beware, I have a watchdog configured, as I don't know i= f > a triggered WD would cause the same panic, the following is just a > guess) that I run out of memory of some kind (I have 1G RAM, i386, max > kmem size 700M). I restarted pkgdb several times after a reboot, and i= t > continues to process the libusb removal, but hey, this is anoying. >=20 > Does someone see something similar to what I describe (mainly the growt= h > of the arc cache way beyond what is configured)? Anyone with some ideas= > what to try? What you've come across is probably *the* single most important problem with ZFS - unfortunately not yet resolved. If ARC could be constrained or removed, other issues would probably be forgivable :) --------------enigF636F2BEAD87C797405E3AD2 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJ6IXfldnAQVacBcgRAiCHAJ0S00oDz8k8dV6sr08gWZ42bL6VYACfX0sP 4V08WCXPUTwI4CCYSVimH2c= =WAkT -----END PGP SIGNATURE----- --------------enigF636F2BEAD87C797405E3AD2--