From owner-freebsd-current@FreeBSD.ORG Tue Apr 10 01:55:24 2007 Return-Path: X-Original-To: freebsd-current@FreeBSD.org Delivered-To: freebsd-current@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AD22C16A403; Tue, 10 Apr 2007 01:55:24 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 9395C13C4BF; Tue, 10 Apr 2007 01:55:24 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 5F0D11A4D87; Mon, 9 Apr 2007 18:55:29 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id B6816513F4; Mon, 9 Apr 2007 21:55:23 -0400 (EDT) Date: Mon, 9 Apr 2007 21:55:23 -0400 From: Kris Kennaway To: Craig Boston , Kris Kennaway , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , freebsd-fs@FreeBSD.org Message-ID: <20070410015523.GA39181@xor.obsecurity.org> References: <4617A3A6.60804@kasimir.com> <20070407165759.GG8831@cicely12.cicely.de> <20070407180319.GH8831@cicely12.cicely.de> <20070407191517.GN63916@garage.freebsd.pl> <20070407212413.GK8831@cicely12.cicely.de> <20070410003505.GA8189@nowhere> <20070410003837.GB8189@nowhere> <20070410011125.GB38535@xor.obsecurity.org> <20070410013034.GC8189@nowhere> <20070410014233.GD8189@nowhere> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="OXfL5xGRrasGEqWY" Content-Disposition: inline In-Reply-To: <20070410014233.GD8189@nowhere> User-Agent: Mutt/1.4.2.2i Cc: Subject: Re: ZFS committed to the FreeBSD base. X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Apr 2007 01:55:24 -0000 --OXfL5xGRrasGEqWY Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 09, 2007 at 08:42:33PM -0500, Craig Boston wrote: > On Mon, Apr 09, 2007 at 08:30:35PM -0500, Craig Boston wrote: > > Even the vm.zone breakdown seems to be gone in current so apparently my > > knowledge of such things is becoming obsolete :) >=20 > But vmstat -m still works >=20 > ... >=20 > solaris 145806 122884K - 15319671 16,32,64,128,256,512,1024,2048,40= 96 > ... >=20 > Whoa! That's a lot of kernel memory. Meanwhile... >=20 > kstat.zfs.misc.arcstats.size: 33554944 > (which is just barely above vfs.zfs.arc_min) >=20 > So I don't think it's the arc cache (yeah I know that's redundant) that > is the problem. Seems like something elsewhere in zfs is allocating > large amounts of memory and not letting it go, and even the cache is > having to shrink to its minimum size due to the memory pressure. >=20 > It didn't panic this time, so when the tar finished I tried a "zfs > unmount /usr/ports". This caused the "solaris" entry to drop down to > about 64MB, so it's not a leak. It could just be that ZFS needs lots of > memory to operate if it keeps a lot of metadata for each file in memory. >=20 > The sheer # of allocations still seems excessive though. It was well > over 20 million by the time the tar process exited. That is a lifetime count of the # of operations, not the current number allocated ("InUse"). It does look like there is something else using a significant amount of memory apart from arc, but arc might at least be the major one due to its extremely greedy default allocation policy. Kris --OXfL5xGRrasGEqWY Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGGu6LWry0BWjoQKURAsvPAJ9RQY1byjCO6m2ffTfKNdcal+MHqgCfXipe L730fhNTz/IegK/hc1PK+/g= =dFbw -----END PGP SIGNATURE----- --OXfL5xGRrasGEqWY--