From owner-freebsd-current@FreeBSD.ORG Tue Mar 11 09:48:34 2008 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 738D71065671; Tue, 11 Mar 2008 09:48:34 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from relay02.kiev.sovam.com (relay02.kiev.sovam.com [62.64.120.197]) by mx1.freebsd.org (Postfix) with ESMTP id F19BF8FC19; Tue, 11 Mar 2008 09:48:33 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from [212.82.216.226] (helo=skuns.kiev.zoral.com.ua) by relay02.kiev.sovam.com with esmtps (TLSv1:AES256-SHA:256) (Exim 4.67) (envelope-from ) id 1JZ15s-00095W-5v; Tue, 11 Mar 2008 11:48:32 +0200 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by skuns.kiev.zoral.com.ua (8.14.2/8.14.2) with ESMTP id m2B9mS25096936 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 11 Mar 2008 11:48:28 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.14.2/8.14.2) with ESMTP id m2B9mEmN033093; Tue, 11 Mar 2008 11:48:14 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.14.2/8.14.2/Submit) id m2B9mEra033092; Tue, 11 Mar 2008 11:48:14 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 11 Mar 2008 11:48:14 +0200 From: Kostik Belousov To: Kip Macy Message-ID: <20080311094814.GF10374@deviant.kiev.zoral.com.ua> References: <47D544B1.6070806@bsdunix.ch> <47D5D2B2.90202@FreeBSD.org> <5f67a8c40803101813k3a2b790dk57b67bc2d6f85d17@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="f61P+fpdnY2FZS1u" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Virus-Scanned: ClamAV version 0.91.2, clamav-milter version 0.91.2 on skuns.kiev.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.2.4 X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on skuns.kiev.zoral.com.ua X-Scanner-Signature: d3dfc5a0b247ea81d48b6a940fe6235f X-DrWeb-checked: yes X-SpamTest-Envelope-From: kostikbel@gmail.com X-SpamTest-Group-ID: 00000000 X-SpamTest-Info: Profiles 2377 [Mar 10 2008] X-SpamTest-Info: helo_type=3 X-SpamTest-Info: {received from trusted relay: not dialup} X-SpamTest-Method: none X-SpamTest-Method: Local Lists X-SpamTest-Rate: 0 X-SpamTest-Status: Not detected X-SpamTest-Status-Extended: not_detected X-SpamTest-Version: SMTP-Filter Version 3.0.0 [0255], KAS30/Release Cc: freebsd-fs@freebsd.org, Zaphod Beeblebrox , current@freebsd.org, Thomas Vogt Subject: Re: vm_thread_new: kstack allocation failed with many ZFS FS and NFSD X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Mar 2008 09:48:34 -0000 --f61P+fpdnY2FZS1u Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Mar 10, 2008 at 09:24:55PM -0700, Kip Macy wrote: > On Mon, Mar 10, 2008 at 6:13 PM, Zaphod Beeblebrox wr= ote: > > On Mon, Mar 10, 2008 at 8:30 PM, Kris Kennaway wrote: > > > > > > > Your kernel has run out of memory. If you cannot tune kmem_size fur= ther > > > then it cannot handle this many ZFS filesystems. > > > > > > Roughly how much kernel memory does a filesystem use (even if inactive= ) --- > > or did you really mean something like too many pools? > > > > The ZFS documentation encourages creating filesystems for everything. = I > > think my (rather beafy) laptop has 20 filesystems now for various task= s --- > > but I didn't realize there was a non-trivial cost (that is: a cost bey= ond > > the mount structure, root vnodes and whatnot)... >=20 > There may be kernel threads created for each file system. One way to > look at it is that a process isn't that expensive, but FreeBSD > probably couldn't cope very well with 5000 processes. On the usual modern i386 hardware with usual load we easily handle ~30000 threads, with the top coming at around 50000 threads. The most limiting factor, from my POV, is the kernel address space, since each thread takes 3 pages for the kernel stack. --f61P+fpdnY2FZS1u Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (FreeBSD) iEYEARECAAYFAkfWVV0ACgkQC3+MBN1Mb4jxYACaAtwPk01KGJXSpe7Gu0LcUGuj VBEAn1jiS+kxdCHIg0VUaUw6wVixFSR3 =ukK4 -----END PGP SIGNATURE----- --f61P+fpdnY2FZS1u--