From owner-freebsd-fs@FreeBSD.ORG Wed Nov 7 17:02:13 2007 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9F08316A41A for ; Wed, 7 Nov 2007 17:02:13 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 2E47713C4B2 for ; Wed, 7 Nov 2007 17:02:12 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0395D45E90; Wed, 7 Nov 2007 18:02:01 +0100 (CET) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id D3FD245CD9; Wed, 7 Nov 2007 18:01:55 +0100 (CET) Date: Wed, 7 Nov 2007 18:01:48 +0100 From: Pawel Jakub Dawidek To: Martijn Plak Message-ID: <20071107170147.GN15618@garage.freebsd.pl> References: <20071005000046.GC92272@garage.freebsd.pl> <20071008121523.GM2327@garage.freebsd.pl> <20071105215035.GC26730@heff.fud.org.nz> <2e77fc10711051531k41e7224dq6aaedb35cad8d9f2@mail.gmail.com> <6214AB9C-9F9B-4B9D-8B05-0B3DF5F6C16D@SARENET.ES> <20071106100015.GB5268@garage.freebsd.pl> <9A147CEC-D5E6-4117-8C69-16E40DB45B22@SARENET.ES> <20071106125552.GO5268@garage.freebsd.pl> <5ED261E6-A85A-4D7D-A01A-4688802FECB9@plak.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="SwC/mAzP11p89u4p" Content-Disposition: inline In-Reply-To: <5ED261E6-A85A-4D7D-A01A-4688802FECB9@plak.net> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS kmem_map too small. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2007 17:02:13 -0000 --SwC/mAzP11p89u4p Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 07, 2007 at 08:46:35AM +0100, Martijn Plak wrote: > My 7.0-BETA2 (+ updates) system is crashing regularly on a kmem_map =20 > too small panic too. > Yesterday I applied the vm_kern.c.2.patch patch and turned off all of =20 > my sysctl tweaks. >=20 > At first, the system was stable for a day. During that day, I ran =20 > make -j4 buildworld several times without trouble. >=20 > Then started a network transfer. This was a usenet download, on 4 TCP =20 > channels, for a total of 10Mbps, from a server at a 'ping distance' =20 > of about 20ms, using hellanzb.py. My guess was that this sort of =20 > transfer puts some memory pressure on the kernel space. Running that =20 > in parallel with the buildworld crashed the system again. >=20 > I hope this helps the investigation. Let me know if I can run other =20 > tests. [...] > =3D=3D=3D cat /boot/loader.conf > # Load ZFS and load root system from the RAID-Z array. > zfs_load=3D"YES" > vfs.root.mountfrom=3D"zfs:raid/sys/root" >=20 > # Tune ZFS and VM parameters. > #vfs.zfs.arc_max=3D"64M" > #kern.maxvnodes=3D"50000" > #vm.kmem_size_max=3D"512M" > #vm.kmem_size=3D"512M" > =3D=3D=3D sysctl vm | grep kmem > vm.kmem_size_scale: 3 > vm.kmem_size_max: 335544320 > vm.kmem_size_min: 0 > vm.kmem_size: 335544320 The only tuning that is needed (and ZFS will warn now about this) is vm.kmem_size/vm.kmem_size_max. Can you set those back to 512M and retry? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --SwC/mAzP11p89u4p Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHMe97ForvXbEpPzQRArDuAJ45U0Vm7EkW7Pt3jMyOzkuBdPNMHQCg9HuB zQ9URLta+KPLekOREBLBX6U= =OB5C -----END PGP SIGNATURE----- --SwC/mAzP11p89u4p--