From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 12:54:15 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AC2A8106566B for ; Sun, 27 Jul 2008 12:54:15 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id 0E9318FC1A for ; Sun, 27 Jul 2008 12:54:14 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 104E74569A; Sun, 27 Jul 2008 14:54:13 +0200 (CEST) Received: from localhost (chello087206045140.chello.pl [87.206.45.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 707EA45C99; Sun, 27 Jul 2008 14:54:08 +0200 (CEST) Date: Sun, 27 Jul 2008 14:54:13 +0200 From: Pawel Jakub Dawidek To: freebsd-fs@FreeBSD.org Message-ID: <20080727125413.GG1345@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="pfTAc8Cvt8L6I27a" Content-Disposition: inline User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-current@FreeBSD.org Subject: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 12:54:15 -0000 --pfTAc8Cvt8L6I27a Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi. http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 The patch above contains the most recent ZFS version that could be found in OpenSolaris as of today. Apart for large amount of new functionality, I belive there are many stability (and also performance) improvements compared to the version from the base system. Check out OpenSolaris website to find out the differences between base system version and patch version. Please test, test, test. If I get enough positive feedback, I may be able to squeeze it into 7.1-RELEASE, but this might be hard. If you have any questions, please use mailing lists (freebsd-fs@FreeBSD.org would be the best). Thank you in advance! --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --pfTAc8Cvt8L6I27a Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIjG/1ForvXbEpPzQRAnctAJ91c32L6NIndQwEcPai7L9AtYAAJwCfdeEZ atAsjYV6T5/dTjD0wljQ+sw= =D4oR -----END PGP SIGNATURE----- --pfTAc8Cvt8L6I27a-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 14:05:15 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A866A1065672; Sun, 27 Jul 2008 14:05:15 +0000 (UTC) (envelope-from arne@rfc2549.org) Received: from mail.blinkt.de (mail.blinkt.de [88.198.169.219]) by mx1.freebsd.org (Postfix) with ESMTP id 6BD5B8FC08; Sun, 27 Jul 2008 14:05:15 +0000 (UTC) (envelope-from arne@rfc2549.org) Received: from dslb-084-061-153-001.pools.arcor-ip.net ([84.61.153.1] helo=styx.local) by mail.blinkt.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KN6Vl-000MGO-J4; Sun, 27 Jul 2008 15:42:09 +0200 Message-ID: <488C7B30.3020503@rfc2549.org> Date: Sun, 27 Jul 2008 15:42:08 +0200 From: Arne Schwabe User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; de; rv:1.8.1.16) Gecko/20080707 Thunderbird/2.0.0.16 Mnenhy/0.7.5.0 MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 14:05:15 -0000 Pawel Jakub Dawidek schrieb: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be foun= d > in OpenSolaris as of today. Apart for large amount of new functionality= , > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > =20 So this build could import zfs version 3/zpool version 10? Just asking=20 because I have a opensolaris box where could try FreeBSD in this case. Arne From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 14:20:22 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 62AA91065674 for ; Sun, 27 Jul 2008 14:20:22 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay02.ispgateway.de (smtprelay02.ispgateway.de [80.67.18.14]) by mx1.freebsd.org (Postfix) with ESMTP id EC9968FC0C for ; Sun, 27 Jul 2008 14:20:21 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from [88.153.4.14] (helo=localhost) by smtprelay02.ispgateway.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1KN6ww-0005EJ-1w for freebsd-fs@FreeBSD.org; Sun, 27 Jul 2008 16:10:14 +0200 Date: Sun, 27 Jul 2008 16:10:06 +0200 From: Fabian Keil To: freebsd-fs@FreeBSD.org Message-ID: <20080727161006.1f453d55@fabiankeil.de> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> X-Mailer: Claws Mail 3.5.0 (GTK+ 2.12.11; i386-portbld-freebsd8.0) X-PGP-KEY-URL: http://www.fabiankeil.de/gpg-keys/freebsd-listen-2008-08-18.asc Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/V3MnKbEbO4sDmZMLoHIk0pt"; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Df-Sender: 775067 Cc: Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-fs@FreeBSD.org List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 14:20:22 -0000 --Sig_/V3MnKbEbO4sDmZMLoHIk0pt Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Pawel Jakub Dawidek wrote: > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >=20 > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. Awesome, thanks. The patch applied cleanly, but unfortunately buildkernel fails for me with: =3D=3D=3D> zfs (depend) @ -> /usr/src/sys machine -> /usr/src/sys/amd64/include awk -f @/tools/vnode_if.awk @/kern/vnode_if.src -p awk -f @/tools/vnode_if.awk @/kern/vnode_if.src -q awk -f @/tools/vnode_if.awk @/kern/vnode_if.src -h make: don't know how to make u8_textprep.c. Stop *** Error code 2 Stop in /usr/src/sys/modules. *** Error code 1 Stop in /usr/obj/usr/src/sys/GENERIC. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. buildworld fails with: =3D=3D=3D> sys/boot/i386/cdboot (cleandir) rm -f cdboot cdboot.o rm -f .depend GPATH GRTAGS GSYMS GTAGS =3D=3D=3D> sys/boot/i386/gptboot (cleandir) rm -f gptboot gptldr.bin gptldr.out gptldr.o gptboot.bin gptboot.out gptboo= t.o sio.o machine =3D=3D=3D> sys/boot/i386/zfsboot (cleandir) cd: can't cd to /usr/src/sys/boot/i386/zfsboot *** Error code 2 Stop in /usr/src/sys/boot/i386. *** Error code 1 Stop in /usr/src/sys/boot. *** Error code 1 Stop in /usr/src/sys. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. *** Error code 1 Stop in /usr/src. Also there are some warning: [fk@kendra /usr/src]$ time make buildkernel KERNCONF=3DGENERIC "/usr/src/Makefile", line 134: warning: duplicate script for target "machin= e" ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "clean"= ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "cleand= epend" ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "distri= bute" ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "lint" = ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "obj" i= gnored "/usr/src/Makefile", line 306: warning: duplicate script for target "objlin= k" ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "tags" = ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "files"= ignored "/usr/src/Makefile", line 306: warning: duplicate script for target "includ= es" ignored -------------------------------------------------------------- >>> Kernel build for GENERIC started on Sun Jul 27 15:59:40 CEST 2008 -------------------------------------------------------------- I'm using 8.0-CURRENT, my sources are from today your vfs_subr.c commits were the last changes I got. I tried on both i386 and amd64. Fabian --Sig_/V3MnKbEbO4sDmZMLoHIk0pt Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkiMgb4ACgkQBYqIVf93VJ37lACgxbNPC9iWItMhY0HlGECBaVWx WgwAoJhaRQtWBJbEBFW/ukykKF/KPGUA =IWgC -----END PGP SIGNATURE----- --Sig_/V3MnKbEbO4sDmZMLoHIk0pt-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 14:48:24 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F3FE81065679; Sun, 27 Jul 2008 14:48:23 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from cdptpa-omtalb.mail.rr.com (cdptpa-omtalb.mail.rr.com [75.180.132.120]) by mx1.freebsd.org (Postfix) with ESMTP id 6BEC08FC23; Sun, 27 Jul 2008 14:48:23 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from shop.chemikals.org ([75.182.12.58]) by cdptpa-omta04.mail.rr.com with ESMTP id <20080727144822.BXR19640.cdptpa-omta04.mail.rr.com@shop.chemikals.org>; Sun, 27 Jul 2008 14:48:22 +0000 Received: from volatile.chemikals.org (root@r74-193-170-223.bssrcmta01.bscyla.by.dh.suddenlink.net [74.193.170.223] (may be forged)) by shop.chemikals.org (8.14.1/8.14.1) with ESMTP id m6REmLLu052583; Sun, 27 Jul 2008 10:48:21 -0400 (EDT) (envelope-from morganw@chemikals.org) Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.14.2/8.14.2) with ESMTP id m6REmJS0095372; Sun, 27 Jul 2008 09:48:20 -0500 (CDT) (envelope-from morganw@chemikals.org) Date: Sun, 27 Jul 2008 09:48:19 -0500 (CDT) From: Wes Morgan To: Pawel Jakub Dawidek In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Message-ID: References: <20080727125413.GG1345@garage.freebsd.pl> User-Agent: Alpine 1.10 (BSF 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-fs@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 14:48:24 -0000 On Sun, 27 Jul 2008, Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). Is this patch against -stable or -current? From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 15:27:45 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 004EA1065672; Sun, 27 Jul 2008 15:27:44 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from bene1.itea.ntnu.no (bene1.itea.ntnu.no [IPv6:2001:700:300:3::56]) by mx1.freebsd.org (Postfix) with ESMTP id 466C48FC1B; Sun, 27 Jul 2008 15:27:44 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from localhost (localhost [127.0.0.1]) by bene1.itea.ntnu.no (Postfix) with ESMTP id 5DF5A16C87B; Sun, 27 Jul 2008 17:27:42 +0200 (CEST) Received: from nobby.studby.ntnu.no (unknown [IPv6:2001:700:300:3::184]) by bene1.itea.ntnu.no (Postfix) with ESMTP id DB18016C879; Sun, 27 Jul 2008 17:27:41 +0200 (CEST) Date: Sun, 27 Jul 2008 17:27:24 +0200 From: Ulf Lilleengen To: Arne Schwabe Message-ID: <20080727152724.GA3336@nobby.studby.ntnu.no> References: <20080727125413.GG1345@garage.freebsd.pl> <488C7B30.3020503@rfc2549.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <488C7B30.3020503@rfc2549.org> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene1.itea.ntnu.no Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "..."@nobby.studby.ntnu.no List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 15:27:45 -0000 On Sun, Jul 27, 2008 at 03:42:08PM +0200, Arne Schwabe wrote: > Pawel Jakub Dawidek schrieb: > > Hi. > > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > > The patch above contains the most recent ZFS version that could be found > > in OpenSolaris as of today. Apart for large amount of new functionality, > > I belive there are many stability (and also performance) improvements > > compared to the version from the base system. > > > > > So this build could import zfs version 3/zpool version 10? Just asking > because I have a opensolaris box where could try FreeBSD in this case. > Yes, it supports zpool version 11 and zfs version 3. -- Ulf Lilleengen From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 15:32:04 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DDB0C106566B for ; Sun, 27 Jul 2008 15:32:04 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from bene2.itea.ntnu.no (bene2.itea.ntnu.no [IPv6:2001:700:300:3::57]) by mx1.freebsd.org (Postfix) with ESMTP id 31FD58FC0A for ; Sun, 27 Jul 2008 15:32:03 +0000 (UTC) (envelope-from lulf@stud.ntnu.no) Received: from localhost (localhost [127.0.0.1]) by bene2.itea.ntnu.no (Postfix) with ESMTP id 152CD90007; Sun, 27 Jul 2008 17:32:02 +0200 (CEST) Received: from nobby.studby.ntnu.no (unknown [IPv6:2001:700:300:3::184]) by bene2.itea.ntnu.no (Postfix) with ESMTP id 9CF9690006; Sun, 27 Jul 2008 17:32:01 +0200 (CEST) Date: Sun, 27 Jul 2008 17:31:44 +0200 From: Ulf Lilleengen To: Wes Morgan Message-ID: <20080727153144.GB3336@nobby.studby.ntnu.no> References: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene2.itea.ntnu.no Cc: freebsd-fs@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "..."@nobby.studby.ntnu.no List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 15:32:04 -0000 On Sun, Jul 27, 2008 at 09:48:19AM -0500, Wes Morgan wrote: > On Sun, 27 Jul 2008, Pawel Jakub Dawidek wrote: > > > Hi. > > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > > The patch above contains the most recent ZFS version that could be found > > in OpenSolaris as of today. Apart for large amount of new functionality, > > I belive there are many stability (and also performance) improvements > > compared to the version from the base system. > > > > Check out OpenSolaris website to find out the differences between base > > system version and patch version. > > > > Please test, test, test. If I get enough positive feedback, I may be > > able to squeeze it into 7.1-RELEASE, but this might be hard. > > > > If you have any questions, please use mailing lists > > (freebsd-fs@FreeBSD.org would be the best). > > Is this patch against -stable or -current? -current -- Ulf Lilleengen From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 16:14:09 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54D231065678 for ; Sun, 27 Jul 2008 16:14:09 +0000 (UTC) (envelope-from denis@h3q.com) Received: from mail.h3q.com (mail.h3q.com [213.73.89.199]) by mx1.freebsd.org (Postfix) with ESMTP id E8FC78FC23 for ; Sun, 27 Jul 2008 16:14:08 +0000 (UTC) (envelope-from denis@h3q.com) Received: (qmail 24693 invoked from network); 27 Jul 2008 15:47:26 -0000 Received: from unknown (HELO flashlie.club.berlin.ccc.de) (denis@195.160.172.2) by mail.h3q.com with AES128-SHA encrypted SMTP; 27 Jul 2008 15:47:26 -0000 Message-Id: <86929730-717E-4B13-9EE8-857F796D77DE@h3q.com> From: Denis Ahrens To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Date: Sun, 27 Jul 2008 17:47:25 +0200 X-Mailer: Apple Mail (2.926) Subject: zfs patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 16:14:09 -0000 hi did you add -p0 to the patch command? I did not first and had the errors you had. with -p0 as an option to the patch command everything works now Denis From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 16:32:51 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B61EE106566B for ; Sun, 27 Jul 2008 16:32:51 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from smtprelay09.ispgateway.de (smtprelay09.ispgateway.de [80.67.29.23]) by mx1.freebsd.org (Postfix) with ESMTP id 7984E8FC13 for ; Sun, 27 Jul 2008 16:32:51 +0000 (UTC) (envelope-from freebsd-listen@fabiankeil.de) Received: from [88.153.4.14] (helo=localhost) by smtprelay09.ispgateway.de with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.68) (envelope-from ) id 1KN9Av-00011q-U3 for freebsd-fs@freebsd.org; Sun, 27 Jul 2008 18:32:50 +0200 Date: Sun, 27 Jul 2008 18:32:46 +0200 From: Fabian Keil To: freebsd-fs@freebsd.org Message-ID: <20080727183246.5649e644@fabiankeil.de> In-Reply-To: <86929730-717E-4B13-9EE8-857F796D77DE@h3q.com> References: <86929730-717E-4B13-9EE8-857F796D77DE@h3q.com> X-Mailer: Claws Mail 3.5.0 (GTK+ 2.12.11; i386-portbld-freebsd8.0) X-PGP-KEY-URL: http://www.fabiankeil.de/gpg-keys/freebsd-listen-2008-08-18.asc Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/aI22BTbuq8TqthjEmBl2qgu"; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Df-Sender: 775067 Subject: Re: zfs patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 16:32:51 -0000 --Sig_/aI22BTbuq8TqthjEmBl2qgu Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Denis Ahrens wrote: > did you add -p0 to the patch command? I did not. Thanks. Fabian --Sig_/aI22BTbuq8TqthjEmBl2qgu Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (FreeBSD) iEYEARECAAYFAkiMoy4ACgkQBYqIVf93VJ2i3wCfTlKS1X+6W9R8oZXtn3bZ5qbu vL4An3gA09/KQDmd6b7hAaltmZVy/o/d =JwKy -----END PGP SIGNATURE----- --Sig_/aI22BTbuq8TqthjEmBl2qgu-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:11:18 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D09CE106564A; Sun, 27 Jul 2008 18:11:18 +0000 (UTC) (envelope-from nork@FreeBSD.org) Received: from sakura.ninth-nine.com (unknown [IPv6:2001:2f0:104:80a0:230:48ff:fe41:2455]) by mx1.freebsd.org (Postfix) with ESMTP id 6B2438FC15; Sun, 27 Jul 2008 18:11:18 +0000 (UTC) (envelope-from nork@FreeBSD.org) Received: from nadesico.ninth-nine.com (nadesico.ninth-nine.com [219.127.74.122]) by sakura.ninth-nine.com (8.14.1/8.14.1/NinthNine) with SMTP id m6RIBGKW066920; Mon, 28 Jul 2008 03:11:16 +0900 (JST) (envelope-from nork@FreeBSD.org) Date: Mon, 28 Jul 2008 03:11:15 +0900 From: Norikatsu Shigemura To: Pawel Jakub Dawidek Message-Id: <20080728031115.b0ac0d07.nork@FreeBSD.org> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.0.2 (sakura.ninth-nine.com [219.127.74.121]); Mon, 28 Jul 2008 03:11:16 +0900 (JST) Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Norikatsu Shigemura Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:11:19 -0000 On Sun, 27 Jul 2008 14:54:13 +0200 Pawel Jakub Dawidek wrote: > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. I read your patch. So I don't test, yet. But I noticed a minor issue of your patch. * NO NEED FOLLOWING PATCH * - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- sys/cddl/contrib/opensolaris/common/atomic/ia64/atomic.S.orig 2008-03-29 07:16:08.000000000 +0900 +++ sys/cddl/contrib/opensolaris/common/atomic/ia64/atomic.S 2008-07-28 01:54:52.314417185 +0900 @@ -23,7 +23,7 @@ * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF * THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. * - * $FreeBSD: src/sys/cddl/contrib/opensolaris/common/atomic/ia64/atomic.S,v 1.3 2008/03/28 22:16:08 jb Exp $ + * $FreeBSD: src/sys/contrib/opensolaris/common/atomic/ia64/atomic.S,v 1.2 2007/06/08 16:20:03 marcel Exp $ */ #include - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - I'm using following patch: 1. To support zpool for lsdev. 2. To support case of "slice has only zpool and no bsd partition". I don't test on new zfs, yet. I'll try to test it, too. - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - --- sys/boot/i386/libi386/biosdisk.c~ 2008-02-29 02:49:23.000000000 +0900 +++ sys/boot/i386/libi386/biosdisk.c 2008-03-18 09:15:34.209096127 +0900 @@ -469,6 +469,7 @@ * unused. */ if ((lp->d_partitions[i].p_fstype == FS_BSDFFS) || + (lp->d_partitions[i].p_fstype == FS_ZFS) || (lp->d_partitions[i].p_fstype == FS_SWAP) || (lp->d_partitions[i].p_fstype == FS_VINUM) || ((lp->d_partitions[i].p_fstype == FS_UNUSED) && @@ -477,6 +478,7 @@ /* Only print out statistics in verbose mode */ if (verbose) sprintf(line, " %s%c: %s %s (%d - %d)\n", prefix, 'a' + i, + (lp->d_partitions[i].p_fstype == FS_ZFS) ? "ZFS " : (lp->d_partitions[i].p_fstype == FS_SWAP) ? "swap " : (lp->d_partitions[i].p_fstype == FS_VINUM) ? "vinum" : "FFS ", @@ -485,6 +487,7 @@ lp->d_partitions[i].p_offset + lp->d_partitions[i].p_size); else sprintf(line, " %s%c: %s\n", prefix, 'a' + i, + (lp->d_partitions[i].p_fstype == FS_ZFS) ? "ZFS" : (lp->d_partitions[i].p_fstype == FS_SWAP) ? "swap" : (lp->d_partitions[i].p_fstype == FS_VINUM) ? "vinum" : "FFS"); @@ -696,7 +699,12 @@ if (lp->d_magic != DISKMAGIC) { DEBUG("no disklabel"); +#if 0 return (ENOENT); +#else + od->od_flags &= ~BD_LABELOK; + od->od_boff = sector; /* no partition, must be after the slice */ +#endif } if (dev->d_kind.biosdisk.partition >= lp->d_npartitions) { DEBUG("partition '%c' exceeds partitions in table (a-'%c')", - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:25:48 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8BFFB1065675; Sun, 27 Jul 2008 18:25:48 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id 4FF9D8FC08; Sun, 27 Jul 2008 18:25:48 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se (c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.169]) by smtp.infidyne.com (Postfix) with ESMTPSA id CDC267030A; Sun, 27 Jul 2008 20:25:46 +0200 (CEST) From: Peter Schuller To: Pawel Jakub Dawidek Date: Sun, 27 Jul 2008 20:26:46 +0200 User-Agent: KMail/1.9.7 References: <200807262005.54235.peter.schuller@infidyne.com> <20080726205118.GB1345@garage.freebsd.pl> In-Reply-To: <20080726205118.GB1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart101433479.frefnM8Eff"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200807272026.54907.peter.schuller@infidyne.com> Cc: freebsd-fs@freebsd.org Subject: Re: Asynchronous writing to zvols (ZFS) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:25:48 -0000 --nextPart101433479.frefnM8Eff Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hello, > The problem is that we don't between async and sync I/O request on GEOM > level, that's why I decided to commit a ZIL log after each write, which > wasn't very smart it seems. This is handled differently in version I've > in perforce. Could you try the below patch and see how it performs now? > > http://people.freebsd.org/~pjd/patches/zvol.c.patch The above (though the files has moved, for anyone else reading wanting to=20 apply) does eliminate the synchronicity problem. I am now seeing 5-15=20 MB/second write speeds to the zvol, with 100% constituent disk utilization. I am not sure why I don't see faster writes; I get more like 40-60 when=20 writing to a file in a ZFS file system on the same pool. But regardless, th= e=20 synchronisity issue is gone. Does your comment above regarding distinguishing bewteen sync and asynch ap= ply=20 to the section of code affected by the above patch, or did you mean there i= s=20 some other place above the zvol handling where there is lack of distinction? That is, is the end-effect of the above change that we *never* do synchrono= us=20 writes (because the fact that a write is supposed to be synchronous is=20 somehow lost before it reaches that point)? I understand a zil_commit is only required on BIO_FLUSH requests, which is= =20 what the patch fixes. But I get the impression from your phrasing above tha= t=20 the reason that a zil_commit was done on every I/O from the get go was in a= n=20 effort to honor actual synchronous writes by conservatively *always* doing= =20 synchronous writes, because the synchronicity of synchronous writes would n= ot=20 be propagated down to the zvol class. I wouldn't want to sacrifice=20 correctness just to get the speed ;) =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart101433479.frefnM8Eff Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEABECAAYFAkiMve4ACgkQDNor2+l1i323JQCeJGz+HHjH3+7otXK8uQTgiCHx N/MAn2pTreSDYOpn4KrzwXM2CJIe9OLr =PNCr -----END PGP SIGNATURE----- --nextPart101433479.frefnM8Eff-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:27:12 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8A981065683 for ; Sun, 27 Jul 2008 18:27:12 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from smtp.infidyne.com (ds9.infidyne.com [88.80.6.206]) by mx1.freebsd.org (Postfix) with ESMTP id 833FB8FC39 for ; Sun, 27 Jul 2008 18:27:12 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se (c-a916e555.03-51-73746f3.cust.bredbandsbolaget.se [85.229.22.169]) by smtp.infidyne.com (Postfix) with ESMTPSA id CB3927030C; Sun, 27 Jul 2008 20:27:11 +0200 (CEST) From: Peter Schuller To: Thomas Hurst Date: Sun, 27 Jul 2008 20:28:22 +0200 User-Agent: KMail/1.9.7 References: <200807262005.54235.peter.schuller@infidyne.com> <20080726210319.GA57383@voi.aagh.net> In-Reply-To: <20080726210319.GA57383@voi.aagh.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart1433525.BkCLED9PbG"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200807272028.22674.peter.schuller@infidyne.com> Cc: freebsd-fs@freebsd.org Subject: Re: Asynchronous writing to zvols (ZFS) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:27:12 -0000 --nextPart1433525.BkCLED9PbG Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline > WARNING: ZFS is considered to be an experimental feature in FreeBSD. > ZFS filesystem version 6 > > http://opensolaris.org/os/community/zfs/version/6/ I know of the 'version 6' bit, but that's just the on-disk format, not the= =20 version of the code base (unless I am misunderstanding something). =2D-=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --nextPart1433525.BkCLED9PbG Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEABECAAYFAkiMvkYACgkQDNor2+l1i33qRACfYnyFPITjsThPqBmO9jIj7O2c gOQAoNfBzbJLGgV3dRgOarw3wotAwPRJ =eaVX -----END PGP SIGNATURE----- --nextPart1433525.BkCLED9PbG-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:32:53 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61EFC1065674; Sun, 27 Jul 2008 18:32:53 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (unknown [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id 104EC8FC1E; Sun, 27 Jul 2008 18:32:53 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id 351FA2844E; Mon, 28 Jul 2008 02:32:52 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id B1149EC3E27; Mon, 28 Jul 2008 02:32:51 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id X5ghmgfpNIa9; Mon, 28 Jul 2008 02:32:46 +0800 (CST) Received: from charlie.delphij.net (c-69-181-135-56.hsd1.ca.comcast.net [69.181.135.56]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id 1C119EC3E23; Mon, 28 Jul 2008 02:32:44 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=galxPMoqmn72sNmfHj7TPHi1x9D183GIh5ziNl8TPSrVx14iyXPinGrV0Ogc2bMTw YzikET6mMb6ylqcd67+eQ== Message-ID: <488CBF49.10308@delphij.net> Date: Sun, 27 Jul 2008 11:32:41 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.16 (X11/20080725) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> X-Enigmail-Version: 0.95.6 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:32:53 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Great work! For the record, this has fixed all of our known problem (multithread load causes panic, non-tuned loader.conf would be fragile on heavy load, etc) with ZFS as reported at the FreeBSD mailing lists or privately to Pawel, plus there is some performance improvements as compared with FreeBSD 7-STABLE (8-CURRENT with WITNESS, INVARIANTS off but userland malloc debugging options on). Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkiMv0kACgkQi+vbBBjt66AvhACfb00igV3cmes4i4b3jgksUEZg JVUAn0vgdyfsFooYL+xY6J9jOHQkwpag =qkbL -----END PGP SIGNATURE----- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:37:36 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 106D6106567C; Sun, 27 Jul 2008 18:37:36 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.delphij.net (unknown [IPv6:2001:470:1f03:2c9::2]) by mx1.freebsd.org (Postfix) with ESMTP id B23BC8FC14; Sun, 27 Jul 2008 18:37:35 +0000 (UTC) (envelope-from delphij@delphij.net) Received: from tarsier.geekcn.org (tarsier.geekcn.org [211.166.10.233]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by tarsier.delphij.net (Postfix) with ESMTPS id D406F28448; Mon, 28 Jul 2008 02:37:34 +0800 (CST) Received: from localhost (tarsier.geekcn.org [211.166.10.233]) by tarsier.geekcn.org (Postfix) with ESMTP id 96E10EC3E1E; Mon, 28 Jul 2008 02:37:34 +0800 (CST) X-Virus-Scanned: amavisd-new at geekcn.org Received: from tarsier.geekcn.org ([211.166.10.233]) by localhost (mail.geekcn.org [211.166.10.233]) (amavisd-new, port 10024) with ESMTP id k0OSgrGmGSsw; Mon, 28 Jul 2008 02:37:30 +0800 (CST) Received: from charlie.delphij.net (c-69-181-135-56.hsd1.ca.comcast.net [69.181.135.56]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tarsier.geekcn.org (Postfix) with ESMTPSA id BE6DCEC2F60; Mon, 28 Jul 2008 02:37:28 +0800 (CST) DomainKey-Signature: a=rsa-sha1; s=default; d=delphij.net; c=nofws; q=dns; h=message-id:date:from:reply-to:organization:user-agent: mime-version:to:cc:subject:references:in-reply-to: x-enigmail-version:openpgp:content-type:content-transfer-encoding; b=aAPfV7TWwVaApR/sszXIOTJAcwQC8jI+gZlgtbbu71s3djgfr+k2PoUgQWOrpR8zb xg7JFxuafn45pCTN6P7Cg== Message-ID: <488CC066.2040800@delphij.net> Date: Sun, 27 Jul 2008 11:37:26 -0700 From: Xin LI Organization: The FreeBSD Project User-Agent: Thunderbird 2.0.0.16 (X11/20080725) MIME-Version: 1.0 To: d@delphij.net References: <20080727125413.GG1345@garage.freebsd.pl> <488CBF49.10308@delphij.net> In-Reply-To: <488CBF49.10308@delphij.net> X-Enigmail-Version: 0.95.6 OpenPGP: id=18EDEBA0; url=http://www.delphij.net/delphij.asc Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Pawel Jakub Dawidek Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: d@delphij.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:37:36 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xin LI wrote: | Great work! | | For the record, this has fixed all of our known problem (multithread | load causes panic, non-tuned loader.conf would be fragile on heavy load, | etc) with ZFS as reported at the FreeBSD mailing lists or privately to | Pawel, plus there is some performance improvements as compared with | FreeBSD 7-STABLE (8-CURRENT with WITNESS, INVARIANTS off but userland | malloc debugging options on). One note: our test environment is amd64 with 8GB of RAM; the pool is version 6. We have not done 'zpool upgrade' as we want to share it between 7.0-STABLE and 8-CURRENT for testing purposes. Cheers, - -- Xin LI http://www.delphij.net/ FreeBSD - The Power to Serve! -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkiMwGYACgkQi+vbBBjt66A4NgCfesg95cVSx4lgrRdcCKL4VipA ns4AoJi5rSx5mhzKNj2ze2EzlHuuRc9o =WSpV -----END PGP SIGNATURE----- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 18:46:38 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 97B2A106568D for ; Sun, 27 Jul 2008 18:46:38 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.179]) by mx1.freebsd.org (Postfix) with ESMTP id 313F98FC33 for ; Sun, 27 Jul 2008 18:46:38 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-060-236.pools.arcor-ip.net [88.66.60.236]) by mrelayeu.kundenserver.de (node=mrelayeu7) with ESMTP (Nemesis) id 0ML2xA-1KNB4F1WP4-0004iR; Sun, 27 Jul 2008 20:34:03 +0200 Received: (qmail 62087 invoked from network); 27 Jul 2008 18:34:01 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by mx.laiers.local with SMTP; 27 Jul 2008 18:34:01 -0000 From: Max Laier Organization: FreeBSD To: freebsd-current@freebsd.org Date: Sun, 27 Jul 2008 20:34:00 +0200 User-Agent: KMail/1.9.52 (FreeBSD/8.0-CURRENT; KDE/4.0.83; i386; ; ) References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200807272034.01290.max@love2party.net> X-Provags-ID: V01U2FsdGVkX1/3804tUdVPE/G3XMaVVv8TdgWuqzaL2r2fPEJ vhnOhDjE5lsz9zp4A/MomYcgacVyMQ99OykXw4Tgo8hAZKp6rM se4kY5tQ11SUZbC/FzC1A== Cc: freebsd-fs@freebsd.org, Pawel Jakub Dawidek Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 18:46:38 -0000 Hi Pawel, On Sunday 27 July 2008 14:54:13 Pawel Jakub Dawidek wrote: > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. nice! > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). Is this supposed to help with memory pressure on i386, too? Or do the caveats from the wiki still apply? I heard some anecdotal evidence that it would indeed help. Everybody, remember to use "patch -p0" - just bit me ... again. -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 20:26:57 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C7B341065679 for ; Sun, 27 Jul 2008 20:26:57 +0000 (UTC) (envelope-from tom@hur.st) Received: from spork.qfe3.net (spork.qfe3.net [212.13.207.101]) by mx1.freebsd.org (Postfix) with ESMTP id 8C4848FC1A for ; Sun, 27 Jul 2008 20:26:57 +0000 (UTC) (envelope-from tom@hur.st) Received: from [81.104.123.28] (helo=voi.aagh.net) by spork.qfe3.net with esmtp (Exim 4.66 (FreeBSD)) (envelope-from ) id 1KNCXO-0005XT-Mn; Sun, 27 Jul 2008 21:08:14 +0100 Received: from freaky by voi.aagh.net with local (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KNCXO-0005x5-Fi; Sun, 27 Jul 2008 21:08:14 +0100 Date: Sun, 27 Jul 2008 21:08:14 +0100 From: Thomas Hurst To: Peter Schuller Message-ID: <20080727200814.GA19914@voi.aagh.net> Mail-Followup-To: Peter Schuller , freebsd-fs@freebsd.org References: <200807262005.54235.peter.schuller@infidyne.com> <20080726210319.GA57383@voi.aagh.net> <200807272028.22674.peter.schuller@infidyne.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FCuugMFkClbJLl1L" Content-Disposition: inline In-Reply-To: <200807272028.22674.peter.schuller@infidyne.com> Organization: Not much. User-Agent: Mutt/1.5.18 (2008-05-17) Sender: Thomas Hurst Cc: freebsd-fs@freebsd.org Subject: Re: Asynchronous writing to zvols (ZFS) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 20:26:57 -0000 --FCuugMFkClbJLl1L Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable * Peter Schuller (peter.schuller@infidyne.com) wrote: > > WARNING: ZFS is considered to be an experimental feature in > > FreeBSD. ZFS filesystem version 6 > > > > http://opensolaris.org/os/community/zfs/version/6/ >=20 > I know of the 'version 6' bit, but that's just the on-disk format, not > the version of the code base (unless I am misunderstanding something). Sure, but since FreeBSD's using version 6, chances are it's using code =66rom around where it appeared in Solaris Nevada. snv_59 was using version 3, which didn't even support compression. It would be nice if this were documented, though, so we don't have to make vague guesses. --=20 Thomas 'Freaky' Hurst http://hur.st/ --FCuugMFkClbJLl1L Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkiM1a0ACgkQNBBHZ542MwQPcQCgwgprS/tYceW/cdQSppbrNhlj VmcAoIX5MgQETt8Z8pNqGT5Ffif+Xicm =Tz7m -----END PGP SIGNATURE----- --FCuugMFkClbJLl1L-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 21:24:28 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 555471065676 for ; Sun, 27 Jul 2008 21:24:28 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id D99BC8FC15 for ; Sun, 27 Jul 2008 21:24:27 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KNDj7-0007Mg-Ji for freebsd-fs@freebsd.org; Sun, 27 Jul 2008 21:24:25 +0000 Received: from 78-0-85-142.adsl.net.t-com.hr ([78.0.85.142]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sun, 27 Jul 2008 21:24:25 +0000 Received: from ivoras by 78-0-85-142.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Sun, 27 Jul 2008 21:24:25 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Ivan Voras Date: Sun, 27 Jul 2008 23:24:09 +0200 Lines: 121 Message-ID: References: <20080727125413.GG1345@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig44B0235121D6BCA8F9F89B83" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-0-85-142.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> X-Enigmail-Version: 0.95.6 Sender: news Cc: freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 21:24:28 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig44B0235121D6BCA8F9F89B83 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Pawel Jakub Dawidek wrote: > Hi. >=20 > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >=20 > The patch above contains the most recent ZFS version that could be foun= d > in OpenSolaris as of today. Apart for large amount of new functionality= , > I belive there are many stability (and also performance) improvements > compared to the version from the base system. >=20 > Check out OpenSolaris website to find out the differences between base > system version and patch version. >=20 > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. I'm trying to test it, and my build fails at an unusual place - dtrace.=20 I've verified that a clean cvsup tree compiles the dtrace modules, and=20 it fails with the same tree patched with the above patch. Any ideas? The exact command for applying the patch was: wbench:/usr/src# patch -p0 < ~ivoras/zfs_20080727.patch The failure is: =3D=3D=3D> dtmalloc (all) Warning: Object directory not changed from original=20 /usr/src/sys/modules/dtrace/dtmalloc cc -O2 -fno-strict-aliasing -pipe -Werror -D_KERNEL -DKLD_MODULE=20 -std=3Dc99 -nostdinc=20 -I/usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/compat/opensolaris=20 -I/usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/contrib/opensolaris/= uts/common=20 -I/usr/src/sys/modules/dtrace/dtmalloc/../../.. -I. -I@ -I@/contrib/altq = -finline-limit=3D8000 --param inline-unit-growth=3D100 --param=20 large-function-growth=3D1000 -fno-common -mno-align-long-strings=20 -mpreferred-stack-boundary=3D2 -mno-mmx -mno-3dnow -mno-sse -mno-sse2=20 -mno-sse3 -ffreestanding -fstack-protector -Wall -Wredundant-decls=20 -Wnested-externs -Wstrict-prototypes -Wmissing-prototypes=20 -Wpointer-arith -Winline -Wcast-qual -Wundef -Wno-pointer-sign=20 -fformat-extensions -Wno-unknown-pragmas -c=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/dev/dtmalloc/dtmalloc.= c In file included from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../sys/vnode.h:541, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/contrib/opensolaris/ut= s/common/sys/vnode.h:44, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/compat/opensolaris/sys= /vnode.h:43, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/compat/opensolaris/sys= /kobj.h:41, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../sys/linker.h:35, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/compat/opensolaris/sys= /modctl.h:34, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/contrib/opensolaris/ut= s/common/sys/dtrace.h:50, from=20 /usr/src/sys/modules/dtrace/dtmalloc/../../../cddl/dev/dtmalloc/dtmalloc.= c:35: =2E/vnode_if.h:1161: error: expected specifier-qualifier-list before=20 'acl_type_t' =2E/vnode_if.h:1174: error: expected declaration specifiers or '...'=20 before 'acl_type_t' cc1: warnings being treated as errors =2E/vnode_if.h:1177: warning: 'struct acl' declared inside parameter list= =2E/vnode_if.h:1177: warning: its scope is only this definition or=20 declaration, which is probably not what you want =2E/vnode_if.h: In function 'VOP_GETACL': =2E/vnode_if.h:1183: error: 'struct vop_getacl_args' has no member named = 'a_type' =2E/vnode_if.h:1183: error: 'type' undeclared (first use in this function= ) This is -current from a few minutes ago, i386, GENERIC kernel with=20 INVARIANTS and WITNESS (and their supporting options) removed. Excerpt from vnode_if.h: 1158 struct vop_getacl_args { 1159 struct vop_generic_args a_gen; 1160 struct vnode *a_vp; 1161 acl_type_t a_type; 1162 struct acl *a_aclp; 1163 struct ucred *a_cred; 1164 struct thread *a_td; 1165 }; --------------enig44B0235121D6BCA8F9F89B83 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIjOd/ldnAQVacBcgRAo9/AJ9G8del2ewKm3hSqaCWbiLV9hTgbwCfbJ2O P2+J8zAGDXO3WGan0nKFdXs= =mE0o -----END PGP SIGNATURE----- --------------enig44B0235121D6BCA8F9F89B83-- From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 21:46:52 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5FDC61065682 for ; Sun, 27 Jul 2008 21:46:52 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from keltia.freenix.fr (keltia.freenix.org [IPv6:2001:660:330f:f820:213:72ff:fe15:f44]) by mx1.freebsd.org (Postfix) with ESMTP id 137648FC18 for ; Sun, 27 Jul 2008 21:46:52 +0000 (UTC) (envelope-from roberto@keltia.freenix.fr) Received: from localhost (localhost [127.0.0.1]) by keltia.freenix.fr (Postfix/TLS) with ESMTP id 3926C39EAB for ; Sun, 27 Jul 2008 23:46:50 +0200 (CEST) X-Virus-Scanned: amavisd-new at keltia.freenix.fr Received: from keltia.freenix.fr ([127.0.0.1]) by localhost (keltia.freenix.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 3frxRlhS8WEu for ; Sun, 27 Jul 2008 23:46:49 +0200 (CEST) Received: by keltia.freenix.fr (Postfix/TLS, from userid 101) id E4BF939EAA; Sun, 27 Jul 2008 23:46:49 +0200 (CEST) Date: Sun, 27 Jul 2008 23:46:49 +0200 From: Ollivier Robert To: freebsd-fs@freebsd.org Message-ID: <20080727214649.GA98433@keltia.freenix.fr> References: <20080727125413.GG1345@garage.freebsd.pl> <20080727153144.GB3336@nobby.studby.ntnu.no> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20080727153144.GB3336@nobby.studby.ntnu.no> X-Operating-System: MacOS X / Macbook Pro - FreeBSD 7 / Dell D820 SMP User-Agent: Mutt/1.5.17 (2007-11-01) Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 21:46:52 -0000 According to Ulf Lilleengen: > > Is this patch against -stable or -current? > -current Has 7 & 8 diverged so much that it will not apply to 7-STABLE? -- Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto@keltia.freenix.fr Darwin sidhe.keltia.net Version 9.2.0: Tue Feb 5 16:13:22 PST 2008; i386 From owner-freebsd-fs@FreeBSD.ORG Sun Jul 27 22:56:34 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7165C1065670 for ; Sun, 27 Jul 2008 22:56:34 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from cdptpa-omtalb.mail.rr.com (cdptpa-omtalb.mail.rr.com [75.180.132.122]) by mx1.freebsd.org (Postfix) with ESMTP id 35ACA8FC17 for ; Sun, 27 Jul 2008 22:56:34 +0000 (UTC) (envelope-from morganw@chemikals.org) Received: from shop.chemikals.org ([75.182.12.58]) by cdptpa-omta03.mail.rr.com with ESMTP id <20080727225633.ZSFL4153.cdptpa-omta03.mail.rr.com@shop.chemikals.org> for ; Sun, 27 Jul 2008 22:56:33 +0000 Received: from volatile.chemikals.org (root@r74-193-170-223.bssrcmta01.bscyla.by.dh.suddenlink.net [74.193.170.223] (may be forged)) by shop.chemikals.org (8.14.1/8.14.1) with ESMTP id m6RMuWXA058588 for ; Sun, 27 Jul 2008 18:56:32 -0400 (EDT) (envelope-from morganw@chemikals.org) Received: from localhost (morganw@localhost [127.0.0.1]) by volatile.chemikals.org (8.14.2/8.14.2) with ESMTP id m6RMuUt5058530 for ; Sun, 27 Jul 2008 17:56:31 -0500 (CDT) (envelope-from morganw@chemikals.org) Date: Sun, 27 Jul 2008 17:56:30 -0500 (CDT) From: Wes Morgan To: freebsd-fs@freebsd.org In-Reply-To: <20080727214649.GA98433@keltia.freenix.fr> Message-ID: References: <20080727125413.GG1345@garage.freebsd.pl> <20080727153144.GB3336@nobby.studby.ntnu.no> <20080727214649.GA98433@keltia.freenix.fr> User-Agent: Alpine 1.10 (BSF 962 2008-03-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2008 22:56:34 -0000 On Sun, 27 Jul 2008, Ollivier Robert wrote: > According to Ulf Lilleengen: >>> Is this patch against -stable or -current? >> -current > > Has 7 & 8 diverged so much that it will not apply to 7-STABLE? > Well, the patch doesn't apply. Not sure how far they have diverged. I'd love to test it, but I stayed with 7 when it was branched to -current. From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 03:03:05 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C8E3106564A; Mon, 28 Jul 2008 03:03:05 +0000 (UTC) (envelope-from nork@FreeBSD.org) Received: from sakura.ninth-nine.com (unknown [IPv6:2001:2f0:104:80a0:230:48ff:fe41:2455]) by mx1.freebsd.org (Postfix) with ESMTP id CFEB38FC14; Mon, 28 Jul 2008 03:03:04 +0000 (UTC) (envelope-from nork@FreeBSD.org) Received: from nadesico.ninth-nine.com (nadesico.ninth-nine.com [219.127.74.122]) by sakura.ninth-nine.com (8.14.1/8.14.1/NinthNine) with SMTP id m6S332Jf081238; Mon, 28 Jul 2008 12:03:03 +0900 (JST) (envelope-from nork@FreeBSD.org) Date: Mon, 28 Jul 2008 12:03:00 +0900 From: Norikatsu Shigemura To: Pawel Jakub Dawidek Message-Id: <20080728120300.4196ea62.nork@FreeBSD.org> In-Reply-To: <20080728031115.b0ac0d07.nork@FreeBSD.org> References: <20080727125413.GG1345@garage.freebsd.pl> <20080728031115.b0ac0d07.nork@FreeBSD.org> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.0.2 (sakura.ninth-nine.com [219.127.74.121]); Mon, 28 Jul 2008 12:03:03 +0900 (JST) Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Norikatsu Shigemura Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 03:03:05 -0000 Hi pjd! I could upgrad to your new zfs environment with NO WORRY and NO TROUBLE:-). I can still boot my PC from zfs. I'll try to stress test. Thank you! From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 05:21:28 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E99F3106564A for ; Mon, 28 Jul 2008 05:21:28 +0000 (UTC) (envelope-from malus.x@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.229]) by mx1.freebsd.org (Postfix) with ESMTP id C28E88FC22 for ; Mon, 28 Jul 2008 05:21:28 +0000 (UTC) (envelope-from malus.x@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so5112097rvf.43 for ; Sun, 27 Jul 2008 22:21:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=OTGlg+pZudvyCdFV06ezQVbeOcUFQaV9pKfjj8Va2DA=; b=Mwn6DbWWMoZ8/XJMFVKATPh+S/NkYM8nP2qnYH+mBXVGyBeLzgIbgbj7TfRn+yHeZa jXKZShwPDtkos4UsShZv7NPwr/Ru70GbcOAcWKF5yZGcn7OavjTsItsZMCZXO4LbWbu9 /sfxBbRbuadzIq9KzA1AFhgKBJGvPG/yRoqAk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=b2kEvr/GYqAtojimJO3mrBF3gspiey0DpB5yOgFIZrWzFOWGybV8c2+BeyKJ2McnO9 PYnRDqJZ9znursWFgjRIqZMAZqnRwgtTr2k5n4N/gtJUpgbBqhwBhsi8yViNWfPsbzW1 aC8B49wK8p7gl9n8+JDCeA8T+bvc69btVVuRI= Received: by 10.140.201.15 with SMTP id y15mr2129117rvf.145.1217220949197; Sun, 27 Jul 2008 21:55:49 -0700 (PDT) Received: by 10.140.162.15 with HTTP; Sun, 27 Jul 2008 21:55:49 -0700 (PDT) Message-ID: Date: Mon, 28 Jul 2008 00:55:49 -0400 From: "David Grochowski" To: freebsd-current@freebsd.org, freebsd-fs@freebsd.org In-Reply-To: <20080728032427.GN79560@egr.msu.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> <20080728032427.GN79560@egr.msu.edu> Cc: Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 05:21:29 -0000 Hey, On Sun, Jul 27, 2008 at 11:24 PM, Adam McDougall wrote: > > On Sun, Jul 27, 2008 at 02:54:13PM +0200, Pawel Jakub Dawidek wrote: > > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch applied fine for me, but I get a compile error part way through > a buildworld. My world/kernel is from -current from Thursday, I also > tried csupping HEAD first, cleaning up my source tree, doing things with > headers I shouldn't (which I will revert). To the best of my weak knowledge > of C, it seems like ace_t should be fine (I tried to trace it through the > includes). Am I doing something wrong? Also, is this patch expected to > apply to 7? (I can find out for myself if I don't hear). Thanks. > > cc -O2 -pipe -I/usr/src/cddl/lib/libzpool/../../../sys/cddl/compat/opensolaris > -I/usr/src/cddl/lib/libzpool/../../../cddl/compat/opensolaris/include > -I/usr/src/cddl/lib/libzpool/../../../cddl/compat/opensolaris/lib/libumem > -I/usr/src/cddl/lib/libzpool/../../../cddl/contrib/opensolaris/lib/libzpool/common > -I/usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/sys > -I/usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs > -I/usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/common/zfs > -I/usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common > -I/usr/src/cddl/lib/libzpool/../../../cddl/contrib/opensolaris/head > -I/usr/src/cddl/lib/libzpool/../../../cddl/lib/libumem > -I/usr/src/cddl/lib/libzpool/../../../cddl/contrib/opensolaris/lib/libnvpair -DWANTS_MUTEX_OWNED > -I/usr/src/cddl/lib/libzpool/../../../lib/libpthread/thread > -I/usr/src/cddl/lib/libzpool/../../../lib/libpthread/sys > -I/usr/src/cddl/lib/libzpool/../../../lib/libthr/arch/amd64/include -fstack-protector > -Wno-unknown-pragmas -c > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:35: > error: expected ')' before '*' token > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c: > In function 'zfs_oldacl_byteswap': > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:127: > error: 'ace_t' undeclared (first use in this function) > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:127: > error: (Each undeclared identifier is reported only once > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:127: > error: for each function it appears in.) > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:129: > error: expected expression before ')' token > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c: > In function 'zfs_znode_byteswap': > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:177: > error: 'ace_t' undeclared (first use in this function) > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:177: > error: expected expression before ')' token > *** Error code 1 > > Stop in /usr/src/cddl/lib/libzpool. > *** Error code 1 > > Stop in /usr/src/cddl/lib. > *** Error code 1 > > Stop in /usr/src. > *** Error code 1 > > Stop in /usr/src. > *** Error code 1 > > Stop in /usr/src. > *** Error code 1 > > Stop in /usr/src. I had the same issue. Try deleting "/usr/src/sys/cddl/compat/opensolaris/sys/acl.h" and "/usr/src/sys/cddl/compat/opensolaris/sys/callb.h" (make sure that these files have a length of zero first!). When patching, these files are supposed to be deleted, but were instead left as empty files. Since these files are included before the actual ones in "/usr/src/sys/cddl/contrib/opensolaris/uts/common/sys", this will cause a problem. Also, I would like to note that the patch has been working for me without any problems. Sincerely, Dave Grochowski From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 08:33:06 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 74423106566B; Mon, 28 Jul 2008 08:33:06 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id CBD888FC15; Mon, 28 Jul 2008 08:33:05 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id E9C6745C8A; Mon, 28 Jul 2008 10:33:03 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BEEDD45685; Mon, 28 Jul 2008 10:32:58 +0200 (CEST) Date: Mon, 28 Jul 2008 10:33:03 +0200 From: Pawel Jakub Dawidek To: Max Laier Message-ID: <20080728083303.GD2953@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zbGR4y+acU1DwHSi" Content-Disposition: inline In-Reply-To: <200807272034.01290.max@love2party.net> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 08:33:06 -0000 --zbGR4y+acU1DwHSi Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jul 27, 2008 at 08:34:00PM +0200, Max Laier wrote: > Hi Pawel, >=20 > On Sunday 27 July 2008 14:54:13 Pawel Jakub Dawidek wrote: > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > > The patch above contains the most recent ZFS version that could be found > > in OpenSolaris as of today. Apart for large amount of new functionality, > > I belive there are many stability (and also performance) improvements > > compared to the version from the base system. >=20 > nice! >=20 > > Check out OpenSolaris website to find out the differences between base > > system version and patch version. > > > > Please test, test, test. If I get enough positive feedback, I may be > > able to squeeze it into 7.1-RELEASE, but this might be hard. > > > > If you have any questions, please use mailing lists > > (freebsd-fs@FreeBSD.org would be the best). >=20 > Is this supposed to help with memory pressure on i386, too? Or do the ca= veats=20 > from the wiki still apply? I heard some anecdotal evidence that it would= =20 > indeed help. Yes, it should fix most if not all 'kmem_map too small' panics, at least from what I tried. Tunning kmem_size is still needed to get better performance. > Everybody, remember to use "patch -p0" - just bit me ... again. Grr, forgot to mention that, sorry. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --zbGR4y+acU1DwHSi Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIjYQ/ForvXbEpPzQRAomfAKDMoK0i912osVBIfbh6V1HUCbvP+gCfZjKN 0kpFV9ndhQjhCGFMJ94J22s= =axux -----END PGP SIGNATURE----- --zbGR4y+acU1DwHSi-- From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 11:06:56 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 59214106567C for ; Mon, 28 Jul 2008 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 410F68FC28 for ; Mon, 28 Jul 2008 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m6SB6u7M078898 for ; Mon, 28 Jul 2008 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m6SB6tUK078894 for freebsd-fs@FreeBSD.org; Mon, 28 Jul 2008 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 28 Jul 2008 11:06:55 GMT Message-Id: <200807281106.m6SB6tUK078894@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-fs@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-fs@FreeBSD.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 11:06:56 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/93942 fs [vfs] [patch] panic: ufs_dirbad: bad dir (patch from D o kern/112658 fs [smbfs] [patch] smbfs and caching problems (resolves b o kern/114676 fs [ufs] snapshot creation panics: snapacct_ufs2: bad blo o kern/116170 fs [panic] Kernel panic when mounting /tmp o bin/121072 fs [smbfs] mount_smbfs(8) cannot normally convert the cha o bin/122172 fs [fs]: amd(8) automount daemon dies on 6.3-STABLE i386, o kern/122888 fs [zfs] zfs hang w/ prefetch on, zil off while running t 7 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/113049 fs [patch] [request] make quot(8) use getopt(3) and show o bin/113838 fs [patch] [request] mount(8): add support for relative p o bin/114468 fs [patch] [request] add -d option to umount(8) to detach o kern/114847 fs [ntfs] [patch] [request] dirmask support for NTFS ala o kern/114955 fs [cd9660] [patch] [request] support for mask,dirmask,ui o bin/118249 fs mv(1): moving a directory changes its mtime o kern/124621 fs [ext3] Cannot mount ext2fs partition o kern/125536 fs [ext2fs] ext 2 mounts cleanly but fails on commands li 8 problems total. From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 12:54:42 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 262AE106567D for ; Mon, 28 Jul 2008 12:54:42 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.177]) by mx1.freebsd.org (Postfix) with ESMTP id 502598FC15 for ; Mon, 28 Jul 2008 12:54:41 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-005-088.pools.arcor-ip.net [88.66.5.88]) by mrelayeu.kundenserver.de (node=mrelayeu8) with ESMTP (Nemesis) id 0ML31I-1KNSFL0QLv-0000tz; Mon, 28 Jul 2008 14:54:39 +0200 Received: (qmail 77459 invoked from network); 28 Jul 2008 12:54:37 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by mx.laiers.local with SMTP; 28 Jul 2008 12:54:37 -0000 From: Max Laier Organization: FreeBSD To: Pawel Jakub Dawidek Date: Mon, 28 Jul 2008 14:54:36 +0200 User-Agent: KMail/1.9.52 (FreeBSD/8.0-CURRENT; KDE/4.0.83; i386; ; ) References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> <20080728083303.GD2953@garage.freebsd.pl> In-Reply-To: <20080728083303.GD2953@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_MGcjIxwhfn4kObI" Message-Id: <200807281454.36892.max@love2party.net> X-Provags-ID: V01U2FsdGVkX18BkKz/nLb3z6o4KILazMsBefX8IrUxxyOzQtv p5Foo6e+VLoaWDqSQo/d9+fJyi2MkQnO+303kereKZtnK4fEzy lyF7hxtKrnnG2O1T/87Xw== Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 12:54:42 -0000 --Boundary-00=_MGcjIxwhfn4kObI Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Content-Disposition: inline On Monday 28 July 2008 10:33:03 Pawel Jakub Dawidek wrote: > On Sun, Jul 27, 2008 at 08:34:00PM +0200, Max Laier wrote: > > Hi Pawel, > > > > On Sunday 27 July 2008 14:54:13 Pawel Jakub Dawidek wrote: > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > > > > The patch above contains the most recent ZFS version that could be > > > found in OpenSolaris as of today. Apart for large amount of new > > > functionality, I belive there are many stability (and also performance) > > > improvements compared to the version from the base system. > > > > nice! > > > > > Check out OpenSolaris website to find out the differences between base > > > system version and patch version. > > > > > > Please test, test, test. If I get enough positive feedback, I may be > > > able to squeeze it into 7.1-RELEASE, but this might be hard. > > > > > > If you have any questions, please use mailing lists > > > (freebsd-fs@FreeBSD.org would be the best). > > > > Is this supposed to help with memory pressure on i386, too? Or do the > > caveats from the wiki still apply? I heard some anecdotal evidence that > > it would indeed help. > > Yes, it should fix most if not all 'kmem_map too small' panics, at least > from what I tried. Tunning kmem_size is still needed to get better > performance. With the i386 default settings it was not too hard to get the attached panic. Some cpdup and rm cycles of src and ports to a single disk zfs pool. With 512M I haven't been able to kill it, yet. > > Everybody, remember to use "patch -p0" - just bit me ... again. > > Grr, forgot to mention that, sorry. No problem, wasn't meant as criticism but as a community service rather. -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News --Boundary-00=_MGcjIxwhfn4kObI Content-Type: text/plain; charset="iso-8859-15"; name="kgdb" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="kgdb" U2NyaXB0IHN0YXJ0ZWQgb24gTW9uIEp1bCAyOCAxMzo1NTowMiAyMDA4CllvdSBoYXZlIG1haWwu DQpmYnNkOCMga2dkYiAtbiAwDQ0KR05VIGdkYiA2LjEuMSBbRnJlZUJTRF0NCkNvcHlyaWdodCAy MDA0IEZyZWUgU29mdHdhcmUgRm91bmRhdGlvbiwgSW5jLg0KR0RCIGlzIGZyZWUgc29mdHdhcmUs IGNvdmVyZWQgYnkgdGhlIEdOVSBHZW5lcmFsIFB1YmxpYyBMaWNlbnNlLCBhbmQgeW91IGFyZQ0K d2VsY29tZSB0byBjaGFuZ2UgaXQgYW5kL29yIGRpc3RyaWJ1dGUgY29waWVzIG9mIGl0IHVuZGVy IGNlcnRhaW4gY29uZGl0aW9ucy4NClR5cGUgInNob3cgY29weWluZyIgdG8gc2VlIHRoZSBjb25k aXRpb25zLg0KVGhlcmUgaXMgYWJzb2x1dGVseSBubyB3YXJyYW50eSBmb3IgR0RCLiAgVHlwZSAi c2hvdyB3YXJyYW50eSIgZm9yIGRldGFpbHMuDQpUaGlzIEdEQiB3YXMgY29uZmlndXJlZCBhcyAi aTM4Ni1tYXJjZWwtZnJlZWJzZCIuLi4NCg0KVW5yZWFkIHBvcnRpb24gb2YgdGhlIGtlcm5lbCBt ZXNzYWdlIGJ1ZmZlcjoNCnBhbmljOiBrbWVtX21hbGxvYygxMzEwNzIpOiBrbWVtX21hcCB0b28g c21hbGw6IDMzMzk2MzI2NCB0b3RhbCBhbGxvY2F0ZWQNCmNwdWlkID0gMA0KS0RCOiBlbnRlcjog cGFuaWMNClBoeXNpY2FsIG1lbW9yeTogMjAyNiBNQg0KRHVtcGluZyA0NTYgTUI6IDQ0MSA0MjUg NDA5IDM5MyAzNzcgMzYxIDM0NSAzMjkgMzEzIDI5NyAyODEgMjY1IDI0OSAyMzMgMjE3IDIwMSAx ODUgMTY5IDE1MyAxMzcgMTIxIDEwNSA4OSA3MyA1NyA0MSAyNSA5DQoNClJlYWRpbmcgc3ltYm9s cyBmcm9tIC9ib290L2tlcm5lbC96ZnMua28uLi5SZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9r ZXJuZWwvemZzLmtvLnN5bWJvbHMuLi5kb25lLg0KZG9uZS4NCkxvYWRlZCBzeW1ib2xzIGZvciAv Ym9vdC9rZXJuZWwvemZzLmtvDQpSZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwvb3Bl bnNvbGFyaXMua28uLi5SZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwvb3BlbnNvbGFy aXMua28uc3ltYm9scy4uLmRvbmUuDQpkb25lLg0KTG9hZGVkIHN5bWJvbHMgZm9yIC9ib290L2tl cm5lbC9vcGVuc29sYXJpcy5rbw0KUmVhZGluZyBzeW1ib2xzIGZyb20gL2Jvb3Qva2VybmVsL3Nu ZF9oZGEua28uLi5SZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwvc25kX2hkYS5rby5z eW1ib2xzLi4uZG9uZS4NCmRvbmUuDQpMb2FkZWQgc3ltYm9scyBmb3IgL2Jvb3Qva2VybmVsL3Nu ZF9oZGEua28NClJlYWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC9zb3VuZC5rby4uLlJl YWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC9zb3VuZC5rby5zeW1ib2xzLi4uZG9uZS4N CmRvbmUuDQpMb2FkZWQgc3ltYm9scyBmb3IgL2Jvb3Qva2VybmVsL3NvdW5kLmtvDQpSZWFkaW5n IHN5bWJvbHMgZnJvbSAvYm9vdC9tb2R1bGVzL252aWRpYS5rby4uLmRvbmUuDQpMb2FkZWQgc3lt Ym9scyBmb3IgL2Jvb3QvbW9kdWxlcy9udmlkaWEua28NClJlYWRpbmcgc3ltYm9scyBmcm9tIC9i b290L2tlcm5lbC9saW51eC5rby4uLlJlYWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC9s aW51eC5rby5zeW1ib2xzLi4uZG9uZS4NCmRvbmUuDQpMb2FkZWQgc3ltYm9scyBmb3IgL2Jvb3Qv a2VybmVsL2xpbnV4LmtvDQpSZWFkaW5nIHN5bWJvbHMgZnJvbSAvYm9vdC9rZXJuZWwvYWNwaS5r by4uLlJlYWRpbmcgc3ltYm9scyBmcm9tIC9ib290L2tlcm5lbC9hY3BpLmtvLnN5bWJvbHMuLi5k b25lLg0KZG9uZS4NCkxvYWRlZCBzeW1ib2xzIGZvciAvYm9vdC9rZXJuZWwvYWNwaS5rbw0KUmVh ZGluZyBzeW1ib2xzIGZyb20gL2Jvb3Qva2VybmVsL2xpbnByb2Nmcy5rby4uLlJlYWRpbmcgc3lt Ym9scyBmcm9tIC9ib290L2tlcm5lbC9saW5wcm9jZnMua28uc3ltYm9scy4uLmRvbmUuDQpkb25l Lg0KTG9hZGVkIHN5bWJvbHMgZm9yIC9ib290L2tlcm5lbC9saW5wcm9jZnMua28NCiMwICBkb2Fk dW1wICgpIGF0IHBjcHUuaDoxOTYNCjE5NglwY3B1Lmg6IE5vIHN1Y2ggZmlsZSBvciBkaXJlY3Rv cnkuDQoJaW4gcGNwdS5oDQooa2dkYikgd2hlcmUNCiMwICBkb2FkdW1wICgpIGF0IHBjcHUuaDox OTYNCiMxICAweGMwNDk2NDI5IGluIGRiX2ZuY2FsbCAoZHVtbXkxPS0xMDYwMDkxMzkyLCBkdW1t eTI9MCwgZHVtbXkzPTMsIA0KICAgIGR1bW15ND0weGU4NWVmNDljICJcMjAwbFwyMjPFIikgYXQg L3Vzci9zcmMvc3lzL2RkYi9kYl9jb21tYW5kLmM6NTE2DQojMiAgMHhjMDQ5NjlkOCBpbiBkYl9j b21tYW5kIChsYXN0X2NtZHA9MHhjMGM1NmVmMCwgY21kX3RhYmxlPTB4MCwgZG9wYWdlcj0xKQ0K ICAgIGF0IC91c3Ivc3JjL3N5cy9kZGIvZGJfY29tbWFuZC5jOjQxMw0KIzMgIDB4YzA0OTZiMGEg aW4gZGJfY29tbWFuZF9sb29wICgpIGF0IC91c3Ivc3JjL3N5cy9kZGIvZGJfY29tbWFuZC5jOjQ2 Ng0KIzQgIDB4YzA0OTgyZmQgaW4gZGJfdHJhcCAodHlwZT0zLCBjb2RlPTApIGF0IC91c3Ivc3Jj L3N5cy9kZGIvZGJfbWFpbi5jOjIyOA0KIzUgIDB4YzA3YmVlYTYgaW4ga2RiX3RyYXAgKHR5cGU9 MywgY29kZT0wLCB0Zj0weGU4NWVmNjQ0KQ0KICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N1YnJf a2RiLmM6NTM0DQojNiAgMHhjMGFiNWI0YiBpbiB0cmFwIChmcmFtZT0weGU4NWVmNjQ0KSBhdCAv dXNyL3NyYy9zeXMvaTM4Ni9pMzg2L3RyYXAuYzo2ODMNCiM3ICAweGMwYTk5OWFiIGluIGNhbGx0 cmFwICgpIGF0IC91c3Ivc3JjL3N5cy9pMzg2L2kzODYvZXhjZXB0aW9uLnM6MTY1DQojOCAgMHhj MDdiZjAyYSBpbiBrZGJfZW50ZXIgKHdoeT0weGMwYjQ2NzAzICJwYW5pYyIsIG1zZz0weGMwYjQ2 NzAzICJwYW5pYyIpDQogICAgYXQgY3B1ZnVuYy5oOjYwDQojOSAgMHhjMDc5MWRmYyBpbiBwYW5p YyAoDQogICAgZm10PTB4YzBiNmM0OWIgImttZW1fbWFsbG9jKCVsZCk6IGttZW1fbWFwIHRvbyBz bWFsbDogJWxkIHRvdGFsIGFsbG9jYXRlZCIpIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fc2h1 dGRvd24uYzo1NTYNCiMxMCAweGMwOWNkNTIwIGluIGttZW1fbWFsbG9jIChtYXA9MHhjMWM3MTA4 NCwgc2l6ZT0xMzEwNzIsIGZsYWdzPTIpDQogICAgYXQgL3Vzci9zcmMvc3lzL3ZtL3ZtX2tlcm4u YzozMDMNCiMxMSAweGMwOWM0Yzc3IGluIHBhZ2VfYWxsb2MgKHpvbmU9MHgwLCBieXRlcz0xMzEw NzIsIA0KICAgIHBmbGFnPTB4ZTg1ZWY3M2IgIlwwMDIiLCB3YWl0PTIpIGF0IC91c3Ivc3JjL3N5 cy92bS91bWFfY29yZS5jOjk1OQ0KIzEyIDB4YzA5YzVjZDAgaW4gdW1hX2xhcmdlX21hbGxvYyAo c2l6ZT0xMzEwNzIsIHdhaXQ9MikNCiAgICBhdCAvdXNyL3NyYy9zeXMvdm0vdW1hX2NvcmUuYzoy NzEzDQojMTMgMHhjMDc4MDk3OCBpbiBtYWxsb2MgKHNpemU9MTMxMDcyLCBtdHA9MHhjMGY0Yzlh MCwgZmxhZ3M9MikNCiAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9rZXJuX21hbGxvYy5jOjM5Mw0K LS0tVHlwZSA8cmV0dXJuPiB0byBjb250aW51ZSwgb3IgcSA8cmV0dXJuPiB0byBxdWl0LS0tDQoj MTQgMHhjMGU1YTk4MCBpbiB6ZnNfa21lbV9hbGxvYyAoc2l6ZT0xMzEwNzIsIGttZmxhZ3M9MikN CiAgICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96ZnMvLi4vLi4vY2RkbC9jb21wYXQvb3BlbnNv bGFyaXMva2Vybi9vcGVuc29sYXJpc19rbWVtLmM6NzQNCiMxNSAweGMwZWNkN2E5IGluIHppb19i dWZfYWxsb2MgKHNpemU9MTMxMDcyKQ0KICAgIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL3pmcy8u Li8uLi9jZGRsL2NvbnRyaWIvb3BlbnNvbGFyaXMvdXRzL2NvbW1vbi9mcy96ZnMvemlvLmM6MjQ4 DQojMTYgMHhjMGU2ZGRhNyBpbiBhcmNfZ2V0X2RhdGFfYnVmIChidWY9MHhkMGZkM2EyOCkNCiAg ICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96ZnMvLi4vLi4vY2RkbC9jb250cmliL29wZW5zb2xh cmlzL3V0cy9jb21tb24vZnMvemZzL2FyYy5jOjIxMzQNCiMxNyAweGMwZTZkZjE1IGluIGFyY19i dWZfYWxsb2MgKHNwYT0weGM2MDAxMDAwLCBzaXplPTEzMTA3MiwgdGFnPTB4ZDc5ZGIwODgsIA0K ICAgIHR5cGU9QVJDX0JVRkNfTUVUQURBVEEpDQogICAgYXQgL3Vzci9zcmMvc3lzL21vZHVsZXMv emZzLy4uLy4uL2NkZGwvY29udHJpYi9vcGVuc29sYXJpcy91dHMvY29tbW9uL2ZzL3pmcy9hcmMu YzoxMTQzDQojMTggMHhjMGU3MzAwNCBpbiBkYnVmX3JlYWQgKGRiPTB4ZDc5ZGIwODgsIHppbz0w eGQ5NzRjNDgwLCBmbGFncz0yKQ0KICAgIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL3pmcy8uLi8u Li9jZGRsL2NvbnRyaWIvb3BlbnNvbGFyaXMvdXRzL2NvbW1vbi9mcy96ZnMvZGJ1Zi5jOjQ4OA0K IzE5IDB4YzBlNzc4N2EgaW4gZG11X2J1Zl9ob2xkIChvcz0weGM2NDcxYzE4LCBvYmplY3Q9NDQs IG9mZnNldD0xMDYxNjgzMiwgDQogICAgdGFnPTB4YzY2MGQ4MjAsIGRicD0weGM2NjBkODUwKQ0K ICAgIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL3pmcy8uLi8uLi9jZGRsL2NvbnRyaWIvb3BlbnNv bGFyaXMvdXRzL2NvbW1vbi9mcy96ZnMvZG11LmM6MTA3DQojMjAgMHhjMGU3MGI0YiBpbiBicGxp c3RfY2FjaGUgKGJwbD0weGM2NjBkODIwLCBibGtpZD1VbmhhbmRsZWQgZHdhcmYgZXhwcmVzc2lv biBvcGNvZGUgMHg5Mw0KKQ0KICAgIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL3pmcy8uLi8uLi9j ZGRsL2NvbnRyaWIvb3BlbnNvbGFyaXMvdXRzL2NvbW1vbi9mcy96ZnMvYnBsaXN0LmM6MTM4DQoj MjEgMHhjMGU3MGJlNiBpbiBicGxpc3RfZW5xdWV1ZSAoYnBsPTB4YzY2MGQ4MjAsIGJwPTB4Y2Vh YTMwNDAsIA0KLS0tVHlwZSA8cmV0dXJuPiB0byBjb250aW51ZSwgb3IgcSA8cmV0dXJuPiB0byBx dWl0LS0tDQogICAgdHg9MHhjY2FkZTIwMCkNCiAgICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96 ZnMvLi4vLi4vY2RkbC9jb250cmliL29wZW5zb2xhcmlzL3V0cy9jb21tb24vZnMvemZzL2JwbGlz dC5jOjE5OQ0KIzIyIDB4YzBlOGUxMTEgaW4gZHNsX2RhdGFzZXRfYmxvY2tfa2lsbCAoZHM9MHhj NjYwZDgwMCwgYnA9MHhjZWFhMzA0MCwgDQogICAgcGlvPTB4ZDk1MTk2YzAsIHR4PTB4Y2NhZGUy MDApDQogICAgYXQgL3Vzci9zcmMvc3lzL21vZHVsZXMvemZzLy4uLy4uL2NkZGwvY29udHJpYi9v cGVuc29sYXJpcy91dHMvY29tbW9uL2ZzL3pmcy9kc2xfZGF0YXNldC5jOjE3MA0KIzIzIDB4YzBl ODZjYzUgaW4gZnJlZV9ibG9ja3MgKGRuPTB4ZDdmZTcxYzgsIGJwPTB4Y2VhYTMwNDAsIG51bT0x LCANCiAgICB0eD0weGNjYWRlMjAwKQ0KICAgIGF0IC91c3Ivc3JjL3N5cy9tb2R1bGVzL3pmcy8u Li8uLi9jZGRsL2NvbnRyaWIvb3BlbnNvbGFyaXMvdXRzL2NvbW1vbi9mcy96ZnMvZG5vZGVfc3lu Yy5jOjEyNQ0KIzI0IDB4YzBlODc4NmMgaW4gZG5vZGVfc3luYyAoZG49MHhkN2ZlNzFjOCwgdHg9 MHhjY2FkZTIwMCkNCiAgICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96ZnMvLi4vLi4vY2RkbC9j b250cmliL29wZW5zb2xhcmlzL3V0cy9jb21tb24vZnMvemZzL2Rub2RlX3N5bmMuYzozMjANCiMy NSAweGMwZTdkY2Y3IGluIGRtdV9vYmpzZXRfc3luY19kbm9kZXMgKGxpc3Q9MHhjNjYwZGI3Yywg dHg9MHhjY2FkZTIwMCkNCiAgICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96ZnMvLi4vLi4vY2Rk bC9jb250cmliL29wZW5zb2xhcmlzL3V0cy9jb21tb24vZnMvemZzL2RtdV9vYmpzZXQuYzo3OTEN CiMyNiAweGMwZTdkZTY2IGluIGRtdV9vYmpzZXRfc3luYyAob3M9MHhjNjYwZGEwMCwgcGlvPTB4 ZDgxMzgyNDAsIA0KICAgIHR4PTB4Y2NhZGUyMDApDQogICAgYXQgL3Vzci9zcmMvc3lzL21vZHVs ZXMvemZzLy4uLy4uL2NkZGwvY29udHJpYi9vcGVuc29sYXJpcy91dHMvY29tbW9uL2ZzL3pmcy9k bXVfb2Jqc2V0LmM6ODgyDQojMjcgMHhjMGU5MjM3OCBpbiBkc2xfcG9vbF9zeW5jIChkcD0weGM2 NzBmNDAwLCB0eGc9VW5oYW5kbGVkIGR3YXJmIGV4cHJlc3Npb24gb3Bjb2RlIDB4OTMNCikNCiAg ICBhdCAvdXNyL3NyYy9zeXMvbW9kdWxlcy96ZnMvLi4vLi4vY2RkbC9jb250cmliL29wZW5zb2xh cmlzL3V0cy9jb21tb24vZnMvemZzL2RzbF9wb29sLmM6Mjk1DQotLS1UeXBlIDxyZXR1cm4+IHRv IGNvbnRpbnVlLCBvciBxIDxyZXR1cm4+IHRvIHF1aXQtLS0NCiMyOCAweGMwZWE1MzNlIGluIHNw YV9zeW5jIChzcGE9MHhjNjAwMTAwMCwgdHhnPVVuaGFuZGxlZCBkd2FyZiBleHByZXNzaW9uIG9w Y29kZSAweDkzDQopDQogICAgYXQgL3Vzci9zcmMvc3lzL21vZHVsZXMvemZzLy4uLy4uL2NkZGwv Y29udHJpYi9vcGVuc29sYXJpcy91dHMvY29tbW9uL2ZzL3pmcy9zcGEuYzozOTM2DQojMjkgMHhj MGVhZTY2ZCBpbiB0eGdfc3luY190aHJlYWQgKGFyZz0weGM2NzBmNDAwKQ0KICAgIGF0IC91c3Iv c3JjL3N5cy9tb2R1bGVzL3pmcy8uLi8uLi9jZGRsL2NvbnRyaWIvb3BlbnNvbGFyaXMvdXRzL2Nv bW1vbi9mcy96ZnMvdHhnLmM6MzYwDQojMzAgMHhjMDc3MGJhOCBpbiBmb3JrX2V4aXQgKGNhbGxv dXQ9MHhjMGVhZTI4MCA8dHhnX3N5bmNfdGhyZWFkPiwgDQogICAgYXJnPTB4YzY3MGY0MDAsIGZy YW1lPTB4ZTg1ZWZkMzgpIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fZm9yay5jOjgxMA0KIzMx IDB4YzBhOTlhMjAgaW4gZm9ya190cmFtcG9saW5lICgpIGF0IC91c3Ivc3JjL3N5cy9pMzg2L2kz ODYvZXhjZXB0aW9uLnM6MjcwDQooa2dkYikgcQ0KZmJzZDgjIF5ECAhleGl0DQoKU2NyaXB0IGRv bmUgb24gTW9uIEp1bCAyOCAxMzo1NToyNyAyMDA4Cg== --Boundary-00=_MGcjIxwhfn4kObI-- From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 12:57:17 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id ED0DF106567B; Mon, 28 Jul 2008 12:57:17 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id 8A4E68FC23; Mon, 28 Jul 2008 12:57:17 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 1D95845B36; Mon, 28 Jul 2008 14:57:15 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id C48DC456AB; Mon, 28 Jul 2008 14:57:06 +0200 (CEST) Date: Mon, 28 Jul 2008 14:57:11 +0200 From: Pawel Jakub Dawidek To: Max Laier Message-ID: <20080728125711.GH2953@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> <20080728083303.GD2953@garage.freebsd.pl> <200807281454.36892.max@love2party.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="nFBW6CQlri5Qm8JQ" Content-Disposition: inline In-Reply-To: <200807281454.36892.max@love2party.net> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 12:57:18 -0000 --nFBW6CQlri5Qm8JQ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jul 28, 2008 at 02:54:36PM +0200, Max Laier wrote: > On Monday 28 July 2008 10:33:03 Pawel Jakub Dawidek wrote: > > Yes, it should fix most if not all 'kmem_map too small' panics, at least > > from what I tried. Tunning kmem_size is still needed to get better > > performance. >=20 > With the i386 default settings it was not too hard to get the attached pa= nic. =20 > Some cpdup and rm cycles of src and ports to a single disk zfs pool. Wit= h=20 > 512M I haven't been able to kill it, yet. I was probably too optimistic. The default kmem_size is probably just too low. I'm quite sure it would be too low even for Solaris. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --nFBW6CQlri5Qm8JQ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIjcInForvXbEpPzQRAml2AJsEuyTHdipqalyjOXKgsoYl/egUmgCgrhly fCZWeUt0yWgjylgRG7F1hOU= =OyQ3 -----END PGP SIGNATURE----- --nFBW6CQlri5Qm8JQ-- From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 13:26:29 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2053B106566C for ; Mon, 28 Jul 2008 13:26:29 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.190]) by mx1.freebsd.org (Postfix) with ESMTP id 998418FC1A for ; Mon, 28 Jul 2008 13:26:28 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: by ti-out-0910.google.com with SMTP id d27so2127450tid.3 for ; Mon, 28 Jul 2008 06:26:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=tIvOfXJoj8nYpqTGVmwtFxoAJY5SYs0UN6LY50n8Ias=; b=tXZTPEJFit4q9v1lw9Xnb6BXk45r7GAL0kaX+xVCVhNPUiRGTIfYfKmuYw7ePzy135 R4lJl4QlsphJo0AF9ApYtFXZ9xPUfTQlPvAtJ2MKRqPNXlX9VAzjUoJp1/YJXhoIOSXD m3hYTFHciTq8V+BOLIqPTgTBqJx0HStcU2oZA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=PX+Gq6KWnXixzh2fRis+9JowC49nKa2jYub+JUoVYhK+ZxiiAOaS2jLa4GBYYkRHeW MExBoOg7StIyfsqsbSwDKZIAlgs5oPctOBrnJEMsH01vwHMYBYtV1W6lDlMNI5/2Ej9T UwVzeYlI1mVPGJzfWXSROZphnGmk7lc/zUDL4= Received: by 10.110.15.19 with SMTP id 19mr5916417tio.59.1217250061029; Mon, 28 Jul 2008 06:01:01 -0700 (PDT) Received: from ?192.168.1.5? ( [124.157.244.102]) by mx.google.com with ESMTPS id j5sm9309836tid.12.2008.07.28.06.00.58 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 28 Jul 2008 06:01:00 -0700 (PDT) From: OutBackdingo To: Pawel Jakub Dawidek In-Reply-To: <20080728125711.GH2953@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> <20080728083303.GD2953@garage.freebsd.pl> <200807281454.36892.max@love2party.net> <20080728125711.GH2953@garage.freebsd.pl> Content-Type: text/plain Date: Mon, 28 Jul 2008 20:00:51 +0700 Message-Id: <1217250051.6657.0.camel@dingo-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, Max Laier , freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 13:26:29 -0000 So are we saying that i386 with a default kmem of 512MB has gotten psuedo stable with some load? On Mon, 2008-07-28 at 14:57 +0200, Pawel Jakub Dawidek wrote: > On Mon, Jul 28, 2008 at 02:54:36PM +0200, Max Laier wrote: > > On Monday 28 July 2008 10:33:03 Pawel Jakub Dawidek wrote: > > > Yes, it should fix most if not all 'kmem_map too small' panics, at least > > > from what I tried. Tunning kmem_size is still needed to get better > > > performance. > > > > With the i386 default settings it was not too hard to get the attached panic. > > Some cpdup and rm cycles of src and ports to a single disk zfs pool. With > > 512M I haven't been able to kill it, yet. > > I was probably too optimistic. The default kmem_size is probably just > too low. I'm quite sure it would be too low even for Solaris. > From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 16:15:37 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DA1F71065675 for ; Mon, 28 Jul 2008 16:15:37 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from ns1.jnielsen.net (ns1.jnielsen.net [69.55.238.237]) by mx1.freebsd.org (Postfix) with ESMTP id ADAD58FC1E for ; Mon, 28 Jul 2008 16:15:37 +0000 (UTC) (envelope-from lists@jnielsen.net) Received: from max.local (rrcs-74-218-226-253.se.biz.rr.com [74.218.226.253]) (authenticated bits=0) by ns1.jnielsen.net (8.12.9p2/8.12.9) with ESMTP id m6SFdIJP001615; Mon, 28 Jul 2008 11:39:18 -0400 (EDT) (envelope-from lists@jnielsen.net) From: John Nielsen To: freebsd-current@freebsd.org Date: Mon, 28 Jul 2008 11:39:45 -0400 User-Agent: KMail/1.9.7 References: <20080727125413.GG1345@garage.freebsd.pl> <20080728032427.GN79560@egr.msu.edu> In-Reply-To: X-Face: #X5#Y*q>F:]zT!DegL3z5Xo'^MN[$8k\[4^3rN~wm=s=Uw(sW}R?3b^*f1Wu*.<=?utf-8?q?of=5F4NrS=0A=09P*M/9CpxDo!D6?=)IY1w<9B1jB; tBQf[RU-R<,I)e"$q7N7 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200807281139.45771.lists@jnielsen.net> X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on ns1.jnielsen.net X-Virus-Status: Clean Cc: freebsd-fs@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 16:15:37 -0000 On Monday 28 July 2008, David Grochowski wrote: > Hey, > > On Sun, Jul 27, 2008 at 11:24 PM, Adam McDougall wrote: > > On Sun, Jul 27, 2008 at 02:54:13PM +0200, Pawel Jakub Dawidek wrote: > > > > > > Hi. > > > > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > > Stop in /usr/src. > > I had the same issue. Try deleting > "/usr/src/sys/cddl/compat/opensolaris/sys/acl.h" and > "/usr/src/sys/cddl/compat/opensolaris/sys/callb.h" (make sure that > these files have a length of zero first!). When patching, these files > are supposed to be deleted, but were instead left as empty files. > Since these files are included before the actual ones in > "/usr/src/sys/cddl/contrib/opensolaris/uts/common/sys", this will > cause a problem. > > Also, I would like to note that the patch has been working for me > without any problems. Thanks for pointing this out David, I had been scratching my head too. (Also thanks to those who posted reminders to use patch -p0). I'm now up and running with the patch and an upgraded zpool. No issues thus far. I even tried to reproduce the UDP NFS write lockup issue I reported recently and was unable to. Thanks PJD! JN From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 16:19:28 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 666AA1065675 for ; Mon, 28 Jul 2008 16:19:28 +0000 (UTC) (envelope-from sfourman@gmail.com) Received: from rv-out-0506.google.com (rv-out-0506.google.com [209.85.198.230]) by mx1.freebsd.org (Postfix) with ESMTP id 9A90F8FC21 for ; Mon, 28 Jul 2008 16:19:27 +0000 (UTC) (envelope-from sfourman@gmail.com) Received: by rv-out-0506.google.com with SMTP id b25so5398046rvf.43 for ; Mon, 28 Jul 2008 09:19:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=IZtx9o2VhWLxdfenR4NMaOdLIfziBVTanZaj7YiwrGM=; b=qMMQWIzK7gQR+gsWdMgKwlIVs/rfgqFEfXYT5VTs2at1JdxhI2QzMc249IcNftx04n QSXlWrHvpScuRaJ6y0tTEuqqHNxPA0zWmM8CsME19USiy3f0Ou6yHFECqiWW72kBFwXI UvYLG54hopWOWV1Pe5aJGcScpE22JdtAGwsXQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=mc3YCwiySfDQ9agMT6cztvMUS7Dx6F7dTdQ3gB9Q2QDsj2q72I8PIXcOvb+cOMaBZL 8E4WBG0IcXsTMAg/dJS792qY/zslJYOYbSwrbh8+kMJI4dJ+E6FayNxIxQq2flUs3vFU lm6bTVocqR8z8qEKwGyHPdhTn7ArZ47PzvG04= Received: by 10.141.13.16 with SMTP id q16mr2439524rvi.99.1217260386467; Mon, 28 Jul 2008 08:53:06 -0700 (PDT) Received: by 10.141.28.19 with HTTP; Mon, 28 Jul 2008 08:53:06 -0700 (PDT) Message-ID: <11167f520807280853u135eb813r20eb6d78734344b@mail.gmail.com> Date: Mon, 28 Jul 2008 10:53:06 -0500 From: "Sam Fourman Jr." To: "Pawel Jakub Dawidek" In-Reply-To: <20080728125711.GH2953@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> <20080728083303.GD2953@garage.freebsd.pl> <200807281454.36892.max@love2party.net> <20080728125711.GH2953@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, Max Laier , freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 16:19:28 -0000 > I was probably too optimistic. The default kmem_size is probably just > too low. I'm quite sure it would be too low even for Solaris. In your estimation what is a good setting for kmem_size ? Sam Fourman Jr. From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 19:50:04 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0F1C9106564A; Mon, 28 Jul 2008 19:50:04 +0000 (UTC) (envelope-from pgollucci@p6m7g8.com) Received: from EXHUB015-3.exch015.msoutlookonline.net (exhub015-3.exch015.msoutlookonline.net [207.5.72.95]) by mx1.freebsd.org (Postfix) with ESMTP id E2FCC8FC1A; Mon, 28 Jul 2008 19:50:03 +0000 (UTC) (envelope-from pgollucci@p6m7g8.com) Received: from philip.hq.rws (74.93.213.161) by smtpx15.msoutlookonline.net (207.5.72.103) with Microsoft SMTP Server (TLS) id 8.1.278.0; Mon, 28 Jul 2008 12:40:01 -0700 Message-ID: <488E2090.6020707@p6m7g8.com> Date: Mon, 28 Jul 2008 15:40:00 -0400 From: "Philip M. Gollucci" Organization: P6 Web Applications Inc. User-Agent: Thunderbird 2.0.0.12 (X11/20080414) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 19:50:04 -0000 Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). I have the go-ahead to try this on svn.apache.org and/or svn.eu.apache.org. I won't have anytime to do it until Late next week at the earliest though. From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 20:06:00 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA969106567D for ; Mon, 28 Jul 2008 20:06:00 +0000 (UTC) (envelope-from beat@chruetertee.ch) Received: from marvin.chruetertee.ch (marvin.chruetertee.ch [217.150.245.55]) by mx1.freebsd.org (Postfix) with ESMTP id 1E88D8FC22 for ; Mon, 28 Jul 2008 20:05:59 +0000 (UTC) (envelope-from beat@chruetertee.ch) Received: from daedalus.network.local (228-37.78-83.cust.bluewin.ch [83.78.37.228]) (authenticated bits=0) by marvin.chruetertee.ch (8.14.2/8.13.6) with ESMTP id m6SJtum4031579 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO) for ; Mon, 28 Jul 2008 19:55:57 GMT (envelope-from beat@chruetertee.ch) Message-ID: <488E246D.2030508@chruetertee.ch> Date: Mon, 28 Jul 2008 21:56:29 +0200 From: =?ISO-8859-1?Q?Beat_G=E4tzi?= User-Agent: Thunderbird 2.0.0.14 (X11/20080503) MIME-Version: 1.0 To: freebsd-fs@FreeBSD.org References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> X-Enigmail-Version: 0.95.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 20:06:00 -0000 Hi, Pawel Jakub Dawidek wrote: > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. Thanks for the great work! > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. I have a amd64 box with 8GB RAM running CURRENT-200806 snapshot. I get the latest version of the sources with csup, applied your patch and build the world/kernel. /usr/src and /usr/obj are located on a zfs file system. After "make installkernel" and reboot into single user mode I had to start the zfs file system but it failed: # fsck # mount -a # /etc/rc.d/hostid start Setting hostuuid: ... Setting hostid: ... # /etc/rc.d/zfs start lock order reversal: 1st 0xffffff0004832620 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2053 2nd 0xffffffff80b09da0 kernel linker (kernel linker) @ /usr/src/sys/kern/kern_linker.c:693 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a witness_checkorder() at witness_checkorder+0x609 _sx_xlock() at _sx_xlock+0x52 linker_file_lookup_set() at linker_file_lookup_set+0xe1 linker_file_register_sysctls() at linker_file_register_sysctls+0x20 linker_load_module() at linker_load_module+0x919 linker_load_dependencies() at linker_load_dependencies+0x1bc link_elf_load_file() at link_elf_load_file+0xa96 linker_load_module() at linker_load_module+0x8cf kern_kldload() at kern_kldload+0xac kldload() at kldload+0x84 syscall() at syscall+0x1bf Xfast_syscall() at Xfast_syscall+0xab --- syscall (304, FreeBSD ELF64, kldload), rip = 0x80068561c, rsp = 0x7fffffffec88, rbp = 0 --- This module (opensolaris) contains code covered by the Common Development and Distribution License (CDDL) see http://opensolaris.org/os/licensing/opensolaris_license/ WARNING: ZFS is considered to be an experimental feature in FreeBSD. ZFS filesystem version 11 ZFS storage pool version 11 internal error: out of memory internal error: out of memory internal error: out of memory internal error: out of memory Running "zpool list" shows no available pool and the "internal error: out of memory" error message. The same problem occurs in multi-user mode. loader.conf is set to: vm.kmem_size_max="2147483648" vm.kmem_size="2147483648" Increase/remove the kmem_size-values didn't change anything. To solve the problem I had to boot kernel.old and run make installworld/mergemaster. After rebooting with the new kernel the pool was available again and everything work without a problem. Did I do something wrong when I upgraded the server? Regards, Beat From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 20:23:00 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C464B106564A; Mon, 28 Jul 2008 20:23:00 +0000 (UTC) (envelope-from jorn@wcborstel.com) Received: from mail.wcborstel.com (www.wcborstel.com [82.93.93.17]) by mx1.freebsd.org (Postfix) with ESMTP id 6E41D8FC22; Mon, 28 Jul 2008 20:23:00 +0000 (UTC) (envelope-from jorn@wcborstel.com) Received: from mail.wcborstel.com (mail.wcborstel.com [10.0.2.50]) by mail.wcborstel.com (Postfix) with ESMTP id 0491874DE; Mon, 28 Jul 2008 20:03:02 +0000 (UTC) Received: by mail.wcborstel.com (Postfix, from userid 58) id D0DC374DD; Mon, 28 Jul 2008 20:03:01 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on mail.wcborstel.com X-Spam-Level: X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,AWL, SARE_SUB_OBFU_OTHER autolearn=no version=3.2.4 Received: from [10.0.1.34] (unknown [10.0.1.34]) by mail.wcborstel.com (Postfix) with ESMTP id 999E774D8; Mon, 28 Jul 2008 20:02:59 +0000 (UTC) Message-ID: <488E26C8.3040306@wcborstel.com> Date: Mon, 28 Jul 2008 22:06:32 +0200 From: Jorn Argelo User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 20:23:00 -0000 Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). > > Thank you in advance! > > First of all PJD and all of the people involved with ZFS for FreeBSD, thanks a lot for all your efforts. I'm a happy user of ZFS :-) Anyway, I was wondering ... is this patch also applicable for 7.0-RELEASE, or is it only for -CURRENT? If it's the former I'll go ahead and apply the patch to see if I run into any problems. I just don't have a kernel debugger enabled, nor do I have WITNESS in the kernel (for obvious reasons). I don't know if this is a major problem or not. Sorry for the perhaps RTFM questions - I'm usually not really into this sort of stuff, but I'd like to help out where possible. Thanks, Jorn From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 20:53:33 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A774F1065675; Mon, 28 Jul 2008 20:53:33 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id F27298FC17; Mon, 28 Jul 2008 20:53:32 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 45B5E45B36; Mon, 28 Jul 2008 22:53:31 +0200 (CEST) Received: from localhost (chello087206045140.chello.pl [87.206.45.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BF19A4569A; Mon, 28 Jul 2008 22:53:25 +0200 (CEST) Date: Mon, 28 Jul 2008 22:53:24 +0200 From: Pawel Jakub Dawidek To: Jorn Argelo Message-ID: <20080728205324.GC2740@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <488E26C8.3040306@wcborstel.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ylS2wUBXLOxYXZFQ" Content-Disposition: inline In-Reply-To: <488E26C8.3040306@wcborstel.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 20:53:33 -0000 --ylS2wUBXLOxYXZFQ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jul 28, 2008 at 10:06:32PM +0200, Jorn Argelo wrote: > Pawel Jakub Dawidek wrote: > >Hi. > > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > > >The patch above contains the most recent ZFS version that could be found > >in OpenSolaris as of today. Apart for large amount of new functionality, > >I belive there are many stability (and also performance) improvements > >compared to the version from the base system. > > > >Check out OpenSolaris website to find out the differences between base > >system version and patch version. > > > >Please test, test, test. If I get enough positive feedback, I may be > >able to squeeze it into 7.1-RELEASE, but this might be hard. > > > >If you have any questions, please use mailing lists > >(freebsd-fs@FreeBSD.org would be the best). > > > >Thank you in advance! > > > > =20 > First of all PJD and all of the people involved with ZFS for FreeBSD,=20 > thanks a lot for all your efforts. I'm a happy user of ZFS :-) >=20 > Anyway, I was wondering ... is this patch also applicable for=20 > 7.0-RELEASE, or is it only for -CURRENT? If it's the former I'll go=20 > ahead and apply the patch to see if I run into any problems. I just=20 > don't have a kernel debugger enabled, nor do I have WITNESS in the=20 > kernel (for obvious reasons). I don't know if this is a major problem or= =20 > not. >=20 > Sorry for the perhaps RTFM questions - I'm usually not really into this= =20 > sort of stuff, but I'd like to help out where possible. The patch is against HEAD and HEAD only. Don't expect patch against 7-STABLE soon. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --ylS2wUBXLOxYXZFQ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIjjHEForvXbEpPzQRApxNAKDyJShpTK0HYMXQ77Bi4QTEYGyFbQCfXIeZ Xgprr/8l3I5TV1iPiZbuG3w= =eEfS -----END PGP SIGNATURE----- --ylS2wUBXLOxYXZFQ-- From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 20:55:32 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49DF8106566B; Mon, 28 Jul 2008 20:55:32 +0000 (UTC) (envelope-from sven@dmv.com) Received: from smtp-gw-cl-c.virtdom.com (smtp-gw-cl-c.virtdom.com [216.240.97.41]) by mx1.freebsd.org (Postfix) with ESMTP id EAED98FC20; Mon, 28 Jul 2008 20:55:31 +0000 (UTC) (envelope-from sven@dmv.com) Received: from [192.168.0.101] (c-71-200-111-79.hsd1.md.comcast.net [71.200.111.79]) (authenticated bits=0) by smtp-gw-cl-c.virtdom.com (8.14.3/8.14.3) with ESMTP id m6SKPMix046965 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 28 Jul 2008 16:25:23 -0400 (EDT) (envelope-from sven@dmv.com) Message-ID: <488E2B51.2010709@dmv.com> Date: Mon, 28 Jul 2008 16:25:53 -0400 From: Sven W User-Agent: Thunderbird 2.0.0.14 (X11/20080508) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 20:55:32 -0000 Pawel Jakub Dawidek presumably uttered the following on 07/27/08 08:54: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). > > Thank you in advance! > Is there anyway to apply this to a 7.0-RELEASE-p2 cleanly? (i.e. previous patches, caveats, etc?) I would be interested in seeing if this patch fixes the issue of system locks when trying to do a large write (100+MB) to a zpool with ggate when the remote device is down). Sven From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 21:16:41 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7BC95106567B for ; Mon, 28 Jul 2008 21:16:41 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.171]) by mx1.freebsd.org (Postfix) with ESMTP id 035F08FC13 for ; Mon, 28 Jul 2008 21:16:40 +0000 (UTC) (envelope-from max@love2party.net) Received: from vampire.homelinux.org (dslb-088-066-005-088.pools.arcor-ip.net [88.66.5.88]) by mrelayeu.kundenserver.de (node=mrelayeu3) with ESMTP (Nemesis) id 0MKxQS-1KNa593SLA-0001nc; Mon, 28 Jul 2008 23:16:40 +0200 Received: (qmail 87364 invoked from network); 28 Jul 2008 21:16:38 -0000 Received: from fbsd8.laiers.local (192.168.4.151) by ns1.laiers.local with SMTP; 28 Jul 2008 21:16:38 -0000 From: Max Laier Organization: FreeBSD To: freebsd-current@freebsd.org Date: Mon, 28 Jul 2008 23:16:37 +0200 User-Agent: KMail/1.9.52 (FreeBSD/8.0-CURRENT; KDE/4.0.83; i386; ; ) References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-15" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200807282316.37722.max@love2party.net> X-Provags-ID: V01U2FsdGVkX1+IqgJh2YqF2NLKTedyraC/ZnotKK9LSDdj/LO aihn9qX50I2Zkm/znJvKY2u3NkZS4AT+XdCs+F3R1eLChZv0Y6 3hi0HNv8/GMT6ucvv2eLg== Cc: freebsd-fs@freebsd.org, Pawel Jakub Dawidek Subject: allow vs. usermount [Re: ZFS patches.] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 21:16:41 -0000 On Sunday 27 July 2008 14:54:13 Pawel Jakub Dawidek wrote: > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). Short exercise: | $ whoami | mlaier | $ zfs list | NAME USED AVAIL REFER MOUNTPOINT | tank 104K 228G 19K /tank | tank/mlaier 18K 228G 18K /tank/mlaier | $ zfs allow tank/mlaier | ------------------------------------------------------------- | Local+Descendent permissions on (tank/mlaier) | user mlaier create,destroy,mount,snapshot | ------------------------------------------------------------- | $ zfs create tank/mlaier/test | cannot mount 'tank/mlaier/test': Insufficient privileges | filesystem successfully created, but not mounted This is obviously due to the check in vfs_mount.c patched line 851: if (jailed(td->td_ucred) || usermount == 0) { the question is, should this be tuned to allow for the finer grained zfs permissions to take effect or will we force usermount to use zfs allow mount? -- /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 21:28:23 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 428011065674; Mon, 28 Jul 2008 21:28:23 +0000 (UTC) (envelope-from fbsd-fs@mawer.org) Received: from outbound.icp-qv1-irony-out1.iinet.net.au (outbound.icp-qv1-irony-out1.iinet.net.au [203.59.1.108]) by mx1.freebsd.org (Postfix) with ESMTP id 732618FC16; Mon, 28 Jul 2008 21:28:22 +0000 (UTC) (envelope-from fbsd-fs@mawer.org) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuEAAKTUjUh8qnCp/2dsb2JhbAAIixSlPQ X-IronPort-AV: E=Sophos;i="4.31,267,1215360000"; d="scan'208";a="362904582" Received: from unknown (HELO [10.4.0.197]) ([124.170.112.169]) by outbound.icp-qv1-irony-out1.iinet.net.au with ESMTP; 29 Jul 2008 05:18:07 +0800 Message-ID: <488E378B.40406@mawer.org> Date: Tue, 29 Jul 2008 07:18:03 +1000 From: Antony Mawer User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: OutBackdingo References: <20080727125413.GG1345@garage.freebsd.pl> <200807272034.01290.max@love2party.net> <20080728083303.GD2953@garage.freebsd.pl> <200807281454.36892.max@love2party.net> <20080728125711.GH2953@garage.freebsd.pl> <1217250051.6657.0.camel@dingo-laptop> In-Reply-To: <1217250051.6657.0.camel@dingo-laptop> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, Max Laier , freebsd-current@freebsd.org, Pawel Jakub Dawidek Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 21:28:23 -0000 I have a single-disk i386 system with 1GB RAM, 512MB kmem, which now appears to be perfectly stable... It's a Via Epia system (C3 1GHz) so it's not exactly high-end hardware. This is running 7-STABLE from ~16 May 2008 (without the most recent patches applied), and the following configuration in /boot/loader.conf: # Root on ZFS zfs_load="YES" vfs.root.mountfrom="zfs:tank" # Tune kernel KVA space vm.kmem_size="512M" vm.kmem_size_max="512M" # Tune ZFS arc and vdev cache sizes vfs.zfs.arc_min="16M" vfs.zfs.arc_max="40M" vfs.zfs.vdev.cache.size="5M" # Disable prefetch to improve performance vfs.zfs.prefetch_disable="1" Some of these tunings may be superfluous, but until I added them recently the box never lasted more than 2-3 days. It's now been up for 3 weeks without a panic. Kernel memory usage is comfortable: # kmem TEXT=6285036, 5.99388 MB DATA=93330432, 89.0068 MB TOTAL=99615468, 95.0007 MB The kmem script is the one posted on the FreeBSD wiki. The highest I have seen it climb is ~102mb, which to me suggests I can afford to tune the vfs.zfs.arc_max value higher (I started out with a conservatively low value and planned to tune and tweak from there based on observing kernel memory usage). --Antony OutBackdingo wrote: > So are we saying that i386 with a default kmem of 512MB has gotten > psuedo stable with some load? > > On Mon, 2008-07-28 at 14:57 +0200, Pawel Jakub Dawidek wrote: >> On Mon, Jul 28, 2008 at 02:54:36PM +0200, Max Laier wrote: >>> On Monday 28 July 2008 10:33:03 Pawel Jakub Dawidek wrote: >>>> Yes, it should fix most if not all 'kmem_map too small' panics, at least >>>> from what I tried. Tunning kmem_size is still needed to get better >>>> performance. >>> With the i386 default settings it was not too hard to get the attached panic. >>> Some cpdup and rm cycles of src and ports to a single disk zfs pool. With >>> 512M I haven't been able to kill it, yet. >> I was probably too optimistic. The default kmem_size is probably just >> too low. I'm quite sure it would be too low even for Solaris. From owner-freebsd-fs@FreeBSD.ORG Mon Jul 28 21:35:06 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 71397106566B; Mon, 28 Jul 2008 21:35:06 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id B5CAF8FC14; Mon, 28 Jul 2008 21:35:05 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0CDF3456B1; Mon, 28 Jul 2008 23:35:04 +0200 (CEST) Received: from localhost (chello087206045140.chello.pl [87.206.45.140]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 35EBF4569A; Mon, 28 Jul 2008 23:34:56 +0200 (CEST) Date: Mon, 28 Jul 2008 23:35:00 +0200 From: Pawel Jakub Dawidek To: Max Laier Message-ID: <20080728213500.GD2740@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <200807282316.37722.max@love2party.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BQPnanjtCNWHyqYD" Content-Disposition: inline In-Reply-To: <200807282316.37722.max@love2party.net> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: allow vs. usermount [Re: ZFS patches.] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2008 21:35:06 -0000 --BQPnanjtCNWHyqYD Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jul 28, 2008 at 11:16:37PM +0200, Max Laier wrote: > On Sunday 27 July 2008 14:54:13 Pawel Jakub Dawidek wrote: > > If you have any questions, please use mailing lists > > (freebsd-fs@FreeBSD.org would be the best). >=20 > Short exercise: > | $ whoami > | mlaier > | $ zfs list > | NAME USED AVAIL REFER MOUNTPOINT > | tank 104K 228G 19K /tank > | tank/mlaier 18K 228G 18K /tank/mlaier > | $ zfs allow tank/mlaier > | ------------------------------------------------------------- > | Local+Descendent permissions on (tank/mlaier) > | user mlaier create,destroy,mount,snapshot > | ------------------------------------------------------------- > | $ zfs create tank/mlaier/test > | cannot mount 'tank/mlaier/test': Insufficient privileges > | filesystem successfully created, but not mounted >=20 > This is obviously due to the check in vfs_mount.c patched line 851: >=20 > if (jailed(td->td_ucred) || usermount =3D=3D 0) { >=20 > the question is, should this be tuned to allow for the finer grained zfs= =20 > permissions to take effect or will we force usermount to use zfs allow mo= unt? Current plan is to document it in the same way ZFS within a jail is documented in zfs(8). Yes, one needs to set vfs.usermount=3D1 by hand. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --BQPnanjtCNWHyqYD Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIjjuDForvXbEpPzQRAs21AJsHhp3tQ88mp0UGQr4mxgw7OeJq5wCglQ88 +pVcs/Jo8TGatlJ5dv+/lto= =cQsh -----END PGP SIGNATURE----- --BQPnanjtCNWHyqYD-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 00:15:07 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 74CBF106566B for ; Tue, 29 Jul 2008 00:15:07 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id E74168FC18 for ; Tue, 29 Jul 2008 00:15:06 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from root by ciao.gmane.org with local (Exim 4.43) id 1KNcrm-0007b0-WA for freebsd-fs@freebsd.org; Tue, 29 Jul 2008 00:15:03 +0000 Received: from 89-172-59-21.adsl.net.t-com.hr ([89.172.59.21]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 29 Jul 2008 00:15:02 +0000 Received: from ivoras by 89-172-59-21.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 29 Jul 2008 00:15:02 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Ivan Voras Date: Tue, 29 Jul 2008 02:10:58 +0200 Lines: 72 Message-ID: References: <20080727125413.GG1345@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigA0BAA7E21CDCC347012E0BFE" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 89-172-59-21.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> X-Enigmail-Version: 0.95.6 Sender: news Cc: freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 00:15:07 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigA0BAA7E21CDCC347012E0BFE Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Pawel Jakub Dawidek wrote: > Hi. >=20 > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >=20 > The patch above contains the most recent ZFS version that could be foun= d > in OpenSolaris as of today. Apart for large amount of new functionality= , > I belive there are many stability (and also performance) improvements > compared to the version from the base system. >=20 > Check out OpenSolaris website to find out the differences between base > system version and patch version. >=20 > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. I currently don't have high-end (4 CPU+) AMD64 machines to test, but=20 with 1 CPU i386 virtual machine in VMWare, with 1 GB of memory,=20 kmem_size=3Dkmem_size_max=3D512M and no other tuning, with latest zpool=20 format (11) it took about 15 minutes to get a "kmem_map too small" panic = on a mixed load (buildkernel + blogbench + bonnie++). I've then tried the same load on the "real" hardware, 2 CPU, 2 GB=20 memory, kmem_size=3Dkmem_size_max=3D512M, and no other tuning, with the=20 older zpool format (6) i get the same panic, though it takes about twice = as long to happen. In both cases, iostat was running and I noticed there's about 30 seconds = of complete inactivity (CPU 100% idle, no IO on any drives) just before=20 the panic. Locking issue? In the second case I was also monitoring the=20 system more closely and before the inactivity period the IO bandwidth=20 gets really slow, considering the type of load I'm generating: cca 2=20 MB/s, with all tasks except bonnnie++ stopped (SIGSTOP), and bonnie++=20 generating large-block writes. This is what provoked the panic in the=20 second case. Core dumps are available, as always. But, overall, I see a definite improvement here. Before the new patch I=20 could panic the machine within a minute and now it can survive much more = beating. If the other problems (deadlocks) are solved, I'd say it's=20 worth the effort to get it in 7.1 - considering what's in 7.0, any=20 improvement helps. --------------enigA0BAA7E21CDCC347012E0BFE Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIjmATldnAQVacBcgRAt/2AKC4ZIAiZmHkA8R2dUQdmIE7KEZgGgCg8cg7 QMydE4g4+iC8TdenfyWj6nw= =qEt6 -----END PGP SIGNATURE----- --------------enigA0BAA7E21CDCC347012E0BFE-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 00:42:04 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E9BDB1065678; Tue, 29 Jul 2008 00:42:04 +0000 (UTC) (envelope-from fbsd-fs@mawer.org) Received: from outbound.icp-qv1-irony-out3.iinet.net.au (outbound.icp-qv1-irony-out3.iinet.net.au [203.59.1.148]) by mx1.freebsd.org (Postfix) with ESMTP id EDEA18FC0A; Tue, 29 Jul 2008 00:42:03 +0000 (UTC) (envelope-from fbsd-fs@mawer.org) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AuEAAN8BjkjLzq3r/2dsb2JhbAAIixWkTA X-IronPort-AV: E=Sophos;i="4.31,269,1215360000"; d="scan'208";a="295190522" Received: from unknown (HELO [10.24.1.1]) ([203.206.173.235]) by outbound.icp-qv1-irony-out3.iinet.net.au with ESMTP; 29 Jul 2008 08:31:56 +0800 Message-ID: <488E647C.7@mawer.org> Date: Tue, 29 Jul 2008 10:29:48 +1000 From: Antony Mawer User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: Ivan Voras References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 00:42:05 -0000 Ivan Voras wrote: > Pawel Jakub Dawidek wrote: >> Hi. >> >> http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >> >> The patch above contains the most recent ZFS version that could be found >> in OpenSolaris as of today. Apart for large amount of new functionality, >> I belive there are many stability (and also performance) improvements >> compared to the version from the base system. >> >> Check out OpenSolaris website to find out the differences between base >> system version and patch version. >> >> Please test, test, test. If I get enough positive feedback, I may be >> able to squeeze it into 7.1-RELEASE, but this might be hard. > > I currently don't have high-end (4 CPU+) AMD64 machines to test, but > with 1 CPU i386 virtual machine in VMWare, with 1 GB of memory, > kmem_size=kmem_size_max=512M and no other tuning, with latest zpool > format (11) it took about 15 minutes to get a "kmem_map too small" panic > on a mixed load (buildkernel + blogbench + bonnie++). > > I've then tried the same load on the "real" hardware, 2 CPU, 2 GB > memory, kmem_size=kmem_size_max=512M, and no other tuning, with the > older zpool format (6) i get the same panic, though it takes about twice > as long to happen. Have you tried tuning arc_max and/or monitoring vmstat -m to see what is happening? What does arc_max get auto-tuned to at the moment (ie. without manually specifying)? One of the things I recall reading that arc_max is more like a guide, as some ZFS threads can exceed the max whilst other thread(s) go around cleaning up and freeing memory once the limit is hit. Maybe some better smarts are needed in auto-tuning arc_max so that it leaves more of a buffer zone than it does at the moment...? --Antony From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 00:51:10 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B9DE7106564A for ; Tue, 29 Jul 2008 00:51:10 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 0BDA28FC14 for ; Tue, 29 Jul 2008 00:51:10 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KNdQi-0000Sd-Hd for freebsd-fs@freebsd.org; Tue, 29 Jul 2008 00:51:08 +0000 Received: from 89-172-59-21.adsl.net.t-com.hr ([89.172.59.21]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 29 Jul 2008 00:51:08 +0000 Received: from ivoras by 89-172-59-21.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 29 Jul 2008 00:51:08 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Ivan Voras Date: Tue, 29 Jul 2008 02:50:53 +0200 Lines: 62 Message-ID: References: <20080727125413.GG1345@garage.freebsd.pl> <488E647C.7@mawer.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig9B6970F9B2FA78EA05CFCCB7" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 89-172-59-21.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) In-Reply-To: <488E647C.7@mawer.org> X-Enigmail-Version: 0.95.6 Sender: news Cc: freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 00:51:10 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig9B6970F9B2FA78EA05CFCCB7 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Antony Mawer wrote: > Ivan Voras wrote: >> I currently don't have high-end (4 CPU+) AMD64 machines to test, but=20 >> with 1 CPU i386 virtual machine in VMWare, with 1 GB of memory,=20 >> kmem_size=3Dkmem_size_max=3D512M and no other tuning, with latest zpoo= l=20 >> format (11) it took about 15 minutes to get a "kmem_map too small"=20 >> panic on a mixed load (buildkernel + blogbench + bonnie++). >> >> I've then tried the same load on the "real" hardware, 2 CPU, 2 GB=20 >> memory, kmem_size=3Dkmem_size_max=3D512M, and no other tuning, with th= e=20 >> older zpool format (6) i get the same panic, though it takes about=20 >> twice as long to happen. >=20 > Have you tried tuning arc_max and/or monitoring vmstat -m to see what i= s=20 > happening? What does arc_max get auto-tuned to at the moment (ie.=20 > without manually specifying)? >=20 > One of the things I recall reading that arc_max is more like a guide, a= s=20 > some ZFS threads can exceed the max whilst other thread(s) go around=20 > cleaning up and freeing memory once the limit is hit. >=20 > Maybe some better smarts are needed in auto-tuning arc_max so that it=20 > leaves more of a buffer zone than it does at the moment...? I think speculation in the same direction was discussed with the=20 original port of ZFS - I don't know the details but if it arc_max could=20 be better auto-tuned, I think it should be by now. I'm more concerned about the "quiet period" before the panic. I notice=20 ZFS threads have the same priority (PRI field in top) as userland=20 threads (e.g. 44, 55...), while GEOM threads have it different (-8). I=20 don't have the McCusicks book about it so I don't know how priorities=20 whould work, but is this situation OK? I will monitor vmstate -m if it will help Pawel. Should I? --------------enig9B6970F9B2FA78EA05CFCCB7 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFIjmlzldnAQVacBcgRAvZnAJ4tBkASbaRrvFGqTDz/5d1f7PaTgQCdHTza D9T0FRoCMiScrv4wdKugRX8= =GSUG -----END PGP SIGNATURE----- --------------enig9B6970F9B2FA78EA05CFCCB7-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 01:52:36 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DE6051065684 for ; Tue, 29 Jul 2008 01:52:36 +0000 (UTC) (envelope-from mcdouga9@egr.msu.edu) Received: from mx.egr.msu.edu (surfnturf.egr.msu.edu [35.9.37.164]) by mx1.freebsd.org (Postfix) with ESMTP id B3D828FC13 for ; Tue, 29 Jul 2008 01:52:36 +0000 (UTC) (envelope-from mcdouga9@egr.msu.edu) Received: from localhost (localhost [127.0.0.1]) by mx.egr.msu.edu (Postfix) with ESMTP id E814171F2C5; Mon, 28 Jul 2008 21:36:23 -0400 (EDT) X-Virus-Scanned: amavisd-new at egr.msu.edu Received: from mx.egr.msu.edu ([127.0.0.1]) by localhost (surfnturf.egr.msu.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 4B3lYf+JTVnh; Mon, 28 Jul 2008 21:36:23 -0400 (EDT) Received: from localhost (daemon.egr.msu.edu [35.9.44.65]) by mx.egr.msu.edu (Postfix) with ESMTP id C5C0371F1B5; Mon, 28 Jul 2008 21:36:23 -0400 (EDT) Received: by localhost (Postfix, from userid 21281) id AF00B72D; Mon, 28 Jul 2008 21:36:23 -0400 (EDT) Date: Mon, 28 Jul 2008 21:36:23 -0400 From: Adam McDougall To: David Grochowski Message-ID: <20080729013623.GF79560@egr.msu.edu> References: <20080727125413.GG1345@garage.freebsd.pl> <20080728032427.GN79560@egr.msu.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 01:52:37 -0000 Thanks, that worked! My laptop is upgraded and running from it with root mounted from zfs. It seems like there is less compulsory disk activity like there used to be every ~3 seconds when idle, that is welcome. I've only ran my laptop with it about 30 minutes so far, two different boots. The first time I shut down I think I saw around 10-15 unexpected messages something like zfs_umount: force unmount not supported, removing FORCE flag. No problems though, it was probably one for each of my 13 zfs mounts. You got my vote for this to be committed to -current. I'll be loading this onto a few more systems as I get a chance, all of which I'll have to upgrade to -current and don't mind doing for a worthwhile reason, including a download mirror server and a backups server. I'll probably hold off on upgrading the fs version to 11 until I don't need to patch the source, incase I forget to on an upgrade. I do have some others running ZFS without problem that will have to wait for a 7.x patch but since they are running fine, I can wait as long as needed. On Mon, Jul 28, 2008 at 12:55:49AM -0400, David Grochowski wrote: Hey, On Sun, Jul 27, 2008 at 11:24 PM, Adam McDougall wrote: > > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:35: > error: expected ')' before '*' token > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c: > In function 'zfs_oldacl_byteswap': > /usr/src/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_byteswap.c:127: > error: 'ace_t' undeclared (first use in this function) I had the same issue. Try deleting "/usr/src/sys/cddl/compat/opensolaris/sys/acl.h" and "/usr/src/sys/cddl/compat/opensolaris/sys/callb.h" (make sure that these files have a length of zero first!). When patching, these files are supposed to be deleted, but were instead left as empty files. Since these files are included before the actual ones in "/usr/src/sys/cddl/contrib/opensolaris/uts/common/sys", this will cause a problem. Also, I would like to note that the patch has been working for me without any problems. Sincerely, Dave Grochowski _______________________________________________ freebsd-current@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-current To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 08:34:04 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0EB9F106567E; Tue, 29 Jul 2008 08:34:04 +0000 (UTC) (envelope-from remy.nonnenmacher@activnetworks.com) Received: from maiev.nerim.net (maiev.ipv6.nerim.net [IPv6:2001:7a8:1:1::89]) by mx1.freebsd.org (Postfix) with ESMTP id A4DA38FC0C; Tue, 29 Jul 2008 08:34:03 +0000 (UTC) (envelope-from remy.nonnenmacher@activnetworks.com) Received: from rn.activnetworks.com (anwadmin.net8.nerim.net [213.41.185.85]) by maiev.nerim.net (Postfix) with ESMTP id A8CCBB9DC6; Tue, 29 Jul 2008 10:34:01 +0200 (CEST) Message-ID: <488ED5F9.3090004@activnetworks.com> Date: Tue, 29 Jul 2008 10:34:01 +0200 From: Remy Nonnenmacher User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.13) Gecko/20080327 SeaMonkey/1.1.9 MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 08:34:04 -0000 Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >... > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). > > Thank you in advance! > Hello, I have updated a test machine with the patch. Before the patch, the machine was fairly stable using vm.kmem_size=1024M and vfs.zfs.arc_max=200M. After the patch, I ran a few test with the following loader.conf: vm.kmem_size="512M" vm.kmem_size_max="512M" zfs_load="YES" vfs.zfs.arc_max="100M" kern.maxvnodes="400000" I am now getting back "kmem_map too small" panics within a few minutes of cvs update of ports. If I have a look at kstat.zfs.misc.arcstats.size in the mean time, I see the following: kstat.zfs.misc.arcstats.size: 275762656 kstat.zfs.misc.arcstats.size: 279666312 kstat.zfs.misc.arcstats.size: 284994776 kstat.zfs.misc.arcstats.size: 298142184 kstat.zfs.misc.arcstats.size: 304219168 kstat.zfs.misc.arcstats.size: 312289376 kstat.zfs.misc.arcstats.size: 318243832 kstat.zfs.misc.arcstats.size: 331942168 kstat.zfs.misc.arcstats.size: 335262560 kstat.zfs.misc.arcstats.size: 344793136 kstat.zfs.misc.arcstats.size: 359504168 kstat.zfs.misc.arcstats.size: 334877376 kstat.zfs.misc.arcstats.size: 334877376 kstat.zfs.misc.arcstats.size: 334877376 kstat.zfs.misc.arcstats.size: 334877376 kstat.zfs.misc.arcstats.size: 334877376 ((panic here)) (2 seconds between reads) It seems that arc_max is ignored or arc_reclaim is not working as expected. Tanks for your work, Pawel. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 10:57:14 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D9791065675 for ; Tue, 29 Jul 2008 10:57:14 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout1.freenet.de (mout1.freenet.de [IPv6:2001:748:100:40::2:3]) by mx1.freebsd.org (Postfix) with ESMTP id 2CAEF8FC14 for ; Tue, 29 Jul 2008 10:57:14 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from [195.4.92.15] (helo=5.mx.freenet.de) by mout1.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.69 #19) id 1KNmtE-0005Jj-OX for freebsd-fs@FreeBSD.org; Tue, 29 Jul 2008 12:57:12 +0200 Received: from ra4e3.r.pppool.de ([89.54.164.227]:17548 helo=peedub.jennejohn.org) by 5.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.69 #12) id 1KNmtE-0003Js-FH for freebsd-fs@FreeBSD.org; Tue, 29 Jul 2008 12:57:12 +0200 Date: Tue, 29 Jul 2008 12:57:11 +0200 From: Gary Jennejohn To: freebsd-fs@FreeBSD.org Message-ID: <20080729125711.563b3a9a@peedub.jennejohn.org> X-Mailer: Claws Mail 3.5.0 (GTK+ 2.10.14; amd64-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 10:57:14 -0000 I now see a weird problem after upgrading to the latest ZFS. I have a filesystem which is NFS exported. Before the upgrade I could write to this FS w/o any problems. Now, after the upgrade, I see the following very strang behzvior: [on the client] cp 0001-Change-from-Keymile-to-support-CS4.patch /u7/garyj/proj/coge cp: cannot create regular file `/u7/garyj/proj/coge/0001-Change-from-Keymile-to-support-CS4.patch': Input/output error [on the server] garyj:peedub:coge:-bash:9> ll *CS4* ---------- 1 garyj tty 0 Jul 29 12:48 0001-Change-from-Keymile-to-support-CS4.patch The uid on both machines is identical. I have not changed any settings in /etc/exports or the ZFS. I also can't explain where the GID tty comes from, since earlier the GID was always garyj. If I touch the file on the server first then the cp succeeds. Very inconvenient. Any help? --- Gary Jennejohn From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 11:59:24 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D4339106568A for ; Tue, 29 Jul 2008 11:59:24 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from mout0.freenet.de (mout0.freenet.de [IPv6:2001:748:100:40::2:2]) by mx1.freebsd.org (Postfix) with ESMTP id D9A688FC16 for ; Tue, 29 Jul 2008 11:59:23 +0000 (UTC) (envelope-from gary.jennejohn@freenet.de) Received: from [195.4.92.23] (helo=13.mx.freenet.de) by mout0.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.69 #65) id 1KNnrO-0004By-Ee for freebsd-fs@freebsd.org; Tue, 29 Jul 2008 13:59:22 +0200 Received: from ra4e3.r.pppool.de ([89.54.164.227]:60958 helo=peedub.jennejohn.org) by 13.mx.freenet.de with esmtpa (ID gary.jennejohn@freenet.de) (port 25) (Exim 4.69 #12) id 1KNnrO-0000HE-6V for freebsd-fs@freebsd.org; Tue, 29 Jul 2008 13:59:22 +0200 Date: Tue, 29 Jul 2008 13:59:21 +0200 From: Gary Jennejohn To: freebsd-fs@freebsd.org Message-ID: <20080729135921.208f8925@peedub.jennejohn.org> In-Reply-To: <20080729125711.563b3a9a@peedub.jennejohn.org> References: <20080729125711.563b3a9a@peedub.jennejohn.org> X-Mailer: Claws Mail 3.5.0 (GTK+ 2.10.14; amd64-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: gary.jennejohn@freenet.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 11:59:25 -0000 On Tue, 29 Jul 2008 12:57:11 +0200 Gary Jennejohn wrote: > I now see a weird problem after upgrading to the latest ZFS. > > I have a filesystem which is NFS exported. > > Before the upgrade I could write to this FS w/o any problems. Now, > after the upgrade, I see the following very strang behzvior: > > [on the client] > cp 0001-Change-from-Keymile-to-support-CS4.patch /u7/garyj/proj/coge > cp: cannot create regular file `/u7/garyj/proj/coge/0001-Change-from-Keymile-to-support-CS4.patch': Input/output error > > [on the server] > garyj:peedub:coge:-bash:9> ll *CS4* > ---------- 1 garyj tty 0 Jul 29 12:48 0001-Change-from-Keymile-to-support-CS4.patch > > The uid on both machines is identical. I have not changed any settings > in /etc/exports or the ZFS. I also can't explain where the GID tty comes > from, since earlier the GID was always garyj. > > If I touch the file on the server first then the cp succeeds. Very > inconvenient. > > Any help? > I got it working by setting mapall in /etc/exports, but I'd still like to know why it suddenly stopped working. Maybe it had nothing to do with ZFS at all. --- Gary Jennejohn From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 12:41:38 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C8BCB106566B; Tue, 29 Jul 2008 12:41:38 +0000 (UTC) (envelope-from stefan.lambrev@moneybookers.com) Received: from blah.sun-fish.com (blah.sun-fish.com [217.18.249.150]) by mx1.freebsd.org (Postfix) with ESMTP id 77DB28FC12; Tue, 29 Jul 2008 12:41:38 +0000 (UTC) (envelope-from stefan.lambrev@moneybookers.com) Received: by blah.sun-fish.com (Postfix, from userid 1002) id 441DD1B10F55; Tue, 29 Jul 2008 14:26:28 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.2.4 (2008-01-01) on malcho.cmotd.com X-Spam-Level: X-Spam-Status: No, score=-10.6 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.2.4 Received: from hater.haters.org (hater.cmotd.com [192.168.3.125]) by blah.sun-fish.com (Postfix) with ESMTP id E5E341B10F4E; Tue, 29 Jul 2008 14:26:25 +0200 (CEST) Message-ID: <488F0C71.9010902@moneybookers.com> Date: Tue, 29 Jul 2008 15:26:25 +0300 From: Stefan Lambrev User-Agent: Thunderbird 2.0.0.14 (X11/20080616) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset=windows-1251; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.93.3/7876/Tue Jul 29 12:06:52 2008 on blah.cmotd.com X-Virus-Status: Clean Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 12:41:38 -0000 Greetings, I just got new server where I can experiment. Any ideas how to install current using only ZFS? Or I should start with UFS for root partition and then move to ZFS only? Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). > > Thank you in advance! > > -- Best Wishes, Stefan Lambrev ICQ# 24134177 From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 12:55:52 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 047A3106566B; Tue, 29 Jul 2008 12:55:52 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id E7A878FC18; Tue, 29 Jul 2008 12:55:51 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id CCFF41CC0B0; Tue, 29 Jul 2008 05:55:51 -0700 (PDT) Date: Tue, 29 Jul 2008 05:55:51 -0700 From: Jeremy Chadwick To: Stefan Lambrev Message-ID: <20080729125551.GA70379@eos.sc1.parodius.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <488F0C71.9010902@moneybookers.com> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Pawel Jakub Dawidek Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 12:55:52 -0000 On Tue, Jul 29, 2008 at 03:26:25PM +0300, Stefan Lambrev wrote: > Greetings, > > I just got new server where I can experiment. > Any ideas how to install current using only ZFS? > Or I should start with UFS for root partition and then move to ZFS only? I've written a doc on how to do this, at least for RELENG_7, although I'm willing to bet the procedure is 100% identical for CURRENT: http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 13:00:37 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1755D106564A for ; Tue, 29 Jul 2008 13:00:37 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id CEDDD8FC1A for ; Tue, 29 Jul 2008 13:00:36 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id BE0A720A5; Tue, 29 Jul 2008 15:00:35 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Rick Macklem References: Date: Tue, 29 Jul 2008 15:00:35 +0200 In-Reply-To: (Rick Macklem's message of "Wed\, 16 Jul 2008 18\:35\:07 -0400 \(EDT\)") Message-ID: <86myk06e18.fsf@ds4.des.no> User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: Which GSSAPI library does FreeBSD use? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 13:00:37 -0000 Rick Macklem writes: > Hope this isn't too simplistic for this list, but I need to know which > GSSAPI library sources are being used. They don't appear to be either > vanilla MIT nor Heimdal. Homegrown (by Doug Rabson, dfr@) with portions borrowed from Heimdal. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 13:41:00 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A368C106566C for ; Tue, 29 Jul 2008 13:41:00 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.188]) by mx1.freebsd.org (Postfix) with ESMTP id 2C9618FC14 for ; Tue, 29 Jul 2008 13:41:00 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: by ti-out-0910.google.com with SMTP id d27so2375464tid.3 for ; Tue, 29 Jul 2008 06:40:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=nBBNQo5TgHwbJ1rELIccf7Jn7498p+UDIYAgWRAj/bc=; b=txN35EL3aaFDK4x1ruRFu7yksMlWyaVu/5hlmGiCpmiVTZKq6jmXUgQi+SsZX+n9wi /F93A5BilX2gE6h1GlKbrdbTZg7+6nvhoqz3j1/25JEq9PLfWVeW5jjdluROIP3hWd9T WKgY9rxuiia5GrHnhJtI/x1dQHSNTRR2t08GM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=ZiMFOPzjyQQ7n6W1rn+F6vr4x2OtG7TImaH4Xw17P01Es0B2aeiZtFj23xVkJiWOQz vFE6dY/c5qisBdv/+TXEmI8dLHR1sflwAweMNv+JC27AgQULdeUQkORakr3bhzwQhgl4 GtpWy18ehYZN0+DtWNNrlEYFskFLU0sCYT96s= Received: by 10.110.15.19 with SMTP id 19mr7605424tio.42.1217338858878; Tue, 29 Jul 2008 06:40:58 -0700 (PDT) Received: from ?192.168.1.5? ( [124.157.244.46]) by mx.google.com with ESMTPS id i6sm12291388tid.17.2008.07.29.06.40.55 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 29 Jul 2008 06:40:57 -0700 (PDT) From: OutBackdingo To: Jeremy Chadwick In-Reply-To: <20080729125551.GA70379@eos.sc1.parodius.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> Content-Type: text/plain Date: Tue, 29 Jul 2008 20:40:52 +0700 Message-Id: <1217338852.10413.1.camel@dingo-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , Stefan Lambrev Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 13:41:00 -0000 As in the whole including boot from ZFs, not sure that code is in here yet?? had the boot code been migrated to allow for booting from a ZFS partition?? or are we still in the recommended / or /boot being on UFS On Tue, 2008-07-29 at 05:55 -0700, Jeremy Chadwick wrote: > On Tue, Jul 29, 2008 at 03:26:25PM +0300, Stefan Lambrev wrote: > > Greetings, > > > > I just got new server where I can experiment. > > Any ideas how to install current using only ZFS? > > Or I should start with UFS for root partition and then move to ZFS only? > > I've written a doc on how to do this, at least for RELENG_7, although > I'm willing to bet the procedure is 100% identical for CURRENT: > > http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool > From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 13:51:58 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5748B1065680; Tue, 29 Jul 2008 13:51:58 +0000 (UTC) (envelope-from randy@psg.com) Received: from rip.psg.com (rip.psg.com [IPv6:2001:418:1::39]) by mx1.freebsd.org (Postfix) with ESMTP id 36FD18FC17; Tue, 29 Jul 2008 13:51:58 +0000 (UTC) (envelope-from randy@psg.com) Received: from [130.129.23.134] (helo=rmac.psg.com) by rip.psg.com with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KNpcJ-000DN9-91; Tue, 29 Jul 2008 13:51:55 +0000 Message-ID: <488F2078.708@psg.com> Date: Tue, 29 Jul 2008 14:51:52 +0100 From: Randy Bush User-Agent: Thunderbird 2.0.0.16 (Macintosh/20080707) MIME-Version: 1.0 To: OutBackdingo References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> In-Reply-To: <1217338852.10413.1.camel@dingo-laptop> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, Jeremy Chadwick , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , Stefan Lambrev Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 13:51:58 -0000 OutBackdingo wrote: > As in the whole including boot from ZFs, not sure that code is in here > yet?? had the boot code been migrated to allow for booting from a ZFS > partition?? or are we still in the recommended / or /boot being on UFS >> http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool i guess you did not follow the url. boot from zfs is not supported (yet). imiho, jeremy's instrs should be combined with those on creating sliced boot gmirror. randy From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 14:17:06 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6773F1065678 for ; Tue, 29 Jul 2008 14:17:06 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from ccshst09.cs.uoguelph.ca (ccshst09.cs.uoguelph.ca [131.104.94.206]) by mx1.freebsd.org (Postfix) with ESMTP id 093C48FC1A for ; Tue, 29 Jul 2008 14:17:05 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by ccshst09.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id m6TEH0K4029316; Tue, 29 Jul 2008 10:17:02 -0400 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id m6TERwc13965; Tue, 29 Jul 2008 10:27:59 -0400 (EDT) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Tue, 29 Jul 2008 10:27:58 -0400 (EDT) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: =?utf-8?B?RGFnLUVybGluZyBTbcO4cmdyYXY=?= In-Reply-To: <86myk06e18.fsf@ds4.des.no> Message-ID: References: <86myk06e18.fsf@ds4.des.no> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="-559023410-851401618-1217341678=:12515" X-Scanned-By: MIMEDefang 2.63 on 131.104.94.206 Cc: freebsd-fs@freebsd.org Subject: Re: Which GSSAPI library does FreeBSD use? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 14:17:06 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---559023410-851401618-1217341678=:12515 Content-Type: TEXT/PLAIN; charset=utf-8; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Tue, 29 Jul 2008, Dag-Erling Sm=C3=B8rgrav wrote: > Rick Macklem writes: >> Hope this isn't too simplistic for this list, but I need to know which >> GSSAPI library sources are being used. They don't appear to be either >> vanilla MIT nor Heimdal. > > Homegrown (by Doug Rabson, dfr@) with portions borrowed from Heimdal. > Ok, thanks. I was able to work around my problem by statically linking my gssd against libraries built from vanilla Heimdal sources. It looks like it inherited the heimdal-0.6 bug, which ignores the lack of the GSS_C_SEQUENCE_FLAG and checks it even if it wasn't specified. This breaks the client side of RPCSEC_GSS, since somewhat out-of-order Sun RPCs, is normal. (RPCSEC_GSS uses a window of recent seq#s to protect against replay attempts.) Should I email Doug or submit a bug report, to see if someone is willing to work on fixing this? Thanks again, rick ---559023410-851401618-1217341678=:12515-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 15:10:10 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B65491065673 for ; Tue, 29 Jul 2008 15:10:10 +0000 (UTC) (envelope-from des@des.no) Received: from tim.des.no (tim.des.no [194.63.250.121]) by mx1.freebsd.org (Postfix) with ESMTP id 765618FC14 for ; Tue, 29 Jul 2008 15:10:10 +0000 (UTC) (envelope-from des@des.no) Received: from ds4.des.no (des.no [84.49.246.2]) by smtp.des.no (Postfix) with ESMTP id EFB0F209F; Tue, 29 Jul 2008 17:10:08 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Rick Macklem References: <86myk06e18.fsf@ds4.des.no> Date: Tue, 29 Jul 2008 17:10:08 +0200 In-Reply-To: (Rick Macklem's message of "Tue\, 29 Jul 2008 10\:27\:58 -0400 \(EDT\)") Message-ID: <86ej5c681b.fsf@ds4.des.no> User-Agent: Gnus/5.110006 (No Gnus v0.6) Emacs/23.0.60 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-fs@freebsd.org Subject: Re: Which GSSAPI library does FreeBSD use? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 15:10:10 -0000 Rick Macklem writes: > [...] It looks like [FreeBSD's libgssapi] inherited the heimdal-0.6 > bug, which ignores the lack of the GSS_C_SEQUENCE_FLAG and checks it > even if it wasn't specified. This breaks the client side of > RPCSEC_GSS, since somewhat out-of-order Sun RPCs, is normal. > (RPCSEC_GSS uses a window of recent seq#s to protect against replay > attempts.) > > Should I email Doug or submit a bug report, to see if someone is willing > to work on fixing this? You should contact Doug directly. I wonder what this has to do with filesystems, though... DES --=20 Dag-Erling Sm=C3=B8rgrav - des@des.no From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 16:11:38 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9D0C21065675 for ; Tue, 29 Jul 2008 16:11:38 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: from ti-out-0910.google.com (ti-out-0910.google.com [209.85.142.186]) by mx1.freebsd.org (Postfix) with ESMTP id 22C8E8FC20 for ; Tue, 29 Jul 2008 16:11:37 +0000 (UTC) (envelope-from outbackdingo@gmail.com) Received: by ti-out-0910.google.com with SMTP id d27so2400472tid.3 for ; Tue, 29 Jul 2008 09:11:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:subject:from:to:cc :in-reply-to:references:content-type:date:message-id:mime-version :x-mailer:content-transfer-encoding; bh=wwIttG88yDFiL1mabahEym3gGmn0oxoyTtS3n/Kkduk=; b=Zc5oAWKW9akdeUcXYj7dloaJMx+Dblwj8NXEmWGQuKeXcpx3hKw8F0YQbIo/bBUr+B FEVBTKIg4GYsaERfvEaA6LiC0HLxc9eAcOfvAqvU8aUcjyjJipLNcxLbB1jIer10s54L giulLdxP98syqh5OQB1qE278azfZ6lgbmLv2M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=subject:from:to:cc:in-reply-to:references:content-type:date :message-id:mime-version:x-mailer:content-transfer-encoding; b=X7OBHgvWbdBW6BJ4iJYLtqhuYkli87KF7svBZtmR5sOKEFQfJrVz50KdJf4XrUQDBr X3dPLoKJU3VDvTf+PoRVuYJtTirK5WzhDZwdkcoh8GS3euv3ehxg6m0BZTorOT0dSaF4 rHTtml2xpozPJ9PMQPgwh8+rQ4q/HLBXLbbTY= Received: by 10.110.93.12 with SMTP id q12mr7893229tib.16.1217347896786; Tue, 29 Jul 2008 09:11:36 -0700 (PDT) Received: from ?192.168.1.5? ( [124.157.244.46]) by mx.google.com with ESMTPS id d1sm12707822tid.11.2008.07.29.09.11.29 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 29 Jul 2008 09:11:34 -0700 (PDT) From: OutBackdingo To: Randy Bush In-Reply-To: <488F2078.708@psg.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> <488F2078.708@psg.com> Content-Type: text/plain Date: Tue, 29 Jul 2008 23:11:22 +0700 Message-Id: <1217347882.10413.5.camel@dingo-laptop> Mime-Version: 1.0 X-Mailer: Evolution 2.22.3.1 Content-Transfer-Encoding: 7bit Cc: freebsd-fs@FreeBSD.org, Jeremy Chadwick , freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , Stefan Lambrev Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 16:11:38 -0000 Maybe i should have rephrased that. Ive had a running ZFS, i thought as i was reading your version of the install guide, if the newer code drop included the boot from ZFS. seems i read it was in the perforce tree, so i guess ive answered my own qurestion, that it is not in fact in this patch On Tue, 2008-07-29 at 14:51 +0100, Randy Bush wrote: > OutBackdingo wrote: > > As in the whole including boot from ZFs, not sure that code is in here > > yet?? had the boot code been migrated to allow for booting from a ZFS > > partition?? or are we still in the recommended / or /boot being on UFS > >> http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool > > i guess you did not follow the url. > > boot from zfs is not supported (yet). > > imiho, jeremy's instrs should be combined with those on creating sliced > boot gmirror. > > randy From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 16:24:59 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 54565106566B; Tue, 29 Jul 2008 16:24:59 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from merlin.alerce.com (merlin.alerce.com [64.62.142.94]) by mx1.freebsd.org (Postfix) with ESMTP id 370F08FC1D; Tue, 29 Jul 2008 16:24:58 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from merlin.alerce.com (localhost [127.0.0.1]) by merlin.alerce.com (Postfix) with ESMTP id 3959833C62; Tue, 29 Jul 2008 09:25:18 -0700 (PDT) Received: from postfix.alerce.com (w092.z064001164.sjc-ca.dsl.cnc.net [64.1.164.92]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by merlin.alerce.com (Postfix) with ESMTP id BAD5833C5B; Tue, 29 Jul 2008 09:25:17 -0700 (PDT) Received: by postfix.alerce.com (Postfix, from userid 501) id 5A3A34953DD; Tue, 29 Jul 2008 09:24:57 -0700 (PDT) From: George Hartzell MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Message-ID: <18575.17497.248521.461931@almost.alerce.com> Date: Tue, 29 Jul 2008 09:24:57 -0700 To: freebsd-fs@FreeBSD.org, freebsd-current@freebsd.org In-Reply-To: <488E246D.2030508@chruetertee.ch> References: <20080727125413.GG1345@garage.freebsd.pl> <488E246D.2030508@chruetertee.ch> X-Mailer: VM 7.19 under Emacs 22.1.50.1 X-Virus-Scanned: ClamAV using ClamSMTP Cc: =?ISO-8859-1?Q?Beat_G=E4tzi?= Subject: Re: ZFS patches. [Problem with root on zfs and upgrading] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: hartzell@alerce.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 16:24:59 -0000 Beat G=E4tzi writes: > Hi, >=20 > Pawel Jakub Dawidek wrote: > > The patch above contains the most recent ZFS version that could be= found > > in OpenSolaris as of today. Apart for large amount of new function= ality, > > I belive there are many stability (and also performance) improveme= nts > > compared to the version from the base system. >=20 > Thanks for the great work! >=20 > > Please test, test, test. If I get enough positive feedback, I may = be > > able to squeeze it into 7.1-RELEASE, but this might be hard. >=20 > I have a amd64 box with 8GB RAM running CURRENT-200806 snapshot. I g= et > the latest version of the sources with csup, applied your patch and > build the world/kernel. > /usr/src and /usr/obj are located on a zfs file system. After "make > installkernel" and reboot into single user mode I had to start the z= fs > file system but it failed: >=20 > # fsck > # mount -a > # /etc/rc.d/hostid start > Setting hostuuid: ... > Setting hostid: ... > # /etc/rc.d/zfs start > lock order reversal: > 1st 0xffffff0004832620 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:205= 3 > 2nd 0xffffffff80b09da0 kernel linker (kernel linker) @ > /usr/src/sys/kern/kern_linker.c:693 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > witness_checkorder() at witness_checkorder+0x609 > _sx_xlock() at _sx_xlock+0x52 > linker_file_lookup_set() at linker_file_lookup_set+0xe1 > linker_file_register_sysctls() at linker_file_register_sysctls+0x20 > linker_load_module() at linker_load_module+0x919 > linker_load_dependencies() at linker_load_dependencies+0x1bc > link_elf_load_file() at link_elf_load_file+0xa96 > linker_load_module() at linker_load_module+0x8cf > kern_kldload() at kern_kldload+0xac > kldload() at kldload+0x84 > syscall() at syscall+0x1bf > Xfast_syscall() at Xfast_syscall+0xab > --- syscall (304, FreeBSD ELF64, kldload), rip =3D 0x80068561c, rsp = =3D > 0x7fffffffec88, rbp =3D 0 --- > This module (opensolaris) contains code covered by the > Common Development and Distribution License (CDDL) > see http://opensolaris.org/os/licensing/opensolaris_license/ > WARNING: ZFS is considered to be an experimental feature in FreeBSD.= > ZFS filesystem version 11 > ZFS storage pool version 11 > internal error: out of memory > internal error: out of memory > internal error: out of memory > internal error: out of memory >=20 > Running "zpool list" shows no available pool and the "internal error= : > out of memory" error message. >=20 > The same problem occurs in multi-user mode. loader.conf is set to: > vm.kmem_size_max=3D"2147483648" > vm.kmem_size=3D"2147483648" >=20 > Increase/remove the kmem_size-values didn't change anything. >=20 > To solve the problem I had to boot kernel.old and run make > installworld/mergemaster. After rebooting with the new kernel the po= ol > was available again and everything work without a problem. >=20 > Did I do something wrong when I upgraded the server? I'm being bitten by the problem that bit Beat, but worse. I'm running a root on zfs system, built using variations of Yarema's tools (which do a great job of rounding up and automating all of the little tips and tricks about putting your root on a zfs filesystem, you should read and understand what they're doing though, you'll probably need to adapt them a bit... [ http://yds.coolrat.org/zfsboot.shtml ]). I moved a computer from -STABLE up to -CURRENT via csup and rebuilt everything to convince myself that the upgrade went well. Then I applied Pawel's patch (-p0 -E), and: make buildworld make buildkernel KERNCONF=3DBLUETOO make installkernel KERNCONF=3DBLUETOO and rebooted. I planned to drop down to single user and do the mergemaster/installworld. When I try to boot multi user things go south and it's clear that /usr et al. is missing. I can boot my new kernel single user and my root gets mounted from my zpool, but none of my other zfs filesystems are mounted, and when I try to run zfs list or zpool status I got the same out of memory message that Beat sees. The ZFS filesystem and pool are at version 11 (seen scrolling by on the console). I suspect that my newer kernel isn't cooperating with the older userland utilities which prevents the filesystems from being mounted. I tried to boot from kernel.old, but I end up at the mountroot prompt and can't mount my root. Presumably since my pool has been automagically upgraded to version 11 I can no longer mount my root using kernel.old, so Beat's end-run won't help me. There's nothing I care about on the machine, just the time it took to csup and build and such, so if I have to scrag it and start over it's not a the end of the world. Maybe someone could make an patched copy of /sbin/zfs (and whatever dependencies it has into /lib, etc...) available and I could drop them onto a usb key and use some combination of PATH and LD_LIBRARY_PATH to use them to get my /usr etc... mounted? Or I could build up another machine to the same patched point, do the buildworld and buildkernel, then use that to make a patched bootable usb drive. That'll take a while to free up the extra hardware though. g. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 16:36:31 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 536711065670; Tue, 29 Jul 2008 16:36:31 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from merlin.alerce.com (merlin.alerce.com [64.62.142.94]) by mx1.freebsd.org (Postfix) with ESMTP id 373C58FC15; Tue, 29 Jul 2008 16:36:31 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from merlin.alerce.com (localhost [127.0.0.1]) by merlin.alerce.com (Postfix) with ESMTP id A9E4533C62; Tue, 29 Jul 2008 09:36:50 -0700 (PDT) Received: from postfix.alerce.com (w092.z064001164.sjc-ca.dsl.cnc.net [64.1.164.92]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by merlin.alerce.com (Postfix) with ESMTP id 7127433C5B; Tue, 29 Jul 2008 09:36:50 -0700 (PDT) Received: by postfix.alerce.com (Postfix, from userid 501) id 4CBB6495406; Tue, 29 Jul 2008 09:36:30 -0700 (PDT) From: George Hartzell MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <18575.18190.242505.359259@almost.alerce.com> Date: Tue, 29 Jul 2008 09:36:30 -0700 To: Stefan Lambrev In-Reply-To: <488F0C71.9010902@moneybookers.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> X-Mailer: VM 7.19 under Emacs 22.1.50.1 X-Virus-Scanned: ClamAV using ClamSMTP Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Pawel Jakub Dawidek Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: hartzell@alerce.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 16:36:31 -0000 Stefan Lambrev writes: > Greetings, > > I just got new server where I can experiment. > Any ideas how to install current using only ZFS? > Or I should start with UFS for root partition and then move to ZFS only? > Check out the tools that Yarema's put together: http://yds.coolrat.org/zfsboot.shtml You should read through them, you may need to change e.g. where you have the install CD mounted, and you'll probably want to change the list of zfs filesystems that get built, but the tools do a great job of collecting all of the little secrets for building a zfs on root system. BUT, be careful about trying to pick up and apply Pawel's latest patches. I'm currently wedged with a new kernel and automagically upgraded zfs pool and an old userland that can't cope. I can't mount my various /usr, /usr/src, etc... filesystems so I can't installworld with the patched stuff. Catch-22. Fortunately the box was set up for just this experiment.... g. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 17:49:06 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DB5721065683; Tue, 29 Jul 2008 17:49:05 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from mail.cyrusharmon.org (mail.cyrusharmon.org [64.62.142.89]) by mx1.freebsd.org (Postfix) with ESMTP id BF1B68FC24; Tue, 29 Jul 2008 17:49:05 +0000 (UTC) (envelope-from hartzell@alerce.com) Received: from mail.cyrusharmon.org (localhost [127.0.0.1]) by mail.cyrusharmon.org (Postfix) with ESMTP id 254091CC42; Tue, 29 Jul 2008 10:24:53 -0700 (PDT) Received: from [192.168.42.32] (w092.z064001164.sjc-ca.dsl.cnc.net [64.1.164.92]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mail.cyrusharmon.org (Postfix) with ESMTP id B599F1CC3E; Tue, 29 Jul 2008 10:24:52 -0700 (PDT) From: George Hartzell To: freebsd-fs@FreeBSD.org In-Reply-To: <18575.17497.248521.461931@almost.alerce.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488E246D.2030508@chruetertee.ch> <18575.17497.248521.461931@almost.alerce.com> Content-Type: text/plain; charset=ISO-8859-1 Date: Tue, 29 Jul 2008 10:26:05 -0700 Message-Id: <1217352365.3554.3.camel@delicious> Mime-Version: 1.0 X-Mailer: Evolution 2.22.1.1 FreeBSD GNOME Team Port Content-Transfer-Encoding: 8bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: Beat =?ISO-8859-1?Q?G=E4tzi?= , freebsd-current@freebsd.org Subject: Re: ZFS patches. [Problem with root on zfs and upgrading] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 17:49:06 -0000 On Tue, 2008-07-29 at 09:24 -0700, George Hartzell wrote: > Beat Gätzi writes: > > Hi, > > > > Pawel Jakub Dawidek wrote: > > > The patch above contains the most recent ZFS version that could be found > > > in OpenSolaris as of today. Apart for large amount of new functionality, > > > I belive there are many stability (and also performance) improvements > > > compared to the version from the base system. > > > > Thanks for the great work! > > > > > Please test, test, test. If I get enough positive feedback, I may be > > > able to squeeze it into 7.1-RELEASE, but this might be hard. > > > > I have a amd64 box with 8GB RAM running CURRENT-200806 snapshot. I get > > the latest version of the sources with csup, applied your patch and > > build the world/kernel. > > /usr/src and /usr/obj are located on a zfs file system. After "make > > installkernel" and reboot into single user mode I had to start the zfs > > file system but it failed: > > > > # fsck > > # mount -a > > # /etc/rc.d/hostid start > > Setting hostuuid: ... > > Setting hostid: ... > > # /etc/rc.d/zfs start > > lock order reversal: > > 1st 0xffffff0004832620 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2053 > > 2nd 0xffffffff80b09da0 kernel linker (kernel linker) @ > > /usr/src/sys/kern/kern_linker.c:693 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2a > > witness_checkorder() at witness_checkorder+0x609 > > _sx_xlock() at _sx_xlock+0x52 > > linker_file_lookup_set() at linker_file_lookup_set+0xe1 > > linker_file_register_sysctls() at linker_file_register_sysctls+0x20 > > linker_load_module() at linker_load_module+0x919 > > linker_load_dependencies() at linker_load_dependencies+0x1bc > > link_elf_load_file() at link_elf_load_file+0xa96 > > linker_load_module() at linker_load_module+0x8cf > > kern_kldload() at kern_kldload+0xac > > kldload() at kldload+0x84 > > syscall() at syscall+0x1bf > > Xfast_syscall() at Xfast_syscall+0xab > > --- syscall (304, FreeBSD ELF64, kldload), rip = 0x80068561c, rsp = > > 0x7fffffffec88, rbp = 0 --- > > This module (opensolaris) contains code covered by the > > Common Development and Distribution License (CDDL) > > see http://opensolaris.org/os/licensing/opensolaris_license/ > > WARNING: ZFS is considered to be an experimental feature in FreeBSD. > > ZFS filesystem version 11 > > ZFS storage pool version 11 > > internal error: out of memory > > internal error: out of memory > > internal error: out of memory > > internal error: out of memory > > > > Running "zpool list" shows no available pool and the "internal error: > > out of memory" error message. > > > > The same problem occurs in multi-user mode. loader.conf is set to: > > vm.kmem_size_max="2147483648" > > vm.kmem_size="2147483648" > > > > Increase/remove the kmem_size-values didn't change anything. > > > > To solve the problem I had to boot kernel.old and run make > > installworld/mergemaster. After rebooting with the new kernel the pool > > was available again and everything work without a problem. > > > > Did I do something wrong when I upgraded the server? > > I'm being bitten by the problem that bit Beat, but worse. > > I'm running a root on zfs system, built using variations of Yarema's > tools (which do a great job of rounding up and automating all of the > little tips and tricks about putting your root on a zfs filesystem, > you should read and understand what they're doing though, you'll > probably need to adapt them a bit... > [ http://yds.coolrat.org/zfsboot.shtml ]). > > I moved a computer from -STABLE up to -CURRENT via csup and rebuilt > everything to convince myself that the upgrade went well. > > Then I applied Pawel's patch (-p0 -E), and: > > make buildworld > make buildkernel KERNCONF=BLUETOO > make installkernel KERNCONF=BLUETOO > > and rebooted. I planned to drop down to single user and do the > mergemaster/installworld. > > When I try to boot multi user things go south and it's clear that /usr > et al. is missing. > > I can boot my new kernel single user and my root gets mounted from my > zpool, but none of my other zfs filesystems are mounted, and when I > try to run zfs list or zpool status I got the same out of memory > message that Beat sees. > > The ZFS filesystem and pool are at version 11 (seen scrolling by on > the console). > > I suspect that my newer kernel isn't cooperating with the older > userland utilities which prevents the filesystems from being mounted. > > I tried to boot from kernel.old, but I end up at the mountroot prompt > and can't mount my root. Presumably since my pool has been > automagically upgraded to version 11 I can no longer mount my root > using kernel.old, so Beat's end-run won't help me. > > There's nothing I care about on the machine, just the time it took to > csup and build and such, so if I have to scrag it and start over it's > not a the end of the world. > > Maybe someone could make an patched copy of /sbin/zfs (and whatever > dependencies it has into /lib, etc...) available and I could drop them > onto a usb key and use some combination of PATH and LD_LIBRARY_PATH to > use them to get my /usr etc... mounted? > > Or I could build up another machine to the same patched point, do the > buildworld and buildkernel, then use that to make a patched bootable > usb drive. That'll take a while to free up the extra hardware though. It turns out that I can boot into single user with the new kernel and then mount the zfs filesystems by hand, like this: mount -t zfs z/usr /usr Just need to do it (little scripting on a similar system helps) for the 43 zfs filesystems that yarema's tool set up and I'm booted multi-user with Pawel's new patches. phew. g. From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 19:49:29 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E35D2106567B for ; Tue, 29 Jul 2008 19:49:29 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from yw-out-2324.google.com (yw-out-2324.google.com [74.125.46.28]) by mx1.freebsd.org (Postfix) with ESMTP id 8F4C18FC15 for ; Tue, 29 Jul 2008 19:49:29 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by yw-out-2324.google.com with SMTP id 9so19032ywe.13 for ; Tue, 29 Jul 2008 12:49:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=NLNvCeGUyGrnBmo/q4fW5537CwkLWmQGrb07fWtQnx4=; b=R2jxMXncny5ilXiJVQd92+XCP4EY4E4LK8IXvCsbEE+zDPd60cQF1s7nc9dA7FL9d4 XuyKsaF20TiFCPtkBqr2ce3zg6HDJaIV9V/3kzG3zT4rLFu3QmgICytAcmhradSTTG3k mojL32ecIPjnOklr8HLnVzr67D+fGa1AQCkEI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=D2tz6W7JWC5V6lq1Qod+13sOxlI8qSJKx0JGOn/v+96NhYAowbm66NN+ZzWEOOSaaU LYMJz8j7TCSO2SBGkTzJcHFNXZmk6shXXjeAiHNFzGPj9tXtI5j6+6YxFbbEwNI5FN4u uJYhSR6LB3r/jRqTaL6yfD4+3tWASeqVYDM6A= Received: by 10.141.151.18 with SMTP id d18mr226830rvo.75.1217359393676; Tue, 29 Jul 2008 12:23:13 -0700 (PDT) Received: by 10.150.12.12 with HTTP; Tue, 29 Jul 2008 12:23:13 -0700 (PDT) Message-ID: <5f67a8c40807291223j52f0ccf7r27021bf882b13ad6@mail.gmail.com> Date: Tue, 29 Jul 2008 15:23:13 -0400 From: "Zaphod Beeblebrox" To: "Pawel Jakub Dawidek" In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 References: <20080727125413.GG1345@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 19:49:30 -0000 On Sun, Jul 27, 2008 at 8:54 AM, Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. If the near term goal is to have this in 7.1, it may help to post a patch that works with 7-STABLE to test. I've tried several bits of advice from this thread to compile it. I even nuked my src tree and pulled a virgin one from cvsup. Right now, on 7-STABLE, it stops at: cc -O2 -fno-strict-aliasing -pipe -DZFS_NO_ACL -I/usr/src/cddl/lib/libzfs/../../../sbin/mount -I/usr/src/cddl/lib/libzfs/../../../cddl/lib/libumem -I/usr/src/cddl/lib/libzfs/../../../sys/cddl/compat/opensolaris -I/usr/src/cddl/lib/libzfs/../../../cddl/compat/opensolaris/include -I/usr/src/cddl/lib/libzfs/../../../cddl/compat/opensolaris/lib/libumem -I/usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libzpool/common -I/usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/common/zfs -I/usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs -I/usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/sys -I/usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/head -I/usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common -I/usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libnvpair -I/usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libuutil/common -I/usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libzfs/common -D_SOLARIS_C_SOURCE -c /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/common/zfs/zfs_prop.c In file included from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/sys/u8_textprep.h:31, from /usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libzpool/common/sys/zfs_context.h:83, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/sys/zio.h:32, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/common/zfs/zfs_prop.c:28: /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/sys/isa_defs.h:232:1: warning: "_LITTLE_ENDIAN" redefined In file included from /usr/src/cddl/lib/libzfs/../../../sys/cddl/compat/opensolaris/machine/endian.h:32, from /usr/obj/usr/src/tmp/usr/include/sys/types.h:44, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/compat/opensolaris/sys/types.h:37, from /usr/obj/usr/src/tmp/usr/include/unistd.h:41, from /usr/src/cddl/lib/libzfs/../../../cddl/contrib/opensolaris/lib/libzpool/common/sys/zfs_context.h:53, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/sys/zio.h:32, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/common/zfs/zfs_prop.c:28: /usr/obj/usr/src/tmp/usr/include/machine/endian.h:53:1: warning: this is the location of the previous definition In file included from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/sys/zfs_acl.h:34, from /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/common/zfs/zfs_prop.c:31: /usr/src/cddl/lib/libzfs/../../../sys/cddl/contrib/opensolaris/uts/common/sys/acl.h:42: error: expected specifier-qualifier-list before 'o_mode_t' *** Error code 1 Stop in /usr/src/cddl/lib/libzfs. *** Error code 1 From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 20:17:25 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 91815106564A; Tue, 29 Jul 2008 20:17:25 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id 783A18FC0A; Tue, 29 Jul 2008 20:17:25 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id 41C621CC0AB; Tue, 29 Jul 2008 13:17:25 -0700 (PDT) Date: Tue, 29 Jul 2008 13:17:25 -0700 From: Jeremy Chadwick To: OutBackdingo Message-ID: <20080729201725.GA89512@eos.sc1.parodius.com> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> <488F2078.708@psg.com> <1217347882.10413.5.camel@dingo-laptop> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1217347882.10413.5.camel@dingo-laptop> User-Agent: Mutt/1.5.18 (2008-05-17) Cc: Randy Bush , freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org, Pawel Jakub Dawidek , Stefan Lambrev Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 20:17:25 -0000 On Tue, Jul 29, 2008 at 11:11:22PM +0700, OutBackdingo wrote: > Maybe i should have rephrased that. Ive had a running ZFS, i thought as > i was reading your version of the install guide, if the newer code drop > included the boot from ZFS. seems i read it was in the perforce tree, so > i guess ive answered my own qurestion, that it is not in fact in this > patch > > On Tue, 2008-07-29 at 14:51 +0100, Randy Bush wrote: > > OutBackdingo wrote: > > > As in the whole including boot from ZFs, not sure that code is in here > > > yet?? had the boot code been migrated to allow for booting from a ZFS > > > partition?? or are we still in the recommended / or /boot being on UFS > > >> http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool > > > > i guess you did not follow the url. > > > > boot from zfs is not supported (yet). > > > > imiho, jeremy's instrs should be combined with those on creating sliced > > boot gmirror. > > > > randy I believe it is possible (with or without the patch) to boot purely off of ZFS. The ish.com.au document describes how to do this in "Step Three: solving the ZFS boot problem". https://www.ish.com.au/solutions/articles/freebsdzfs I simply choose not to utilise that method. I'm a bit paranoid about non-UFS root filesystems. My main concern revolves around booting into single-user, which is an important part of the whole build/install world process -- does it actually work with ZFS as a root fs, and if so, is any sort of craziness required to accomplish it? -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB | From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 21:11:56 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1841D106564A; Tue, 29 Jul 2008 21:11:56 +0000 (UTC) (envelope-from lulf@freebsd.org) Received: from bene2.itea.ntnu.no (bene2.itea.ntnu.no [IPv6:2001:700:300:3::57]) by mx1.freebsd.org (Postfix) with ESMTP id 0E0B48FC19; Tue, 29 Jul 2008 21:11:55 +0000 (UTC) (envelope-from lulf@freebsd.org) Received: from localhost (localhost [127.0.0.1]) by bene2.itea.ntnu.no (Postfix) with ESMTP id D95FD90005; Tue, 29 Jul 2008 23:11:52 +0200 (CEST) Received: from nobby.studby.ntnu.no (unknown [IPv6:2001:700:300:3::184]) by bene2.itea.ntnu.no (Postfix) with ESMTP id 113F090004; Tue, 29 Jul 2008 23:11:52 +0200 (CEST) Date: Tue, 29 Jul 2008 23:11:37 +0200 From: Ulf Lilleengen To: OutBackdingo Message-ID: <20080729211137.GA52154@nobby.studby.ntnu.no> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> <488F2078.708@psg.com> <1217347882.10413.5.camel@dingo-laptop> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="EeQfGwPcQSOJBaQU" Content-Disposition: inline In-Reply-To: <1217347882.10413.5.camel@dingo-laptop> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene2.itea.ntnu.no Cc: freebsd-fs@FreeBSD.org, Pawel Jakub Dawidek , Jeremy Chadwick , Stefan Lambrev , Randy Bush , freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 21:11:56 -0000 --EeQfGwPcQSOJBaQU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On tir, jul 29, 2008 at 11:11:22pm +0700, OutBackdingo wrote: > Maybe i should have rephrased that. Ive had a running ZFS, i thought as > i was reading your version of the install guide, if the newer code drop > included the boot from ZFS. seems i read it was in the perforce tree, so > i guess ive answered my own qurestion, that it is not in fact in this > patch >=20 This patch does include ZFS boot support (for i386 only. Look in sys/boot/i386/zfsboot and boot/zfs) I was unable to make it work though, but I was able to install a ZFS-supporting loader, by building the loader with LOADER_ZFS_SUPPORT=3Dyes . However, this feature is a bit undocumented yet, and it didn't work correct= ly for me. But you can always test it out. > On Tue, 2008-07-29 at 14:51 +0100, Randy Bush wrote: > > OutBackdingo wrote: > > > As in the whole including boot from ZFs, not sure that code is in here > > > yet?? had the boot code been migrated to allow for booting from a ZFS > > > partition?? or are we still in the recommended / or /boot being on UFS > > >> http://wiki.freebsd.org/JeremyChadwick/FreeBSD_7.x_on_a_ZFS_pool > >=20 > > i guess you did not follow the url. > >=20 > > boot from zfs is not supported (yet). > >=20 > > imiho, jeremy's instrs should be combined with those on creating sliced > > boot gmirror. > >=20 > > randy >=20 > _______________________________________________ > freebsd-current@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-current > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" >=20 --EeQfGwPcQSOJBaQU Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkiPh4UACgkQCILg8nMIdCXO1ACfQJSEYedFhBbuDyVmLHdvvicl NbIAn0xXrmDCnBqjRm9EUnQ8o3kSxmg9 =t04m -----END PGP SIGNATURE----- --EeQfGwPcQSOJBaQU-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 21:17:10 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4ABFC106567B; Tue, 29 Jul 2008 21:17:10 +0000 (UTC) (envelope-from lulf@FreeBSD.org) Received: from bene2.itea.ntnu.no (bene2.itea.ntnu.no [IPv6:2001:700:300:3::57]) by mx1.freebsd.org (Postfix) with ESMTP id EDF8A8FC1B; Tue, 29 Jul 2008 21:17:09 +0000 (UTC) (envelope-from lulf@FreeBSD.org) Received: from localhost (localhost [127.0.0.1]) by bene2.itea.ntnu.no (Postfix) with ESMTP id DC77290002; Tue, 29 Jul 2008 23:17:08 +0200 (CEST) Received: from nobby.studby.ntnu.no (unknown [IPv6:2001:700:300:3::184]) by bene2.itea.ntnu.no (Postfix) with ESMTP id 35C6590003; Tue, 29 Jul 2008 23:17:08 +0200 (CEST) Date: Tue, 29 Jul 2008 23:16:53 +0200 From: Ulf Lilleengen To: Zaphod Beeblebrox Message-ID: <20080729211653.GA28692@nobby.studby.ntnu.no> References: <20080727125413.GG1345@garage.freebsd.pl> <5f67a8c40807291223j52f0ccf7r27021bf882b13ad6@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="bp/iNruPH9dso1Pn" Content-Disposition: inline In-Reply-To: <5f67a8c40807291223j52f0ccf7r27021bf882b13ad6@mail.gmail.com> User-Agent: Mutt/1.5.18 (2008-05-17) X-Virus-Scanned: Debian amavisd-new at bene2.itea.ntnu.no Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 21:17:10 -0000 --bp/iNruPH9dso1Pn Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 29, 2008 at 03:23:13PM -0400, Zaphod Beeblebrox wrote: > On Sun, Jul 27, 2008 at 8:54 AM, Pawel Jakub Dawidek wro= te: >=20 > > Hi. > > > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >=20 >=20 >=20 > > Please test, test, test. If I get enough positive feedback, I may be > > able to squeeze it into 7.1-RELEASE, but this might be hard. >=20 >=20 > If the near term goal is to have this in 7.1, it may help to post a patch > that works with 7-STABLE to test. I've tried several bits of advice from > this thread to compile it. I even nuked my src tree and pulled a virgin = one > from cvsup. >=20 Quoting Pawel: "The patch is against HEAD and HEAD only. Don't expect patch against 7-STABLE soon." I agree it's preferable with a patch against 7-STABLE, but from a developers view, it's easier to debug one branch at a time :) --=20 Ulf Lilleengen --bp/iNruPH9dso1Pn Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAkiPiMQACgkQCILg8nMIdCXyrQCggUppfaEuzCQmOXAGx6WX05S3 ndYAniazh7wlfkPaDfDYcK63QQ9evk+G =7ST7 -----END PGP SIGNATURE----- --bp/iNruPH9dso1Pn-- From owner-freebsd-fs@FreeBSD.ORG Tue Jul 29 22:33:20 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 67627106564A for ; Tue, 29 Jul 2008 22:33:20 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from moe.cs.uoguelph.ca (moe.cs.uoguelph.ca [131.104.94.198]) by mx1.freebsd.org (Postfix) with ESMTP id 0520D8FC16 for ; Tue, 29 Jul 2008 22:33:19 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by moe.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id m6TMXGTe013527; Tue, 29 Jul 2008 18:33:16 -0400 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id m6TMiG826830; Tue, 29 Jul 2008 18:44:16 -0400 (EDT) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Tue, 29 Jul 2008 18:44:16 -0400 (EDT) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: =?utf-8?B?RGFnLUVybGluZyBTbcO4cmdyYXY=?= In-Reply-To: <86ej5c681b.fsf@ds4.des.no> Message-ID: References: <86myk06e18.fsf@ds4.des.no> <86ej5c681b.fsf@ds4.des.no> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="-559023410-851401618-1217371456=:26819" X-Scanned-By: MIMEDefang 2.63 on 131.104.94.198 Cc: freebsd-fs@freebsd.org Subject: Re: Which GSSAPI library does FreeBSD use? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2008 22:33:20 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. ---559023410-851401618-1217371456=:26819 Content-Type: TEXT/PLAIN; charset=utf-8; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Tue, 29 Jul 2008, Dag-Erling Sm=C3=B8rgrav wrote: > Rick Macklem writes: >> >> Should I email Doug or submit a bug report, to see if someone is willing >> to work on fixing this? > > You should contact Doug directly. > Thanks. > I wonder what this has to do with filesystems, though... > Only tangentially. NFSv4 uses a gssd daemon which is what I need it for. (I'll admit I was trying to avoid joining a mailing list, just to ask one question, and I succeeded:-) rick ---559023410-851401618-1217371456=:26819-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 01:19:36 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C0FB1065672 for ; Wed, 30 Jul 2008 01:19:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from mailhub.cs.uoguelph.ca (mailhub.cs.uoguelph.ca [131.104.94.205]) by mx1.freebsd.org (Postfix) with ESMTP id 3FD418FC14 for ; Wed, 30 Jul 2008 01:19:36 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by mailhub.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id m6U1JZoh024195 for ; Tue, 29 Jul 2008 21:19:35 -0400 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id m6U1UYV21267 for ; Tue, 29 Jul 2008 21:30:34 -0400 (EDT) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Tue, 29 Jul 2008 21:30:34 -0400 (EDT) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: freebsd-fs@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanned-By: MIMEDefang 2.63 on 131.104.94.205 Subject: NFSv4 client and server for FreeBSD7 needs testing X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 01:19:36 -0000 I have just put a patch for FreeBSD7.0 up anonymous ftp that includes client and server NFS code. It support NFSv4 (as well as NFSv2 and NFSv3) and includes support for Kerberized NFSv3 as well as NFSv4. The client port should be considered Beta test at this point, although this client seems to be working well in OpenBSD4.2 and Mac OS X 10.5 Leopard. (This client port has nothing to do with the NFSv4 client currently in FreeBSD7.0, but borrows heavily from FreeBSD7's generic NFSv2 and NFSv3 client.) I will be creating a similar patch for FreeBSD-CURRENT soon (within a week, maybe). Testing would be appreciated. There is an email list called openbsd-nfsv4@sfobug.org for questions, comments, bugs, etc. (I don't know if others would mind posts to freebsd-fs@freebsd.org or not. I'll see any posts made there, as well.) If you are interested in trying it out, please go to: ftp://ftp.cis.uoguelph.ca/pub/nfsv4/FreeBSD7 Have fun with it, if you try it, rick From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 08:02:52 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 10E0B1065673 for ; Wed, 30 Jul 2008 08:02:52 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [91.103.162.4]) by mx1.freebsd.org (Postfix) with ESMTP id CC7728FC0A for ; Wed, 30 Jul 2008 08:02:51 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id B666119E023 for ; Wed, 30 Jul 2008 10:02:50 +0200 (CEST) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 9FC1619E019 for ; Wed, 30 Jul 2008 10:02:48 +0200 (CEST) Message-ID: <48902042.3030609@quip.cz> Date: Wed, 30 Jul 2008 10:03:14 +0200 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Subject: ZFS on whole disk vs. slice vs. partition? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 08:02:52 -0000 Hi all, I am preparing myself to next try with ZFS and I would like to know if there are any recomendations / performance differences between using whole disk device (ad0) or slice (ad0s2) or partition (ad0s1e). For example, if I have machine with 2 disks and I want to setup small part of the disk gmirrored with UFS2 (/ + /usr) and the rest of space for data on ZFS mirror - is it better to use ad0s1 + ad1s1 for gmirror and ad0s2 + ad1s2 for ZFS mirror? Or is it better to use ad0s1e + ad1s1e for ZFS mirror? Next example could be machine with 4 disks (1TB disks in RAIDZ / RAIDZ2 as array for backups). It would be nice to user ad0 + ad1 + ad2 + ad3, but then I cannot boot of it, so again - I can use small piece of each disk as bootable UFS2 root with gmirror of 4 drives (first slice of each disk - ad0s1, ad1s1, ad2s1, ad3s1) and the rest for ZFS. Or is there significant reason not to split disks, use whole device for ZFS pool and setup UFS2 root on some other media like CF card with CF 2 IDE convertor? Thanks for any useful informations, tips, trick, links etc. Miroslav Lachman From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 09:44:16 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 73AB510656EB for ; Wed, 30 Jul 2008 09:44:16 +0000 (UTC) (envelope-from ari@ish.com.au) Received: from fish.ish.com.au (eth5921.nsw.adsl.internode.on.net [59.167.240.32]) by mx1.freebsd.org (Postfix) with ESMTP id ED91E8FC13 for ; Wed, 30 Jul 2008 09:44:15 +0000 (UTC) (envelope-from ari@ish.com.au) Received: from MailerDaemon by fish.ish.com.au with local-bsmtp (Exim 4.63) (envelope-from ) id 1KO8A2-0000FM-8q for freebsd-fs@FreeBSD.org; Wed, 30 Jul 2008 19:39:58 +1000 Received: from ip-132.ish.com.au ([203.29.62.132]:65166) by fish.ish.com.au with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.63) (envelope-from ) id 1KO8A0-0000F9-Es; Wed, 30 Jul 2008 19:39:56 +1000 / CTCH-RefIDstr=0001.0A150202.4890343C.00BD,ss=1,fgs=0 Message-Id: From: Aristedes Maniatis To: freebsd-current@FreeBSD.org In-Reply-To: <20080729201725.GA89512@eos.sc1.parodius.com> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Date: Wed, 30 Jul 2008 19:28:27 +1000 References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> <488F2078.708@psg.com> <1217347882.10413.5.camel@dingo-laptop> <20080729201725.GA89512@eos.sc1.parodius.com> X-Mailer: Apple Mail (2.926) X-CTCH-RefID: str=0001.0A150202.4890343C.00BD,ss=1,fgs=0 X-cff-SpamScore: 0(/) X-cff-SpamReport: ----- ----- Message is unknown to the spam scanner. X-cff-LastScanner: antispam Cc: freebsd-fs@FreeBSD.org, Pawel Jakub Dawidek , Jeremy Chadwick , Stefan Lambrev , Randy Bush , OutBackdingo Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 09:44:16 -0000 On 30/07/2008, at 6:17 AM, Jeremy Chadwick wrote: > I believe it is possible (with or without the patch) to boot purely > off > of ZFS. The ish.com.au document describes how to do this in "Step > Three: solving the ZFS boot problem". > > https://www.ish.com.au/solutions/articles/freebsdzfs > > I simply choose not to utilise that method. I'm a bit paranoid about > non-UFS root filesystems. My main concern revolves around booting > into > single-user, which is an important part of the whole build/install > world > process -- does it actually work with ZFS as a root fs, and if so, is > any sort of craziness required to accomplish it? Our article referenced above does still involve a UFS root filesystem, but once the boot process gets under way it is moved out of the way and replaced with the live ZFS root partition. We've had no problem booting into single user mode with this setup. The main down side is that you have a small extra bootable UFS partition (ours are 1Gb) with a kernel and absolutely basic system which is used for nothing more than bootstrapping the system. Oh, and it takes a while to wrap your brain around the whole concept. Having the extra partition means that every time you do make installkernel you'll also need to copy that kernel from the live ZFS root into the UFS partition. That's a nuisance to have to remember. On the plus side, you get to have your entire live filesystem under ZFS and whatever snapshot/RAID/backup/encryption/other ZFS neat feature you care to throw at it. Ari Maniatis --------------------------> ish http://www.ish.com.au Level 1, 30 Wilson Street Newtown 2042 Australia phone +61 2 9550 5001 fax +61 2 9550 4001 GPG fingerprint CBFB 84B4 738D 4E87 5E5C 5EFA EF6A 7D2E 3E49 102A From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 09:45:05 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B177D1065678; Wed, 30 Jul 2008 09:45:05 +0000 (UTC) (envelope-from phoemix@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id 6BA5C8FC2B; Wed, 30 Jul 2008 09:45:05 +0000 (UTC) (envelope-from phoemix@harmless.hu) Received: from fw.publishing.hu ([82.131.181.62] helo=twoflower.in.publishing.hu) by marvin.harmless.hu with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KO8Ex-0004NK-Ju; Wed, 30 Jul 2008 11:45:03 +0200 Date: Wed, 30 Jul 2008 11:45:02 +0200 From: CZUCZY Gergely To: Pawel Jakub Dawidek Message-ID: <20080730114502.41b3a655@twoflower.in.publishing.hu> In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> Organization: Harmless Digital X-Mailer: Claws Mail 3.5.0 (GTK+ 2.12.11; i386-portbld-freebsd6.3) Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/4_N1Q=G.qd=PhZvPxLnxExu"; protocol="application/pgp-signature"; micalg=PGP-SHA1 Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 09:45:05 -0000 --Sig_/4_N1Q=G.qd=PhZvPxLnxExu Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable May I ask whether these patches include the opensolaris crypto extension? http://opensolaris.org/os/project/zfs-crypto/ On Sun, 27 Jul 2008 14:54:13 +0200 Pawel Jakub Dawidek wrote: > Hi. >=20 > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >=20 > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. >=20 > Check out OpenSolaris website to find out the differences between base > system version and patch version. >=20 > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. >=20 > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). >=20 > Thank you in advance! >=20 --=20 =C3=9Cdv=C3=B6lettel, Czuczy Gergely Harmless Digital Bt mailto: gergely.czuczy@harmless.hu Tel: +36-30-9702963 --Sig_/4_N1Q=G.qd=PhZvPxLnxExu Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.3 (FreeBSD) iD8DBQFIkDgezrC0WyuMkpsRAvVQAJ9s1CNLxksi14DEv18XeTU6T52Y5wCgkAAs JLlNxnWT4Ee6IGXFri0krOk= =4hiX -----END PGP SIGNATURE----- --Sig_/4_N1Q=G.qd=PhZvPxLnxExu-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 09:54:04 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F2D801065671; Wed, 30 Jul 2008 09:54:03 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206045140.chello.pl [87.206.45.140]) by mx1.freebsd.org (Postfix) with ESMTP id 622FF8FC1D; Wed, 30 Jul 2008 09:54:02 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id EAACC45C8A; Wed, 30 Jul 2008 11:54:00 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 4FC8F45C99; Wed, 30 Jul 2008 11:53:56 +0200 (CEST) Date: Wed, 30 Jul 2008 11:54:02 +0200 From: Pawel Jakub Dawidek To: CZUCZY Gergely Message-ID: <20080730095402.GD4543@garage.freebsd.pl> References: <20080727125413.GG1345@garage.freebsd.pl> <20080730114502.41b3a655@twoflower.in.publishing.hu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="9dgjiU4MmWPVapMU" Content-Disposition: inline In-Reply-To: <20080730114502.41b3a655@twoflower.in.publishing.hu> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@FreeBSD.org, freebsd-current@FreeBSD.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 09:54:04 -0000 --9dgjiU4MmWPVapMU Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jul 30, 2008 at 11:45:02AM +0200, CZUCZY Gergely wrote: > May I ask whether these patches include the opensolaris crypto extension? > http://opensolaris.org/os/project/zfs-crypto/ I'll work on zfs-crypto once it is integrated into OpenSolaris source, not before. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --9dgjiU4MmWPVapMU Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFIkDo5ForvXbEpPzQRAq2tAKDtRH+XNHuu0H9WBrE9Q+7kvSC+cgCgr+gk 3HoA/++lWdtHcB8d2qcxmQE= =zQBb -----END PGP SIGNATURE----- --9dgjiU4MmWPVapMU-- From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 16:32:32 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from freefall.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with SMTP id 9A3E41065729; Wed, 30 Jul 2008 16:32:30 +0000 (UTC) (envelope-from nork@FreeBSD.org) Date: Thu, 31 Jul 2008 01:32:29 +0900 From: Norikatsu Shigemura To: Ulf Lilleengen Message-Id: <20080731013229.9d342ee5.nork@FreeBSD.org> In-Reply-To: <20080729211137.GA52154@nobby.studby.ntnu.no> References: <20080727125413.GG1345@garage.freebsd.pl> <488F0C71.9010902@moneybookers.com> <20080729125551.GA70379@eos.sc1.parodius.com> <1217338852.10413.1.camel@dingo-laptop> <488F2078.708@psg.com> <1217347882.10413.5.camel@dingo-laptop> <20080729211137.GA52154@nobby.studby.ntnu.no> X-Mailer: Sylpheed 2.5.0 (GTK+ 2.12.11; i386-portbld-freebsd8.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: Randy Bush , Pawel Jakub Dawidek , Norikatsu Shigemura , Stefan Lambrev , freebsd-fs@freebsd.org, freebsd-current@freebsd.org, OutBackdingo Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 16:32:32 -0000 On Tue, 29 Jul 2008 23:11:37 +0200 Ulf Lilleengen wrote: > This patch does include ZFS boot support (for i386 only. Look in > sys/boot/i386/zfsboot and boot/zfs) I was unable to make it work though, but > I was able to install a ZFS-supporting loader, by building the loader with > LOADER_ZFS_SUPPORT=yes . > However, this feature is a bit undocumented yet, and it didn't work correctly > for me. But you can always test it out. I'm using zfsboot on my note PC, and not using UFS. I know many problems about it:-). 1. zpool configuration is too limited, only single and mirror usable. If you want to zfsboot, you can't use RAIDZ, striping and cache(zpool add ... cache ...):-(. 2. On some environment (old BIOS?), zfsboot1 can't chain to zfsboot2. Because, by size (512bytes), zfsboot1 didn't support CHS mode. 3. Yes, a bit undocumented. So you must be careful. 4. I tried to test about zfsboot supported liveCD, but I can't make it yet. Because zfsbootable loader can't boot from CD. SEE ALSO: http://lists.freebsd.org/pipermail/freebsd-fs/2008-July/004895.html http://www.freebsd.org/cgi/query-pr.cgi?pr=bin/125878 From owner-freebsd-fs@FreeBSD.ORG Wed Jul 30 19:05:29 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 154E81065673 for ; Wed, 30 Jul 2008 19:05:29 +0000 (UTC) (envelope-from caelian@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.184]) by mx1.freebsd.org (Postfix) with ESMTP id 88FE98FC08 for ; Wed, 30 Jul 2008 19:05:28 +0000 (UTC) (envelope-from caelian@gmail.com) Received: by nf-out-0910.google.com with SMTP id h3so115803nfh.33 for ; Wed, 30 Jul 2008 12:05:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=uazCttpdQonu9aq0422SseTD249cd8lAHmQBQRe3qfc=; b=ZYJgDUHR2ye8N24lXfDzqMID/cssVyZaZp0IBqwzvoKoHYzhjH0EmwTyxpoKvNoNOa 1nhM9/vXmDpWsH+842Flm9PkLcHUtBdZGg135aug6UqFL9LqVt1vw3Nh+SC7Ws15ivN7 GF2zKoeW/Q46QB3Yj/WHGK0/aKGDJCBKouw90= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=uYqjSy77QAqg+k2+GL/XZm3HlPhQY3TfjJxjRY7O9D+WvvX5zWZUk3ydANyLB1/1Fv P0nAS/ZfBrmE3dNu1WZDmldbTUtqkFiQ9NJ4NsfD/yfNl5GUXHAM+QipL7ZIL6rIwBjr v5Mh2uqe6C0QhS3eXGps2Tu9QhTFtfzU7OUis= Received: by 10.210.49.7 with SMTP id w7mr6771146ebw.180.1217443255094; Wed, 30 Jul 2008 11:40:55 -0700 (PDT) Received: by 10.210.39.13 with HTTP; Wed, 30 Jul 2008 11:40:55 -0700 (PDT) Message-ID: Date: Wed, 30 Jul 2008 20:40:55 +0200 From: "Pascal Hofstee" To: "Pawel Jakub Dawidek" In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2008 19:05:29 -0000 On Sun, Jul 27, 2008 at 2:54 PM, Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). > > Thank you in advance! Well .. so far everything runs smoothly on my FreeBSD/amd64 8.0-CURRENT. I upgraded a simple one-disk ZPOOL and all ZFS filesystems on it without problems. The only thing that caught my eye were the console warnings like the ones below: WARNING pid 1413 (zpool): ioctl sign-extension ioctl ffffffffcc285a09 WARNING pid 1473 (zfs): ioctl sign-extension ioctl ffffffffcc285a12 WARNING pid 1473 (zfs): ioctl sign-extension ioctl ffffffffcc285a15 I only saw the zpool one once the zfs ones are mostly the ffffffffcc285a12. I am not exactly sure what those warnings are trying to tell me but thought i should at least mention them here. -- Pascal Hofstee From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 15:34:58 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7DF24106566C for ; Thu, 31 Jul 2008 15:34:58 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id 0D8D38FC23 for ; Thu, 31 Jul 2008 15:34:57 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so673356fgb.35 for ; Thu, 31 Jul 2008 08:34:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=TSPGHykLvp7DR9v1z5sb4FLtwk4Fm6mYf6ktbg/TrJ0=; b=JUXMVJcAuXMWdqykNjc6ZZiinw7UZW0VWL47fI7KJqFfb5g/gnyyV6APw+o8Bl+F3h k/sMvjtQ38tjLkcBZb2epu2+qkvHs5Lvn/2auC7Emw0EM4VY3CfrLsFNJwTiayjMH74T xbkEX7tOtETgxkFiblVJN+iJfuQpGcttyE6dk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=gOxo7pfvcFqYn42e4WmU+RUIJ1YGBWGILtWKkLK2IyAPoc2W93oQRmVJ+mW9j9Xmnr 7sxf/07MQMxXkf4SD0TSh+01j1/AzONh+ryNdDl9DRJ7V9ONFqcFInODD1NHFQMrMI9P sdcnSUgpXYTFfhxcNop1p84BMm+lwsz9iS/Ks= Received: by 10.86.95.20 with SMTP id s20mr6178585fgb.49.1217516899992; Thu, 31 Jul 2008 08:08:19 -0700 (PDT) Received: by 10.86.54.10 with HTTP; Thu, 31 Jul 2008 08:08:19 -0700 (PDT) Message-ID: Date: Thu, 31 Jul 2008 17:08:19 +0200 From: "Claus Guttesen" To: "Pawel Jakub Dawidek" In-Reply-To: <20080727125413.GG1345@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 15:34:58 -0000 On Sun, Jul 27, 2008 at 2:54 PM, Pawel Jakub Dawidek wrote: > Hi. > > http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 > > The patch above contains the most recent ZFS version that could be found > in OpenSolaris as of today. Apart for large amount of new functionality, > I belive there are many stability (and also performance) improvements > compared to the version from the base system. > > Check out OpenSolaris website to find out the differences between base > system version and patch version. > > Please test, test, test. If I get enough positive feedback, I may be > able to squeeze it into 7.1-RELEASE, but this might be hard. > > If you have any questions, please use mailing lists > (freebsd-fs@FreeBSD.org would be the best). I applied your patch to a current as of July the 31'st. I had to remove /usr/src and perform a clean csup and remove the two empty files as mentioned in this thread. I have a areca arc-1680 sas-card and an external sas-cabinet with 16 sas-drives each 1 TB (931 binary GB). They have been setup in three raidz-partitions with five disks each in one zpool and one spare. There does seem to be a speed-improvement. I nfs-mounted a partition from solaris 9 on sparc and is copying approx.400 GB using rsync. I saw write of 429 MB/s. The spikes occured every 10 secs. to begin with. After some minutes I get writes almost every sec. (watching zpool iostat 1). The limit is clearly the network-connection between the two hosts. I'll do some internal copying later. It's to early to say whether zfs is stable (enough) allthough I haven't been able to make it halt unless I removed a disk. This was with version 6. I'll remove a disk tomorrow and see how it goes. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 16:19:33 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C85C6106566C; Thu, 31 Jul 2008 16:19:33 +0000 (UTC) (envelope-from kevinxlinuz@163.com) Received: from m5-85.163.com (m12-15.163.com [220.181.12.15]) by mx1.freebsd.org (Postfix) with SMTP id E3FF38FC0C; Thu, 31 Jul 2008 16:19:32 +0000 (UTC) (envelope-from kevinxlinuz@163.com) Received: from [127.0.0.1] (unknown [60.191.58.178]) by smtp11 (Coremail) with SMTP id D8CowLDbfqGA4pFIDIQpFQ==.38901S2; Fri, 01 Aug 2008 00:04:16 +0800 (CST) Message-ID: <4891E27B.4010205@163.com> Date: Fri, 01 Aug 2008 00:04:11 +0800 From: kevin User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: Claus Guttesen References: <20080727125413.GG1345@garage.freebsd.pl> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Coremail-Antispam: 1Uf129KBjvJXoWxJr47Aw15JrW5CrWDZF17Awb_yoW8tr15pF WUGFZ0kF4qyrWkCrWxWa1kZF1FyrWxJFyrGFy7G3Wkurn8Ca4F9ry0yayYk3srCrs5Wr4j vay2v3s5ArykXFJanT9S1TB71UUUUUUv73VFW2AGmfu7bjvjm3AaLaJ3UjIYCTnIWjp_UU U8E7k0a2IF6r1UM7kC6x804xWl14x267AKxVWUJVW8JwAFxVCF77xC6IxKo4kEV4yl1I0E scIYIxCEI4klw4CSwwAFIxvE14AKwVWUJVWUGwAawVAYYI1S6c8GOVWUur45Jryln4vEF7 Iv6F18KVAqrcv_GVWUtr1rJF1lnx0Ec2IEnICE548m6r1DJrWUZwAqx4xG64xvF2IEw4CE 5I8CrVC2j2WlYx0E2Ix0cI8IcVAFwI0_Jr0_Jr4lYx0Ex4A2jsIE14v26r4j6F4UM4IEnf 9ElVAFpTB2q-sK649IAas0WaI_GwAC6xAIw28IcVAK0I8IjxAxMx02cVAKzwCY1Ik26cxK 6xAEc7vF6IAIbwCY0x0Ix7I2Y4AK6F4j6FyUMxCjnVAqn7xvrwC2zVAF1VAY17CE14v26r 1Y6r17YxBIdaVFxhVjvjDU0xZFpf9x0zi_cTdUUUUU= Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 16:19:34 -0000 Claus Guttesen wrote: > On Sun, Jul 27, 2008 at 2:54 PM, Pawel Jakub Dawidek wrote: > >> Hi. >> >> http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >> >> The patch above contains the most recent ZFS version that could be found >> in OpenSolaris as of today. Apart for large amount of new functionality, >> I belive there are many stability (and also performance) improvements >> compared to the version from the base system. >> >> Check out OpenSolaris website to find out the differences between base >> system version and patch version. >> >> Please test, test, test. If I get enough positive feedback, I may be >> able to squeeze it into 7.1-RELEASE, but this might be hard. >> >> If you have any questions, please use mailing lists >> (freebsd-fs@FreeBSD.org would be the best). >> > > I applied your patch to a current as of July the 31'st. I had to > remove /usr/src and perform a clean csup and remove the two empty > files as mentioned in this thread. > > I have a areca arc-1680 sas-card and an external sas-cabinet with 16 > sas-drives each 1 TB (931 binary GB). They have been setup in three > raidz-partitions with five disks each in one zpool and one spare. > > There does seem to be a speed-improvement. I nfs-mounted a partition > from solaris 9 on sparc and is copying approx.400 GB using rsync. I > saw write of 429 MB/s. The spikes occured every 10 secs. to begin > with. After some minutes I get writes almost every sec. (watching > zpool iostat 1). The limit is clearly the network-connection between > the two hosts. I'll do some internal copying later. > > It's to early to say whether zfs is stable (enough) allthough I > haven't been able to make it halt unless I removed a disk. This was > with version 6. I'll remove a disk tomorrow and see how it goes. > > Hi, I think the new patch still have some problem.I run zfs on my laptop,and it panic on zfs umount. The problem ( http://www.freebsd.org/cgi/query-pr.cgi?pr=124200 ) relate to zfs? It alway panic in spa_zio_intr_1 and txg_thread_enter. Benjsc is working on it.If any one interest in problem 124200, you can visit http://www.clearchain.com/~benjsc/downloads/FreeBSD/ . From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 18:07:16 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 79F6C106564A for ; Thu, 31 Jul 2008 18:07:16 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (cl-162.ewr-01.us.sixxs.net [IPv6:2001:4830:1200:a1::2]) by mx1.freebsd.org (Postfix) with ESMTP id E6C088FC1B for ; Thu, 31 Jul 2008 18:07:15 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (localhost [127.0.0.1]) by lor.one-eyed-alien.net (8.14.2/8.14.2) with ESMTP id m6VI7s29014099; Thu, 31 Jul 2008 13:07:54 -0500 (CDT) (envelope-from brooks@lor.one-eyed-alien.net) Received: (from brooks@localhost) by lor.one-eyed-alien.net (8.14.2/8.14.2/Submit) id m6VI7sEJ014098; Thu, 31 Jul 2008 13:07:54 -0500 (CDT) (envelope-from brooks) Date: Thu, 31 Jul 2008 13:07:54 -0500 From: Brooks Davis To: Rick Macklem Message-ID: <20080731180754.GA13820@lor.one-eyed-alien.net> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="BXVAT5kNtrzKuDFl" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.17 (2007-11-01) Cc: freebsd-fs@freebsd.org Subject: Re: NFSv4 client and server for FreeBSD7 needs testing X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 18:07:16 -0000 --BXVAT5kNtrzKuDFl Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jul 29, 2008 at 09:30:34PM -0400, Rick Macklem wrote: > I have just put a patch for FreeBSD7.0 up anonymous ftp that includes cli= ent > and server NFS code. It support NFSv4 (as well as NFSv2 and NFSv3) and in= cludes > support for Kerberized NFSv3 as well as NFSv4. The client port should be > considered Beta test at this point, although this client seems to be work= ing > well in OpenBSD4.2 and Mac OS X 10.5 Leopard. (This client port has nothi= ng to > do with the NFSv4 client currently in FreeBSD7.0, but borrows heavily from > FreeBSD7's generic NFSv2 and NFSv3 client.) >=20 > I will be creating a similar patch for FreeBSD-CURRENT soon (within a wee= k, > maybe). >=20 > Testing would be appreciated. There is an email list called > openbsd-nfsv4@sfobug.org for questions, comments, bugs, etc. > (I don't know if others would mind posts to freebsd-fs@freebsd.org or not= =2E I'll > see any posts made there, as well.) >=20 > If you are interested in trying it out, please go to: > ftp://ftp.cis.uoguelph.ca/pub/nfsv4/FreeBSD7 >=20 > Have fun with it, if you try it, rick I've done some very basic testing on amd64. I had to make a few changes to get it to compile, but they were mostly straightforward. Replacing the various incarnations of %q with %j and casts to (intmax_t) handled most of it. I also had to change the third argument of nfsvno_pathconf() to register_t to match the old code and perculate the change through. I've only done some auth sys mounts so far and some very basic reading of f= iles etc. One feature that seems to be missing relative to other systems is what I'd describe as recusive mounting with a single mount entry. For exam= ple if you export these files systems on solaris: /export/home /export/home/foo /export/home/bar and then mount /export/home with nfsv4 on a linux system, you can access the contents of /export/home/foo and /export/home/bar (find breaks interestingl= y on RHEL 5.1 Server, but that's another story :). -- Brooks --BXVAT5kNtrzKuDFl Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (FreeBSD) iD4DBQFIkf95XY6L6fI4GtQRAr3lAKC5/ohC4gz8CdU1xfA3qoEVnycaXwCRAXaV q0u8b/F9dtxxrnu1Qlu62Q== =WDr+ -----END PGP SIGNATURE----- --BXVAT5kNtrzKuDFl-- From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 19:09:12 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CF3EA1065679 for ; Thu, 31 Jul 2008 19:09:12 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from mailhub.cs.uoguelph.ca (mailhub.cs.uoguelph.ca [131.104.94.205]) by mx1.freebsd.org (Postfix) with ESMTP id 8EABC8FC2B for ; Thu, 31 Jul 2008 19:09:12 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by mailhub.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id m6VJ9Bkl018400; Thu, 31 Jul 2008 15:09:11 -0400 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id m6VJKG612674; Thu, 31 Jul 2008 15:20:16 -0400 (EDT) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Thu, 31 Jul 2008 15:20:16 -0400 (EDT) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: Brooks Davis In-Reply-To: <20080731180754.GA13820@lor.one-eyed-alien.net> Message-ID: References: <20080731180754.GA13820@lor.one-eyed-alien.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanned-By: MIMEDefang 2.63 on 131.104.94.205 Cc: freebsd-fs@freebsd.org Subject: Re: NFSv4 client and server for FreeBSD7 needs testing X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 19:09:12 -0000 On Thu, 31 Jul 2008, Brooks Davis wrote: > > I've done some very basic testing on amd64. I had to make a few > changes to get it to compile, but they were mostly straightforward. > Replacing the various incarnations of %q with %j and casts to (intmax_t) > handled most of it. I also had to change the third argument of > nfsvno_pathconf() to register_t to match the old code and perculate the > change through. > If you email me the diffs, that would be appreciated, since I only have i386 hardware to test with. > I've only done some auth sys mounts so far and some very basic reading of files > etc. One feature that seems to be missing relative to other systems is > what I'd describe as recusive mounting with a single mount entry. For example > if you export these files systems on solaris: > > /export/home > /export/home/foo > /export/home/bar > > and then mount /export/home with nfsv4 on a linux system, you can access the > contents of /export/home/foo and /export/home/bar (find breaks interestingly on > RHEL 5.1 Server, but that's another story :). > Yes, unlike NFSv2 and v3, NFSv4 allows the server to cross mount points on the server. I haven't implemented that in my server for two reasons: 1 - The Solaris 10 client gets confused at mount point crossings. I don't know if the current release of OpenSolaris has this fixed? 2 - It makes the file systems look exactly the same for NFSv4 as v2 and v3, if you don't allow mount point crossings. (ie. You can mount each separately, if you want to.) However, good point. Maybe it should be a "sysctl" option to enable it. (It's been a while since I tried it, but I think all I have to do is set the CROSSMOUNT flag on VOP_LOOKUP() to make it work.) I'll admit I don't get around to testing using the Linux client often, but if I can get it to work, I'll add a "sysctl" variable to enable it. Thanks and good luck with the testing, rick From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 20:19:34 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4C00A1065674 for ; Thu, 31 Jul 2008 20:19:34 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from moe.cs.uoguelph.ca (moe.cs.uoguelph.ca [131.104.94.198]) by mx1.freebsd.org (Postfix) with ESMTP id E41DD8FC08 for ; Thu, 31 Jul 2008 20:19:33 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from muncher.cs.uoguelph.ca (muncher.cs.uoguelph.ca [131.104.91.102]) by moe.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id m6VKJWhs024668 for ; Thu, 31 Jul 2008 16:19:32 -0400 Received: from localhost (rmacklem@localhost) by muncher.cs.uoguelph.ca (8.11.7p3+Sun/8.11.6) with ESMTP id m6VKUb426547 for ; Thu, 31 Jul 2008 16:30:37 -0400 (EDT) X-Authentication-Warning: muncher.cs.uoguelph.ca: rmacklem owned process doing -bs Date: Thu, 31 Jul 2008 16:30:37 -0400 (EDT) From: Rick Macklem X-X-Sender: rmacklem@muncher.cs.uoguelph.ca To: freebsd-fs@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Scanned-By: MIMEDefang 2.63 on 131.104.94.198 Subject: NFSv4 Referrals, was Re: NFSv4 client and server... X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 20:19:34 -0000 I see that, along with what they call Mirror mounts, the OpenSolaris team is building Referral support into their client. I put some code for Referrals in a long time ago, but it is incomplete and untested. (A referral can be thought of as a symbolic link/pointer to a file system on another server.) What is needed is an entry in the local file system that can be recognized as an nfsv4 referral and stores the referral data (just something like "otherserver:/path"). As a dirty hack, I had thought of using a symbolic link, but with a funny set of mode bits. (Local access on the server would just see a symbolic link with funny mode bits and no extant file, but the nfs server would recognize it as a referral and use it.) But there must be a better way? Any ideas? rick From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 20:58:35 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B286A106568C for ; Thu, 31 Jul 2008 20:58:35 +0000 (UTC) (envelope-from matt@corp.spry.com) Received: from ik-out-1112.google.com (ik-out-1112.google.com [66.249.90.179]) by mx1.freebsd.org (Postfix) with ESMTP id 1628A8FC25 for ; Thu, 31 Jul 2008 20:58:34 +0000 (UTC) (envelope-from matt@corp.spry.com) Received: by ik-out-1112.google.com with SMTP id c30so1137916ika.3 for ; Thu, 31 Jul 2008 13:58:33 -0700 (PDT) Received: by 10.210.41.14 with SMTP id o14mr2817056ebo.77.1217537913154; Thu, 31 Jul 2008 13:58:33 -0700 (PDT) Received: from matts.spry.com ( [64.79.222.10]) by mx.google.com with ESMTPS id m5sm781295gve.3.2008.07.31.13.58.31 (version=TLSv1/SSLv3 cipher=RC4-MD5); Thu, 31 Jul 2008 13:58:32 -0700 (PDT) Message-Id: <62D3072A-E41A-4CFC-971D-9924958F38C7@corp.spry.com> From: Matt Simerson To: freebsd-fs@freebsd.org Mime-Version: 1.0 (Apple Message framework v928.1) Date: Thu, 31 Jul 2008 13:58:26 -0700 References: <20253C48-38CB-4A77-9C59-B993E7E5D78A@corp.spry.com> X-Mailer: Apple Mail (2.928.1) Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS hang issue and prefetch_disable - UPDATE X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 20:58:35 -0000 My announcement that vfs.zfs.prefetch_disable=1 resulted in a stable system was premature. One of my backup servers (see specs below) hung. When I got onto the console via KVM, it looked normal with no errors but didn't respond to Control-Alt-Delete. After a power cycle, zpool status showed 8 disks FAULTED and the action state was: http://www.sun.com/msg/ZFS-8000-5E Basically, that meant my ZFS file system and 7.5TB of data was gone. Ouch. I'm using a pair of ARECA 1231ML RAID controllers. Previously, I had them configured in JBOD with raidz2. This time around, I configured both controllers with one 12 disk RAID 6 volume. Now FreeBSD just sees two 10TB disks which I stripe with ZFS: zpool create back01 /dev/ da0 /dev/da1 I also did a bit more fiddling with /boot/loader.conf. Previous I had: vm.kmem_size="1536M" vm.kmem_size_max="1536M" vfs.zfs.prefetch_disable=1 This resulted in ZFS using 1.1GB of RAM (as measured using the technique described on the wiki) during normal use. The system in question hung during the nightly processing (which backs up some other systems via rsync) and my suspicions are that when I/O load picked up, it exhausted the available kernel memory and hung the system. So now I have these settings on one system: vm.kmem_size="1536M" vm.kmem_size_max="1536M" vfs.zfs.arc_min="16M" vfs.zfs.arc_max="64M" vfs.zfs.prefetch_disable=1 and the same except vfs.zfs.arc_max="256M" on the other. The one with 64M uses 256MB of RAM for ZFS and the one set at 256M uses 600MB of RAM. These are measured under heavy network and disk IO load being generated by multiple rsync processes pulling backups from remote nodes and storing it on ZFS. I am using ZFS compression. I get much better performance now with RAID 6 on the controller and ZFS striping than using raidz2. Unless tuning the arc_ settings made the difference. Either way, the system I just rebuilt is now quite a bit faster with RAID 6 than JBOD + raidz2. Hopefully tuning vfs.zfs.arc_max will result in stability. If it doesn't, my next choice is upgrading to -HEAD with the recent ZFS patch or ditching ZFS entirely and using geom_stripe. I don't like either option. Matt > From: Matt Simerson > Date: July 22, 2008 1:25:42 PM PDT > To: freebsd-fs@freebsd.org > Subject: ZFS hang issue and prefetch_disable > > Symptoms > > Deadlocks under heavy IO load on the ZFS file system with > prefetch_disable=0. Setting vfs.zfs.prefetch_disable=1 results in a > stable system. > > Configuration > > Two machines. Identically built. Both exhibit identical behavior. > 8 cores (2 x E5420) x 2.5GHz, 16 GB RAM, 24 x 1TB disks. > FreeBSD 7.0 amd64 > dmesg: http://matt.simerson.net/computing/zfs/dmesg.txt > > Boot disk is a read only 1GB compact flash > # cat /etc/fstab > /dev/ad0s1a / ufs ro,noatime 2 2 > > # df -h / > Filesystem 1K-blocks Used Avail Capacity Mounted on > /dev/ad0s1a 939M 555M 309M 64% / > > RAM has been boosted as suggested in ZFS Tuning Guide > # cat /boot/loader.conf > vm.kmem_size= 1610612736 > vm.kmem_size_max= 1610612736 > vfs.zfs.prefetch_disable=1 > > I haven't mucked much with the other memory settings as I'm using > amd64 and according to the FreeBSD ZFS wiki, that isn't necessary. > I've tried higher settings for kmem but that resulted in a failed > boot. I have ample RAM And would love to use as much as possible for > network and disk I/O buffers as that's principally all this system > does. > > Disks & ZFS options > > Sun's "Best Practices" suggests limiting the number of disks in a > raidz pool to no more than 6-10, IIRC. ZFS is configured as shown: http://matt.simerson.net/computing/zfs/zpool.txt > > I'm using all of the ZFS default properties except: atime=off, > compression=on. > > Environment > > I'm using these machines as backup servers. I wrote an application > that generates a list of the thousands of VPS accounts we host. For > each host, it generates a rsnapshot configuration file and backs up > up their VPS to these systems via rsync. The application manages > concurrency and will spawn additional rsync processes if system i/o > load is below a defined threshhold. Which is to say, I can crank up > or down the amount of disk IO the system sees. > > With vfs.zfs.prefetch_disable=0, I can trigger a hang within a few > hours (no more than a day). If I keep the i/o load (measured via > iostat) down to a low level (< 200 iops) then I still get hangs but > less frequently (1-6 days). The only way I have found to prevent > the hangs is by setting vfs.zfs.prefetch_disable=1. From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 23:37:08 2008 Return-Path: Delivered-To: freebsd-fs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 966E11065674 for ; Thu, 31 Jul 2008 23:37:08 +0000 (UTC) (envelope-from pfgshield-freebsd@yahoo.com) Received: from web32703.mail.mud.yahoo.com (web32703.mail.mud.yahoo.com [68.142.207.247]) by mx1.freebsd.org (Postfix) with SMTP id 5943B8FC08 for ; Thu, 31 Jul 2008 23:37:08 +0000 (UTC) (envelope-from pfgshield-freebsd@yahoo.com) Received: (qmail 56412 invoked by uid 60001); 31 Jul 2008 23:37:07 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Received:X-Mailer:Date:From:Reply-To:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=wgY6N+CXOLwg1d+Z+54OCMQjPvv4eVNzZiAn920Y1iaWlOKya5cea+VbV9YXSOhFh02Qq/VQk4IGYoGcGsBOHmD67UUbxTL2XmY83/fzAVCsA+i8tx73YCY3r4xM8e/f7afEyimscUVOdrdWy0uzSeZo/4m3shwmKS0dKMsyDwc=; Received: from [190.158.44.147] by web32703.mail.mud.yahoo.com via HTTP; Thu, 31 Jul 2008 16:37:07 PDT X-Mailer: YahooMailWebService/0.7.218 Date: Thu, 31 Jul 2008 16:37:07 -0700 (PDT) From: Pedro Giffuni To: freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Message-ID: <809288.56058.qm@web32703.mail.mud.yahoo.com> Cc: Subject: Should we change dirent for 64 bit directory cookies ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pfgshield-freebsd@yahoo.com List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 23:37:08 -0000 Hello fs gurus; I've been sort of following the DragonFly list wrt to the changes Matt made= for his HAMMER fs. I don't know if anyone is considering a port: he added a lot of stuff to th= e base system that will be a pain to port, but he also triggered some bugs = in the old BSD code that would be nice to fix on FreeBSD too. One of the not-*too*-tough things to consider adopting would be 64 director= y cookies: Main commit: http://leaf.dragonflybsd.org/mailarchive/commits/2007-11/msg00151.html Follow up for the linuxulator: http://leaf.dragonflybsd.org/mailarchive/commits/2007-11/msg00153.html Here is a excerpt of a discussion from the DragonFly Kernel ML (Re: [Tux3] = Comparison to Hammer fs design), that pretty much sums up the issues: ________ ... :> The cookies are 64 bits in DragonFly. I'm not sure why Linux would :> still be using 32 bit cookies, file offsets are 64 bits so you :> should be able to use 64 bit cookies. : :It is not Linux that perpetrates this outrage, it is NVFS v2. We can't :just tell everybody that their NFS v2 clients are now broken. Oh, we don't care about NFSv2 all that much any more. NFSv3 is the bare minimum. NFSv2 is extremely old, nobody should be using it any more. Even NFSv3 is getting fairly long in the tooth now. :> For NFS in DragonFly I use a 64 bit cookie where 32 bits is a hash k= ey :> and 32 bits is an iterator to deal with hash collisions. Poof, :> problem solved. : :Which was my original proposal to solve the problem. Then Ted told me :about NFS v2 :-O : :Actually, NFS hands you a 62 bit cookie with the high bits of both s32 :parts unused. NFS v2 gives you a 31 bit cookie. Bleah. I'd recommend dropping support for NFSv2. It is not really worth=20 supporting any more. Does it even support 64 bit inodes? (I don't=20 remember), or 64 bit file offsets? NFSv2 is garbage. You should be able to use 63 bits of the cookie, I don't know why you wouldn't use the high bit of the lsb 32 bit part. There is no requirement that that bit be 0. In fact, the RFC says the cookie is a 64 bit unsigned integer and you should be able to use all 64 bits. If linux is not allowing all 64 bits to be used then it's a serious bug in linux. The cookies are supposed to be opaque, just like the file handle. ... _________ =0A=0A=0A Posta, news, sport, oroscopo: tutto in una sola pagina. =0AC= rea l'home page che piace a te!=0Awww.yahoo.it/latuapagina From owner-freebsd-fs@FreeBSD.ORG Thu Jul 31 23:40:28 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6B90E106566B; Thu, 31 Jul 2008 23:40:28 +0000 (UTC) (envelope-from Benjamin.Close@clearchain.com) Received: from ipmail04.adl2.internode.on.net (ipmail04.adl2.internode.on.net [203.16.214.57]) by mx1.freebsd.org (Postfix) with ESMTP id B524E8FC13; Thu, 31 Jul 2008 23:40:27 +0000 (UTC) (envelope-from Benjamin.Close@clearchain.com) X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: AkkFAEPlkUh5LV7J/2dsb2JhbACBW4lDpiM X-IronPort-AV: E=Sophos;i="4.31,289,1215354600"; d="scan'208";a="171612247" Received: from ppp121-45-94-201.lns10.adl6.internode.on.net (HELO mail.clearchain.com) ([121.45.94.201]) by ipmail04.adl2.internode.on.net with ESMTP; 01 Aug 2008 08:55:07 +0930 Received: from [192.168.155.234] (taurus.internal.clearchain.com [192.168.155.234]) (authenticated bits=0) by mail.clearchain.com (8.14.2/8.14.2) with ESMTP id m6VNP4lY028394 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 1 Aug 2008 08:55:04 +0930 (CST) (envelope-from Benjamin.Close@clearchain.com) Message-ID: <489249D0.2000203@clearchain.com> Date: Fri, 01 Aug 2008 08:55:04 +0930 From: Benjamin Close User-Agent: Thunderbird 2.0.0.16 (Windows/20080708) MIME-Version: 1.0 To: kevin References: <20080727125413.GG1345@garage.freebsd.pl> <4891E27B.4010205@163.com> In-Reply-To: <4891E27B.4010205@163.com> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV version 0.93.3, clamav-milter version 0.93.3 on pegasus.clearchain.com X-Virus-Status: Clean X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.0 (mail.clearchain.com [192.168.154.1]); Fri, 01 Aug 2008 08:55:04 +0930 (CST) Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org, Claus Guttesen Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2008 23:40:28 -0000 kevin wrote: > Claus Guttesen wrote: >> On Sun, Jul 27, 2008 at 2:54 PM, Pawel Jakub Dawidek >> wrote: >> >>> Hi. >>> >>> http://people.freebsd.org/~pjd/patches/zfs_20080727.patch.bz2 >>> >>> The patch above contains the most recent ZFS version that could be >>> found >>> in OpenSolaris as of today. Apart for large amount of new >>> functionality, >>> I belive there are many stability (and also performance) improvements >>> compared to the version from the base system. >>> >>> Check out OpenSolaris website to find out the differences between base >>> system version and patch version. >>> >>> Please test, test, test. If I get enough positive feedback, I may be >>> able to squeeze it into 7.1-RELEASE, but this might be hard. >>> >>> If you have any questions, please use mailing lists >>> (freebsd-fs@FreeBSD.org would be the best). >>> >> >> I applied your patch to a current as of July the 31'st. I had to >> remove /usr/src and perform a clean csup and remove the two empty >> files as mentioned in this thread. >> >> I have a areca arc-1680 sas-card and an external sas-cabinet with 16 >> sas-drives each 1 TB (931 binary GB). They have been setup in three >> raidz-partitions with five disks each in one zpool and one spare. >> >> There does seem to be a speed-improvement. I nfs-mounted a partition >> from solaris 9 on sparc and is copying approx.400 GB using rsync. I >> saw write of 429 MB/s. The spikes occured every 10 secs. to begin >> with. After some minutes I get writes almost every sec. (watching >> zpool iostat 1). The limit is clearly the network-connection between >> the two hosts. I'll do some internal copying later. >> >> It's to early to say whether zfs is stable (enough) allthough I >> haven't been able to make it halt unless I removed a disk. This was >> with version 6. I'll remove a disk tomorrow and see how it goes. >> >> > Hi, > I think the new patch still have some problem.I run zfs on my > laptop,and it panic on zfs umount. > The problem ( http://www.freebsd.org/cgi/query-pr.cgi?pr=124200 ) > relate to zfs? It alway panic in spa_zio_intr_1 and txg_thread_enter. > Benjsc is working on it.If any one interest in problem 124200, you can > visit http://www.clearchain.com/~benjsc/downloads/FreeBSD/ . This issue is not zfs related, zfs however being such a big user of threads and condvars, triggers it more often. Cheers, Benjamin From owner-freebsd-fs@FreeBSD.ORG Fri Aug 1 12:19:39 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8C1611065678 for ; Fri, 1 Aug 2008 12:19:39 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.153]) by mx1.freebsd.org (Postfix) with ESMTP id F06F68FC1B for ; Fri, 1 Aug 2008 12:19:37 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1226157fgb.35 for ; Fri, 01 Aug 2008 05:19:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=Po5iKNvhYlOFjhdfj1k/+y+uxRrHHA/YKyzoWXHawqU=; b=FbaqsZBHk26TRtY9UlJriJZWVPsM9/VI/vqWAtxyFzkxCIli/l4Fmgxwm0KJzYdjfm 6clB4cwfE7OMoASZLQlj47lWsXHMd/5Fvvb29VGJD+3aeFQaqdNPcfZGBgs4p273n5TA 0bbfxylGrlb+4j2bTONwauGDnOhqPG/f4mlwk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=CIFOVH3QMt5r2HlbvBD4Om1x0/Ycbb9TBRtix/prkJUaXZiymtUEveqvMuvds0KjKp 5nqpJ7deI5vG1Uw7C41gW/TS0vExcOUyoJcUmTAy5bjtLuQyzV1UwZZDxbyRbOTpiRPs 7zdvuEsUoiyTTPZDtvl920eSjlecXpQHZ4ufQ= Received: by 10.86.33.19 with SMTP id g19mr7226697fgg.50.1217593176056; Fri, 01 Aug 2008 05:19:36 -0700 (PDT) Received: by 10.86.54.10 with HTTP; Fri, 1 Aug 2008 05:19:35 -0700 (PDT) Message-ID: Date: Fri, 1 Aug 2008 14:19:35 +0200 From: "Claus Guttesen" To: "Pawel Jakub Dawidek" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2008 12:19:39 -0000 >> The patch above contains the most recent ZFS version that could be found >> in OpenSolaris as of today. Apart for large amount of new functionality, >> I belive there are many stability (and also performance) improvements >> compared to the version from the base system. >> >> Please test, test, test. If I get enough positive feedback, I may be >> able to squeeze it into 7.1-RELEASE, but this might be hard. >> > > I applied your patch to a current as of July the 31'st. I had to > remove /usr/src and perform a clean csup and remove the two empty > files as mentioned in this thread. > > I have a areca arc-1680 sas-card and an external sas-cabinet with 16 > sas-drives each 1 TB (931 binary GB). They have been setup in three > raidz-partitions with five disks each in one zpool and one spare. > > There does seem to be a speed-improvement. I nfs-mounted a partition > from solaris 9 on sparc and is copying approx.400 GB using rsync. I > saw write of 429 MB/s. The spikes occured every 10 secs. to begin > with. After some minutes I get writes almost every sec. (watching > zpool iostat 1). The limit is clearly the network-connection between > the two hosts. I'll do some internal copying later. > > It's to early to say whether zfs is stable (enough) allthough I > haven't been able to make it halt unless I removed a disk. This was > with version 6. I'll remove a disk tomorrow and see how it goes. Replying to my own mail! :-) My conclusion about it's stability was a bit hasty. I was copying approx. 400 GB from a nfs-share mounted from a solaris 9 on sparc using tcp and read- and write-size of 32768. The files are images slightly less than 1 MB and a thumbnail (approx. 983000 files). During creation of my pool I saw these error-messages: WARNING pid 1065 (zfs): ioctl sign-extension ioctl ffffffffcc285a18 WARNING pid 1067 (zfs): ioctl sign-extension ioctl ffffffffcc285a18 WARNING pid 1069 (zfs): ioctl sign-extension ioctl ffffffffcc285a15 WARNING pid 1070 (zfs): ioctl sign-extension ioctl ffffffffcc285a15 WARNING pid 1076 (zfs): ioctl sign-extension ioctl ffffffffcc285a19 WARNING pid 1077 (zfs): ioctl sign-extension ioctl ffffffffcc285a18 WARNING pid 1079 (zfs): ioctl sign-extension ioctl ffffffffcc285a15 Twice during the copy (rsync) access to the pool stopped. I took a copy of top during the first and second incident: last pid: 4287; load averages: 0.00, 0.17, 0.48 up 0+03:02:30 00:27:42 33 processes: 1 running, 32 sleeping CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 43M Active, 6350M Inact, 1190M Wired, 220M Cache, 682M Buf, 130M Free Swap: 8192M Total, 16K Used, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 4237 www 1 58 0 23056K 17328K tx->tx 2 0:07 0.00% rsync 4159 root 1 44 0 14336K 3476K pause 0 0:00 0.00% zsh 3681 claus 1 44 0 14480K 3524K pause 1 0:00 0.00% zsh 4154 claus 1 44 0 36580K 3768K select 1 0:00 0.00% sshd 4273 claus 1 44 0 14480K 3552K pause 3 0:00 0.00% zsh 4125 www 1 44 0 14600K 3584K ttyin 1 0:00 0.00% zsh 4120 root 1 44 0 12992K 3088K pause 0 0:00 0.00% zsh 4156 claus 1 46 0 13140K 3196K pause 2 0:00 0.00% zsh 4284 root 1 44 0 12992K 3264K pause 1 0:00 0.00% zsh 3679 claus 1 44 0 36580K 3612K select 2 0:00 0.00% sshd 1016 root 1 44 0 6768K 1168K nanslp 0 0:00 0.00% cron 3676 root 1 46 0 36580K 3624K sbwait 0 0:00 0.00% sshd 4150 root 1 45 0 36580K 3780K sbwait 2 0:00 0.00% sshd 793 root 1 44 0 5712K 1164K select 1 0:00 0.00% syslogd 4268 root 1 45 0 36580K 3896K sbwait 1 0:00 0.00% sshd 4271 claus 1 44 0 36580K 3892K select 2 0:00 0.00% sshd 4287 root 1 44 0 8140K 1896K CPU0 0 0:00 0.00% top 4123 root 1 45 0 20460K 1412K wait 0 0:00 0.00% su 1007 root 1 44 0 24652K 2788K select 1 0:00 0.00% sshd last pid: 2812; load averages: 0.01, 0.53, 0.87 up 0+01:01:45 10:03:55 34 processes: 1 running, 33 sleeping CPU: 0.0% user, 0.0% nice, 0.0% system, 0.0% interrupt, 100% idle Mem: 150M Active, 166M Inact, 1469M Wired, 40K Cache, 680M Buf, 6147M Free Swap: 8192M Total, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 2787 www 1 44 0 117M 99M select 3 0:05 0.00% rsync 2785 www 1 65 0 117M 100M zio->i 1 0:05 0.00% rsync 1326 root 1 44 0 14500K 2300K nanslp 3 0:02 0.00% zpool 1195 claus 1 44 0 8140K 2704K CPU0 0 0:01 0.00% top 1224 www 1 65 0 14804K 4576K pause 1 0:00 0.00% zsh 2786 www 1 44 0 98832K 87432K select 0 0:00 0.00% rsync 1203 claus 1 44 0 36580K 5320K select 0 0:00 0.00% sshd 1155 claus 1 44 0 14608K 4408K pause 1 0:00 0.00% zsh 1177 claus 1 44 0 36580K 5320K select 1 0:00 0.00% sshd 1208 root 1 44 0 15392K 4292K pause 2 0:00 0.00% zsh 1153 claus 1 44 0 36580K 5320K select 3 0:00 0.00% sshd 2708 claus 1 44 0 13140K 3976K ttyin 3 0:00 0.00% zsh 1219 root 1 44 0 12992K 3892K pause 0 0:00 0.00% zsh 1179 claus 1 44 0 13140K 3976K pause 2 0:00 0.00% zsh 1205 claus 1 47 0 13140K 3976K pause 1 0:00 0.00% zsh 1146 root 1 45 0 36580K 5284K sbwait 1 0:00 0.00% sshd 2703 root 1 46 0 36580K 5276K sbwait 0 0:00 0.00% sshd 1171 root 1 46 0 36580K 5276K sbwait 0 0:00 0.00% sshd 1200 root 1 46 0 36580K 5276K sbwait 0 0:00 0.00% sshd 795 root 1 44 0 5712K 1412K select 0 0:00 0.00% syslogd 1018 root 1 44 0 6768K 1484K nanslp 2 0:00 0.00% cron 2706 claus 1 44 0 36580K 5320K select 1 0:00 0.00% sshd 1222 root 1 45 0 20460K 1840K wait 1 0:00 0.00% su When copying was completed I then copied the same data to a different zfs-partition. It stopped once and I saw the following in dmesg: Aug 1 09:22:02 malene root: ZFS: checksum mismatch, zpool=ef1 path=/dev/da4 offset=294400 size=512 The zpool was defined with three raidz-partitions with five disk each and one spare. I need to get some storage available very soon so I re-installed the server with solaris express b79. Zpool-information (from solaris): zpool status pool: ef1 state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM ef1 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c3t0d0 ONLINE 0 0 0 c3t0d1 ONLINE 0 0 0 c3t0d2 ONLINE 0 0 0 c3t0d3 ONLINE 0 0 0 c3t0d4 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c3t0d5 ONLINE 0 0 0 c3t0d6 ONLINE 0 0 0 c3t0d7 ONLINE 0 0 0 c3t1d0 ONLINE 0 0 0 c3t1d1 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c3t1d2 ONLINE 0 0 0 c3t1d3 ONLINE 0 0 0 c3t1d4 ONLINE 0 0 0 c3t1d5 ONLINE 0 0 0 c3t1d6 ONLINE 0 0 0 spares c3t1d7 AVAIL errors: No known data errors -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare From owner-freebsd-fs@FreeBSD.ORG Fri Aug 1 13:38:51 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D752C1065673 for ; Fri, 1 Aug 2008 13:38:51 +0000 (UTC) (envelope-from kometen@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.158]) by mx1.freebsd.org (Postfix) with ESMTP id 5F4D88FC24 for ; Fri, 1 Aug 2008 13:38:51 +0000 (UTC) (envelope-from kometen@gmail.com) Received: by fg-out-1718.google.com with SMTP id l26so1258218fgb.35 for ; Fri, 01 Aug 2008 06:38:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=z3rdhcvB/ZsYK3msf5CibeOHjRaXHpeIVLjygSNHJSA=; b=DvKtqYYh1TbA7zGR3FNok/OCcccTAFwXmrnGlXsWYKpO9K548L5E0cHg+7XK1YoCWa +Pao2wfOJx93dPTyUvgPHtdarn8/kfggOmKJSnLknXSrIA8T+RDKMngFzvuJDinPKa1O 2sQsB2x+xgCKZnMssDT0sFKJo9Ry/JPBFDVRQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=TNJX7NA2fJPeesKW2Rz2hUPpppI3Gc3tkP11Mon2Z3LODzBf+C/8qJCFexmO+VHg3m 5OzrDWXGKYB095KejQ1uNm3gTPrf5tipfaF9Ap1o7lphUQYEBLz9NH+N2HZhM9LGQ/OV eELfn8BGU7vQ8wscW9KvjMo3n7FqzcBKo2kdI= Received: by 10.86.99.9 with SMTP id w9mr7284348fgb.70.1217597929500; Fri, 01 Aug 2008 06:38:49 -0700 (PDT) Received: by 10.86.54.10 with HTTP; Fri, 1 Aug 2008 06:38:49 -0700 (PDT) Message-ID: Date: Fri, 1 Aug 2008 15:38:49 +0200 From: "Claus Guttesen" To: "Pawel Jakub Dawidek" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20080727125413.GG1345@garage.freebsd.pl> Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Re: ZFS patches. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2008 13:38:52 -0000 >>> The patch above contains the most recent ZFS version that could be found >>> in OpenSolaris as of today. Apart for large amount of new functionality, >>> I belive there are many stability (and also performance) improvements >>> compared to the version from the base system. >>> >>> Please test, test, test. If I get enough positive feedback, I may be >>> able to squeeze it into 7.1-RELEASE, but this might be hard. >>> >> >> I applied your patch to a current as of July the 31'st. I had to >> remove /usr/src and perform a clean csup and remove the two empty >> files as mentioned in this thread. >> >> I have a areca arc-1680 sas-card and an external sas-cabinet with 16 >> sas-drives each 1 TB (931 binary GB). They have been setup in three >> raidz-partitions with five disks each in one zpool and one spare. >> >> There does seem to be a speed-improvement. I nfs-mounted a partition >> from solaris 9 on sparc and is copying approx.400 GB using rsync. I >> saw write of 429 MB/s. The spikes occured every 10 secs. to begin >> with. After some minutes I get writes almost every sec. (watching >> zpool iostat 1). The limit is clearly the network-connection between >> the two hosts. I'll do some internal copying later. >> >> It's to early to say whether zfs is stable (enough) allthough I >> haven't been able to make it halt unless I removed a disk. This was >> with version 6. I'll remove a disk tomorrow and see how it goes. > > Replying to my own mail! :-) > > My conclusion about it's stability was a bit hasty. I was copying > approx. 400 GB from a nfs-share mounted from a solaris 9 on sparc > using tcp and read- and write-size of 32768. The files are images > slightly less than 1 MB and a thumbnail (approx. 983000 files). Replying once more to my own mail. There seems to be a hardware-related problem to my setup. I'm getting some 'arcmsr0: scsi id=1 lun=4 ccb='0xffffff02d5cc8e00' outstanding command timeout' (in solaris). I'll check with my vendor. I did not see such errors in FreeBSD. -- regards Claus When lenity and cruelty play for a kingdom, the gentlest gamester is the soonest winner. Shakespeare