From owner-freebsd-fs@FreeBSD.ORG Wed Mar 9 07:27:26 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D16A516A4CE for ; Wed, 9 Mar 2005 07:27:26 +0000 (GMT) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.194]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6DAC043D3F for ; Wed, 9 Mar 2005 07:27:26 +0000 (GMT) (envelope-from mo.babaei@gmail.com) Received: by wproxy.gmail.com with SMTP id 70so91525wra for ; Tue, 08 Mar 2005 23:27:26 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:mime-version:content-type:content-transfer-encoding; b=Z8wosne5Ju7CP00sJ07B4uddtMZ9qOuRBxBAckGFC7cNQEVSJCCdg0As58tjW0HWGhOiWpIED0CQKbdoC6iVqWt5mfIlmYE+1fxpk8KF5awlB98sh0mxVx5gCUhzI1m5TRwTDi/SfwFbw68zyfFjc+QfObzTAFPDg/KRj1w8EV8= Received: by 10.54.71.17 with SMTP id t17mr497123wra; Tue, 08 Mar 2005 23:27:25 -0800 (PST) Received: by 10.54.31.55 with HTTP; Tue, 8 Mar 2005 23:27:25 -0800 (PST) Message-ID: <5bf3a41f05030823275ece0cc3@mail.gmail.com> Date: Wed, 9 Mar 2005 11:57:25 +0430 From: mohammad babaei To: freebsd-fs@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: fsck output X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: mohammad babaei List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 07:27:26 -0000 Dear Sirs, we have a production server running FreeBSD 4.10 RELEASE , when we run fsck on the machine it's out put is something like this: ======== ** /dev/ad0s1a (NO WRITE) ** Last Mounted on / ** Root file system ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 8111 files, 88564 used, 943587 free (1019 frags, 117821 blocks, 0.1% fragmentation) ** /dev/ad0s1h (NO WRITE) ** Last Mounted on /home ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 19 files, 19 used, 3638994 free (34 frags, 454870 blocks, 0.0% fragmentation) ** /dev/ad0s1e (NO WRITE) ** Last Mounted on /tmp ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts UNREF FILE I=102 OWNER=www MODE=100600 SIZE=0 MTIME=Mar 8 22:46 2005 RECONNECT? no CLEAR? no ** Phase 5 - Check Cyl groups 196 files, 148 used, 515923 free (43 frags, 64485 blocks, 0.0% fragmentation) ** /dev/ad0s1f (NO WRITE) ** Last Mounted on /usr ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts ** Phase 5 - Check Cyl groups 341375 files, 2396458 used, 22803387 free (148955 frags, 2831804 blocks, 0.6% fragmentation) ** /dev/ad0s1g (NO WRITE) ** Last Mounted on /var ** Phase 1 - Check Blocks and Sizes ** Phase 2 - Check Pathnames ** Phase 3 - Check Connectivity ** Phase 4 - Check Reference Counts UNREF FILE I=668162 OWNER=mysql MODE=100600 SIZE=0 MTIME=Mar 8 22:41 2005 CLEAR? no UNREF FILE I=668163 OWNER=mysql MODE=100600 SIZE=0 MTIME=Mar 8 22:41 2005 CLEAR? no UNREF FILE I=668171 OWNER=mysql MODE=100600 SIZE=0 MTIME=Mar 8 22:41 2005 CLEAR? no ** Phase 5 - Check Cyl groups FREE BLK COUNT(S) WRONG IN SUPERBLK SALVAGE? no SUMMARY INFORMATION BAD SALVAGE? no BLK(S) MISSING IN BIT MAPS SALVAGE? no ========== [*] Is this a normal output for fsck or not? [*] Will it cause hard disk failure in the future ? Please Help Best Wishes Mo From owner-freebsd-fs@FreeBSD.ORG Wed Mar 9 14:12:14 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5F82916A4CE; Wed, 9 Mar 2005 14:12:14 +0000 (GMT) Received: from vms048pub.verizon.net (vms048pub.verizon.net [206.46.252.48]) by mx1.FreeBSD.org (Postfix) with ESMTP id 43F4443D1D; Wed, 9 Mar 2005 14:12:14 +0000 (GMT) (envelope-from mi@corbulon.video-collage.com) Received: from corbulon.video-collage.com ([151.204.231.237]) by vms048.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0ID300LPY8SDO810@vms048.mailsrvcs.net>; Wed, 09 Mar 2005 08:12:13 -0600 (CST) Received: from corbulon.video-collage.comcorbulon.video-collage.com (8.13.1/8.13.1) with ESMTP id j29ECCuN047945 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 09 Mar 2005 09:12:12 -0500 Received: (from mi@localhost) by corbulon.video-collage.com (8.13.1/8.13.1/Submit) id j29ECC2K047944; Wed, 09 Mar 2005 09:12:12 -0500 (EST envelope-from mi) Date: Wed, 09 Mar 2005 09:12:12 -0500 (EST) From: Mikhail Teterin To: questions@FreeBSD.org, freebsd-fs@FreeBSD.org Message-id: <200503091412.j29ECC2K047944@corbulon.video-collage.com> MIME-version: 1.0 X-Mailer: ELM [version 2.5 PL7] Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7bit X-Virus-Scanned: clamd / ClamAV version devel-20040615, clamav-milter version 0.73a on corbulon.video-collage.com X-Virus-Status: Clean X-Scanned-By: MIMEDefang 2.43 Subject: disklabel disappeared after power loss X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 14:12:14 -0000 Hello! This is a 4.11-STABLE from Dec 24. After a sudden power loss, one of the disks (ad2) can not recover. It was "dangerously dedicated" and had two partitions -- swap (ad2b) and data (ad2e). Any attempts to use either (swapon, fsck, mount) now result in EINVAL. `disklabel ad2' creates an imaginary label with only the ad2c covering the entire drive. If I try to add the ad2b and ad2e in disklabel (I remember the sizes), I get: disklabel: Operation not supported by device I can read from /dev/ad2 directly. How can I restore access to the filesystem? Thanks! -mi From owner-freebsd-fs@FreeBSD.ORG Wed Mar 9 14:38:10 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9E72B16A4CE; Wed, 9 Mar 2005 14:38:10 +0000 (GMT) Received: from vms046pub.verizon.net (vms046pub.verizon.net [206.46.252.46]) by mx1.FreeBSD.org (Postfix) with ESMTP id 75E8643D39; Wed, 9 Mar 2005 14:38:10 +0000 (GMT) (envelope-from mi@corbulon.video-collage.com) Received: from corbulon.video-collage.com ([151.204.231.237]) by vms046.mailsrvcs.net (Sun Java System Messaging Server 6.2 HotFix 0.04 (built Dec 24 2004)) with ESMTPA id <0ID3001AZ9ZLNHB0@vms046.mailsrvcs.net>; Wed, 09 Mar 2005 08:38:10 -0600 (CST) Received: from corbulon.video-collage.comcorbulon.video-collage.com (8.13.1/8.13.1) with ESMTP id j29Ec8J0048262 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 09 Mar 2005 09:38:08 -0500 Received: (from mi@localhost) by corbulon.video-collage.com (8.13.1/8.13.1/Submit) id j29Ec861048261; Wed, 09 Mar 2005 09:38:08 -0500 (EST envelope-from mi) Date: Wed, 09 Mar 2005 09:38:08 -0500 (EST) From: Mikhail Teterin In-reply-to: <20050309142641.53158.qmail@web41205.mail.yahoo.com> To: arne_woerner@yahoo.com (Arne "Wörner") Message-id: <200503091438.j29Ec861048261@corbulon.video-collage.com> MIME-version: 1.0 X-Mailer: ELM [version 2.5 PL7] Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7bit X-Virus-Scanned: clamd / ClamAV version devel-20040615, clamav-milter version 0.73a on corbulon.video-collage.com X-Virus-Status: Clean X-Scanned-By: MIMEDefang 2.43 cc: freebsd-fs@FreeBSD.org cc: questions@FreeBSD.org Subject: Re: disklabel disappeared after power loss X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 14:38:10 -0000 Thank you very much for the quick response! > > After a sudden power loss, one of the disks (ad2) can not > > recover. > What does `fdisk ad2' say? Some nonsense -- as if I had only a 30Mb partition-4... > What does `disklabel ad2' say? Something about "amnesiac" with only the c-partition. I used /stand/sysinstall to create a small swap partition at the beginning of the drive. I don't know, what it does, but it re-created the label, which I was then able to edit with disklabel. scan_ffs (from the sysutils/scan_ffs) helped me recover the exact size and offset. I wish, fsck had scan_ffs' functionality built-in... > Maybe something is messed up, so that disklabel does not dare to > write a new disklabel. Well, sysinstall did not mind... > Is something from ad2 mounted read-writeable, when you get the "Op > not perm" error? No, definetly not. > How about > 1. copying the data from the former ad2e into another filesystem, This is a 50% full 180Gb disk. The only other disk nearby is a 20Gb system drive... > 3. establishing an all new disklabel with proper ad2e? :-) > (most likely ad2e is too big?) ad2e was not too big -- it did not exist. But sysinstall did the job. Perhaps, disklabel needs to learn a few tricks from that tool. And, of course, the main question is, why could the label disappear as a result of something as mundane as powerloss? Yours, -mi From owner-freebsd-fs@FreeBSD.ORG Wed Mar 9 23:38:33 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7BBC516A4CE; Wed, 9 Mar 2005 23:38:33 +0000 (GMT) Received: from harik.murex.com (mail.murex.com [194.98.239.11]) by mx1.FreeBSD.org (Postfix) with ESMTP id CCA5943D31; Wed, 9 Mar 2005 23:38:32 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: from interscan.fr.murex.com (iscan.murex.fr [172.21.17.207] (may be forged)) by harik.murex.com with ESMTP id j29NRpbW027830; Thu, 10 Mar 2005 00:27:51 +0100 (CET) Received: from mxmail.murex.com (interscan.murex.fr [127.0.0.1]) by interscan.fr.murex.com (8.11.6/8.11.6) with ESMTP id j29NlLN15139; Thu, 10 Mar 2005 00:47:24 +0100 Received: from mteterin.us.murex.com ([172.21.130.86]) by mxmail.murex.com with Microsoft SMTPSVC(6.0.3790.0); Thu, 10 Mar 2005 00:38:01 +0100 From: Mikhail Teterin Organization: Virtual Estates, Inc. To: hackers@FreeBSD.org Date: Wed, 9 Mar 2005 18:38:06 -0500 User-Agent: KMail/1.7.2 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200503091838.06322.mi+mx@aldan.algebra.com> X-OriginalArrivalTime: 09 Mar 2005 23:38:02.0221 (UTC) FILETIME=[08C461D0:01C52501] cc: freebsd-fs@FreeBSD.org Subject: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 23:38:33 -0000 Hello! The respected manual contain dire warnings, but the Google search suggests, the situation is not *that* gloomy. For example, according to http://kerneltrap.org/node/652 , nullfs was used on Bento-cluster two years ago in 2003. Is anybody working on this file-systems? Any plans, rumours? What about the `union' option to regular mounts? Is that safe to use? Thanks! -mi From owner-freebsd-fs@FreeBSD.ORG Wed Mar 9 23:46:35 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A9AB216A4CE for ; Wed, 9 Mar 2005 23:46:35 +0000 (GMT) Received: from moe.cs.uoguelph.ca (moe.cs.uoguelph.ca [131.104.96.55]) by mx1.FreeBSD.org (Postfix) with ESMTP id 20B0943D31 for ; Wed, 9 Mar 2005 23:46:35 +0000 (GMT) (envelope-from rick@snowhite.cis.uoguelph.ca) Received: from snowhite.cis.uoguelph.ca (snowhite.cis.uoguelph.ca [131.104.48.1]) by moe.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id j29NkRJa019262; Wed, 9 Mar 2005 18:46:27 -0500 Received: (from rick@localhost) by snowhite.cis.uoguelph.ca (8.9.3/8.9.3) id SAA67710; Wed, 9 Mar 2005 18:48:04 -0500 (EST) Date: Wed, 9 Mar 2005 18:48:04 -0500 (EST) From: rick@snowhite.cis.uoguelph.ca Message-Id: <200503092348.SAA67710@snowhite.cis.uoguelph.ca> To: drhodus@machdep.com, fs@freebsd.org, hackers@opendarwin.org, tech@openbsd.org X-Scanned-By: MIMEDefang 2.44 Subject: NFSv4 patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 23:46:35 -0000 In case anyone is interested, I've put an important patch for my NFSv4 server up anonymous ftpable from ftp.cis.uoguelph.ca in pub/nfsv4/patch1.diff. Good luck with it if you try it, rick From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 00:49:19 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: by hub.freebsd.org (Postfix, from userid 758) id 19E9216A4CE; Thu, 10 Mar 2005 00:49:19 +0000 (GMT) Date: Thu, 10 Mar 2005 00:49:19 +0000 From: Kris Kennaway To: Mikhail Teterin Message-ID: <20050310004919.GA34206@hub.freebsd.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200503091838.06322.mi+mx@aldan.algebra.com> User-Agent: Mutt/1.4.2.1i cc: freebsd-fs@FreeBSD.org cc: hackers@FreeBSD.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 00:49:19 -0000 On Wed, Mar 09, 2005 at 06:38:06PM -0500, Mikhail Teterin wrote: > Hello! > > The respected manual contain dire warnings, but the Google search suggests, > the situation is not *that* gloomy. > > For example, according to http://kerneltrap.org/node/652 , nullfs was used on > Bento-cluster two years ago in 2003. nullfs seems to work fine, unionfs is very fragile and easily exploded. > Is anybody working on this file-systems? Any plans, rumours? > > What about the `union' option to regular mounts? Is that safe to use? Yes. Kris From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 01:29:00 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 34F7C16A4CE; Thu, 10 Mar 2005 01:28:59 +0000 (GMT) Received: from filer.fsl.cs.sunysb.edu (filer.fsl.cs.sunysb.edu [130.245.126.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 711C643D5C; Thu, 10 Mar 2005 01:28:58 +0000 (GMT) (envelope-from ezk@fsl.cs.sunysb.edu) Received: from agora.fsl.cs.sunysb.edu (agora.fsl.cs.sunysb.edu [130.245.126.12])j2A1SQmX016359; Wed, 9 Mar 2005 20:28:26 -0500 Received: from agora.fsl.cs.sunysb.edu (localhost.localdomain [127.0.0.1]) j2A1SP71014424; Wed, 9 Mar 2005 20:28:25 -0500 Received: (from ezk@localhost) by agora.fsl.cs.sunysb.edu (8.12.11/8.12.8/Submit) id j2A1SP4h014420; Wed, 9 Mar 2005 20:28:25 -0500 Date: Wed, 9 Mar 2005 20:28:25 -0500 Message-Id: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> From: Erez Zadok To: Mikhail Teterin In-reply-to: Your message of "Wed, 09 Mar 2005 18:38:06 EST." <200503091838.06322.mi+mx@aldan.algebra.com> X-MailKey: Erez_Zadok cc: freebsd-fs@freebsd.org cc: hackers@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 01:29:00 -0000 At the risk of bringing up the "L" word on this forum :-), we have a fan-out unionfs implementation for Linux that doesn't explode very easily. See http://www.filesystems.org/project-unionfs.html Cheers, Erez. From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 02:36:33 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 879A516A4CE; Thu, 10 Mar 2005 02:36:33 +0000 (GMT) Received: from VARK.MIT.EDU (VARK.MIT.EDU [18.95.3.179]) by mx1.FreeBSD.org (Postfix) with ESMTP id C5EFF43D2F; Thu, 10 Mar 2005 02:36:32 +0000 (GMT) (envelope-from das@FreeBSD.ORG) Received: from VARK.MIT.EDU (localhost [127.0.0.1]) by VARK.MIT.EDU (8.13.3/8.13.1) with ESMTP id j2A2ZJRM011821; Wed, 9 Mar 2005 21:35:19 -0500 (EST) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by VARK.MIT.EDU (8.13.3/8.13.1/Submit) id j2A2ZJWi011820; Wed, 9 Mar 2005 21:35:19 -0500 (EST) (envelope-from das@FreeBSD.ORG) Date: Wed, 9 Mar 2005 21:35:19 -0500 From: David Schultz To: Mikhail Teterin Message-ID: <20050310023518.GA11712@VARK.MIT.EDU> Mail-Followup-To: Mikhail Teterin , hackers@FreeBSD.ORG, freebsd-fs@FreeBSD.ORG References: <200503091838.06322.mi+mx@aldan.algebra.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200503091838.06322.mi+mx@aldan.algebra.com> cc: freebsd-fs@FreeBSD.ORG cc: hackers@FreeBSD.ORG Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 02:36:33 -0000 On Wed, Mar 09, 2005, Mikhail Teterin wrote: > Hello! > > The respected manual contain dire warnings, but the Google search suggests, > the situation is not *that* gloomy. > > For example, according to http://kerneltrap.org/node/652 , nullfs was used on > Bento-cluster two years ago in 2003. > > Is anybody working on this file-systems? Any plans, rumours? Nullfs works better than unionfs. Unionfs worked well in 4.X. Despite numerous minor bugs such as being unable to cope with FIFOs, several people have reported using it quite successfully on production systems. However, unionfs no longer works quite as well in 5.X or -CURRENT. There are several reasons for this: 1. Nobody seems to have both the time and interest to maintain it. 2. Developers can't be expected to prevent regressions in something that's unsupported. 3. There are a couple of people who always respond to questions about unionfs with comments along the lines of: ``It's broken, so we won't help you. Go away and don't tell us if you find any bugs.'' There's some pretty low-hanging fruit in terms of nits to fix. See the PR database if you're interested in helping, and don't let anyone scare you away. ;-) > What about the `union' option to regular mounts? Is that safe to use? Last I checked, it was very broken, but I'm not sure. From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 07:49:15 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2EE8216A4CE for ; Thu, 10 Mar 2005 07:49:15 +0000 (GMT) Received: from carver.gumbysoft.com (carver.gumbysoft.com [66.220.23.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 00E0F43D4C for ; Thu, 10 Mar 2005 07:49:15 +0000 (GMT) (envelope-from dwhite@gumbysoft.com) Received: by carver.gumbysoft.com (Postfix, from userid 1000) id ED63B72DD4; Wed, 9 Mar 2005 23:49:14 -0800 (PST) Received: from localhost (localhost [127.0.0.1]) by carver.gumbysoft.com (Postfix) with ESMTP id E891872DCB; Wed, 9 Mar 2005 23:49:14 -0800 (PST) Date: Wed, 9 Mar 2005 23:49:14 -0800 (PST) From: Doug White To: mohammad babaei In-Reply-To: <5bf3a41f05030823275ece0cc3@mail.gmail.com> Message-ID: <20050309234805.T53915@carver.gumbysoft.com> References: <5bf3a41f05030823275ece0cc3@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-fs@freebsd.org Subject: Re: fsck output X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 07:49:15 -0000 On Wed, 9 Mar 2005, mohammad babaei wrote: > Dear Sirs, > > we have a production server running FreeBSD 4.10 RELEASE , when we run > fsck on the machine it's out put is something like this: > ======== [...] > ** /dev/ad0s1e (NO WRITE) > ** Last Mounted on /tmp > ** Phase 1 - Check Blocks and Sizes > ** Phase 2 - Check Pathnames > ** Phase 3 - Check Connectivity > ** Phase 4 - Check Reference Counts > UNREF FILE I=102 OWNER=www MODE=100600 > SIZE=0 MTIME=Mar 8 22:46 2005 > RECONNECT? no > > > CLEAR? no [..] > ** /dev/ad0s1g (NO WRITE) > ** Last Mounted on /var > ** Phase 1 - Check Blocks and Sizes > ** Phase 2 - Check Pathnames > ** Phase 3 - Check Connectivity > ** Phase 4 - Check Reference Counts > UNREF FILE I=668162 OWNER=mysql MODE=100600 > SIZE=0 MTIME=Mar 8 22:41 2005 > CLEAR? no > > UNREF FILE I=668163 OWNER=mysql MODE=100600 > SIZE=0 MTIME=Mar 8 22:41 2005 > CLEAR? no > > UNREF FILE I=668171 OWNER=mysql MODE=100600 > SIZE=0 MTIME=Mar 8 22:41 2005 > CLEAR? no > > ** Phase 5 - Check Cyl groups > FREE BLK COUNT(S) WRONG IN SUPERBLK > SALVAGE? no > > SUMMARY INFORMATION BAD > SALVAGE? no > > BLK(S) MISSING IN BIT MAPS > SALVAGE? no > > ========== > [*] Is this a normal output for fsck or not? > [*] Will it cause hard disk failure in the future ? What options did you run fsck with? Under normal circumstances after a crash these types of messages are typical. -- Doug White | FreeBSD: The Power to Serve dwhite@gumbysoft.com | www.FreeBSD.org From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 11:38:33 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4513616A4CE; Thu, 10 Mar 2005 11:38:33 +0000 (GMT) Received: from deliver.smtp.vlink.ru (alias.rigel.internal.vlink.ru [217.23.88.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id D9CAF43D54; Thu, 10 Mar 2005 11:38:31 +0000 (GMT) (envelope-from dsh@vlink.ru) Received: from smtp.smtp.vlink.ru (clamav.smtp.vlink.ru [192.168.4.1]) by deliver.smtp.vlink.ru (Postfix) with ESMTP id 78A6445CE5; Thu, 10 Mar 2005 14:38:29 +0300 (MSK) Received: from neva.vlink.ru (neva.vlink.ru [217.107.252.29]) by smtp.smtp.vlink.ru (Postfix) with ESMTP id 2CA2145C90; Thu, 10 Mar 2005 14:38:29 +0300 (MSK) Received: from neva.vlink.ru (localhost [127.0.0.1]) by neva.vlink.ru (8.13.3/8.13.3) with ESMTP id j2ABcS1o010999; Thu, 10 Mar 2005 14:38:28 +0300 (MSK) (envelope-from dsh@vlink.ru) Received: (from dsh@localhost) by neva.vlink.ru (8.13.3/8.13.3/Submit) id j2ABcSZU010996; Thu, 10 Mar 2005 14:38:28 +0300 (MSK) (envelope-from dsh@vlink.ru) X-Comment-To: Kris Kennaway To: Kris Kennaway References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> From: Denis Shaposhnikov Date: Thu, 10 Mar 2005 14:38:28 +0300 In-Reply-To: <20050310004919.GA34206@hub.freebsd.org> (Kris Kennaway's message of "Thu, 10 Mar 2005 00:49:19 +0000") Message-ID: <87ll8vn32j.fsf@neva.vlink.ru> User-Agent: Gnus/5.1006 (Gnus v5.10.6) XEmacs/21.4 (Jumbo Shrimp, berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Scanned: ClamAV using ClamSMTP cc: freebsd-fs@freebsd.org cc: Mikhail Teterin cc: hackers@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 11:38:33 -0000 >>>>> "Kris" == Kris Kennaway writes: Kris> nullfs seems to work fine, unionfs is very fragile and easily Kris> exploded. nullfs is absolutely useless for jail's because TOO slow. -- DSS5-RIPE DSS-RIPN 2:550/5068@fidonet 2:550/5069@fidonet mailto:dsh@vlink.ru http://neva.vlink.ru/~dsh/ From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 11:38:48 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6B82D16A4CE; Thu, 10 Mar 2005 11:38:48 +0000 (GMT) Received: from postfix3-2.free.fr (postfix3-2.free.fr [213.228.0.169]) by mx1.FreeBSD.org (Postfix) with ESMTP id E22AD43D5F; Thu, 10 Mar 2005 11:38:47 +0000 (GMT) (envelope-from tataz@tataz.chchile.org) Received: from tatooine.tataz.chchile.org (vol75-8-82-233-239-98.fbx.proxad.net [82.233.239.98]) by postfix3-2.free.fr (Postfix) with ESMTP id D4CC0C165; Thu, 10 Mar 2005 12:38:46 +0100 (CET) Received: by tatooine.tataz.chchile.org (Postfix, from userid 1000) id 79A85407C; Thu, 10 Mar 2005 12:38:43 +0100 (CET) Date: Thu, 10 Mar 2005 12:38:43 +0100 From: Jeremie Le Hen To: David Schultz Message-ID: <20050310113843.GJ34822@obiwan.tataz.chchile.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310023518.GA11712@VARK.MIT.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050310023518.GA11712@VARK.MIT.EDU> User-Agent: Mutt/1.5.8i cc: freebsd-fs@FreeBSD.ORG cc: Mikhail Teterin cc: hackers@FreeBSD.ORG Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 11:38:48 -0000 Hi David, > Nullfs works better than unionfs. Unionfs worked well in 4.X. > Despite numerous minor bugs such as being unable to cope with > FIFOs, several people have reported using it quite successfully on > production systems. However, unionfs no longer works quite as > well in 5.X or -CURRENT. There are several reasons for this: > > 1. Nobody seems to have both the time and interest to maintain it. > > 2. Developers can't be expected to prevent regressions in > something that's unsupported. > > 3. There are a couple of people who always respond to questions > about unionfs with comments along the lines of: > ``It's broken, so we won't help you. Go away and don't tell > us if you find any bugs.'' > > There's some pretty low-hanging fruit in terms of nits to fix. > See the PR database if you're interested in helping, and don't let > anyone scare you away. ;-) > > > What about the `union' option to regular mounts? Is that safe to use? > > Last I checked, it was very broken, but I'm not sure. A little time ago, phk@ asked for people to submit regression tests for virtual filesystem like this [1]. AFAIK, nobody submitted even one test so far. This could be a good starting point to have unionfs work correctly again. However, I think FreeBSD VFS gurus should first spread some ideas and clues about tests to do. I guess indeed there are very tricky ones that most common mortals wouldn't even suspect. Regards, [1] http://lists.freebsd.org/pipermail/freebsd-current/2005-January/045743.html -- Jeremie Le Hen < jeremie at le-hen dot org >< ttz at chchile dot org > From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 14:19:36 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0B13E16A4EB; Thu, 10 Mar 2005 14:19:33 +0000 (GMT) Received: from bewilderbeast.blackhelicopters.org (bewilderbeast.blackhelicopters.org [198.22.63.43]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4409943D48; Thu, 10 Mar 2005 14:19:33 +0000 (GMT) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: from bewilderbeast.blackhelicopters.org (mwlucas@localhost [127.0.0.1])j2AEJB2f072911; Thu, 10 Mar 2005 09:19:11 -0500 (EST) (envelope-from mwlucas@bewilderbeast.blackhelicopters.org) Received: (from mwlucas@localhost)j2AEJAhI072910; Thu, 10 Mar 2005 09:19:10 -0500 (EST) (envelope-from mwlucas) Date: Thu, 10 Mar 2005 09:19:10 -0500 From: "Michael W. Lucas" To: Jeremie Le Hen Message-ID: <20050310141910.GA72868@bewilderbeast.blackhelicopters.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310023518.GA11712@VARK.MIT.EDU> <20050310113843.GJ34822@obiwan.tataz.chchile.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050310113843.GJ34822@obiwan.tataz.chchile.org> User-Agent: Mutt/1.4.1i X-Spam-Score: (0) X-Scanned-By: MIMEDefang 2.39 cc: freebsd-fs@freebsd.org cc: David Schultz cc: hackers@freebsd.org cc: Mikhail Teterin Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 14:19:36 -0000 On Thu, Mar 10, 2005 at 12:38:43PM +0100, Jeremie Le Hen wrote: > A little time ago, phk@ asked for people to submit regression tests for > virtual filesystem like this [1]. AFAIK, nobody submitted even one test > so far. This could be a good starting point to have unionfs work > correctly again. However, I think FreeBSD VFS gurus should first spread > some ideas and clues about tests to do. I guess indeed there are very > tricky ones that most common mortals wouldn't even suspect. But the mere existence of even a basic regression test would be a start and would encourage people to not hose things further. Folks, don't let the fact that you're not a guru stop you from taking a kiddie step and submitting a basic test! ==ml (who uses neither unionfs nor nullfs because of the scary man pages) -- Michael W. Lucas mwlucas@FreeBSD.org, mwlucas@BlackHelicopters.org http://www.BlackHelicopters.org/~mwlucas/ Latest book: Cisco Routers for the Desperate http://www.CiscoRoutersForTheDesperate.com From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 16:08:58 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A15DF16A4CE for ; Thu, 10 Mar 2005 16:08:58 +0000 (GMT) Received: from mail.crypta.net (mail.crypta.net [83.136.131.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2A53243D55 for ; Thu, 10 Mar 2005 16:08:58 +0000 (GMT) (envelope-from ah@crypta.net) Received: by mail.crypta.net (cryptobank/eProtect-smtpd, from userid 1001) id 86294ECD425; Thu, 10 Mar 2005 17:08:53 +0100 (CET) Date: Thu, 10 Mar 2005 17:08:53 +0100 From: Andy Hilker To: Denis Shaposhnikov Message-ID: <20050310160852.GB1718@mail.crypta.net> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87ll8vn32j.fsf@neva.vlink.ru> User-Agent: Mutt/1.4.2.1i X-PGP-Key: http://wwwkeys.pgp.net:11371/pks/lookup?op=get&search=0xEC6E1071 X-PGP-Fingerprint: 9B2E 5892 AD93 D5C5 FB8E 3912 35D6 951B EC6E 1071 Organization: cryptobank - Andy Hilker cc: freebsd-fs@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 16:08:58 -0000 Hi, You (Denis Shaposhnikov) wrote: > >>>>> "Kris" == Kris Kennaway writes: > > Kris> nullfs seems to work fine, unionfs is very fragile and easily > Kris> exploded. > > nullfs is absolutely useless for jail's because TOO slow. What do you mean exactly, how do you benchmark this? bye, Andy From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 16:45:08 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 36B6216A4CE for ; Thu, 10 Mar 2005 16:45:08 +0000 (GMT) Received: from hub.org (hub.org [200.46.204.220]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E6EF43D5D for ; Thu, 10 Mar 2005 16:45:07 +0000 (GMT) (envelope-from scrappy@hub.org) Received: from localhost (unknown [200.46.204.144]) by hub.org (Postfix) with ESMTP id 2DDAD1299BA; Thu, 10 Mar 2005 12:45:06 -0400 (AST) Received: from hub.org ([200.46.204.220]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 82914-06; Thu, 10 Mar 2005 16:45:06 +0000 (GMT) Received: from ganymede.hub.org (blk-222-46-186.eastlink.ca [24.222.46.186]) by hub.org (Postfix) with ESMTP id B1ADB1299F2; Thu, 10 Mar 2005 12:45:05 -0400 (AST) Received: by ganymede.hub.org (Postfix, from userid 1000) id C49BB5F585; Thu, 10 Mar 2005 12:45:04 -0400 (AST) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id C0E8B5F3E9; Thu, 10 Mar 2005 12:45:04 -0400 (AST) Date: Thu, 10 Mar 2005 12:45:04 -0400 (AST) From: "Marc G. Fournier" To: Andy Hilker In-Reply-To: <20050310160852.GB1718@mail.crypta.net> Message-ID: <20050310123852.F92893@ganymede.hub.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> <20050310160852.GB1718@mail.crypta.net> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Scanned: by amavisd-new at hub.org cc: freebsd-fs@freebsd.org cc: Denis Shaposhnikov Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 16:45:08 -0000 On Thu, 10 Mar 2005, Andy Hilker wrote: > Hi, > > You (Denis Shaposhnikov) wrote: >>>>>>> "Kris" == Kris Kennaway writes: >> >> Kris> nullfs seems to work fine, unionfs is very fragile and easily >> Kris> exploded. >> >> nullfs is absolutely useless for jail's because TOO slow. > > > What do you mean exactly, how do you benchmark this? That's okay, my experiences are that nullfs is too fragile and easily exploded ... unionfs itself, though, isn't *rock solid*, but considering the loads that I throw at it on a daily basis, its alot more solid then the man pages indicate ... One server I have running 80+ jails on, each with their own unionfs running on it, and the last crash was a result of: panic: ufs_direnter : compact2 uptimes on our servers, all of which use unionfs extensively: pluto# ruptime jupiter up 11+23:09, 0 users, load 0.65, 0.78, 1.06 mars up 12+01:06, 0 users, load 0.53, 0.50, 0.55 neptune up 1+21:42, 3 users, load 2.03, 3.16, 3.10 pluto up 12+00:54, 3 users, load 1.33, 1.12, 1.34 venus up 12+00:00, 0 users, load 2.99, 10.73, 15.76 venus/neptune each run >80 jails ... And the reason why the other 4 servers are only around 12 days right now is because we just moved the servers to a new rack ... All servers run 4-STABLE, some a bit older, but a couple are less then a month old ... ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664 From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:05:54 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6449216A4CE for ; Thu, 10 Mar 2005 17:05:54 +0000 (GMT) Received: from dargo.cs.uoguelph.ca (dargo.cs.uoguelph.ca [131.104.96.159]) by mx1.FreeBSD.org (Postfix) with ESMTP id BC8DA43D53 for ; Thu, 10 Mar 2005 17:05:53 +0000 (GMT) (envelope-from rick@snowhite.cis.uoguelph.ca) Received: from snowhite.cis.uoguelph.ca (snowhite.cis.uoguelph.ca [131.104.48.1]) by dargo.cs.uoguelph.ca (8.13.1/8.13.1) with ESMTP id j2AH5qqO003085 for ; Thu, 10 Mar 2005 12:05:52 -0500 Received: (from rick@localhost) by snowhite.cis.uoguelph.ca (8.9.3/8.9.3) id MAA75671 for freebsd-fs@freebsd.org; Thu, 10 Mar 2005 12:07:31 -0500 (EST) Date: Thu, 10 Mar 2005 12:07:31 -0500 (EST) From: rick@snowhite.cis.uoguelph.ca Message-Id: <200503101707.MAA75671@snowhite.cis.uoguelph.ca> To: freebsd-fs@freebsd.org X-Scanned-By: MIMEDefang 2.44 Subject: nfsv4 server patch X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:05:54 -0000 In case anyone is interested, I've put an important patch for my NFSv4 server up anonymous ftpable from ftp.cis.uoguelph.ca in /pub/nfsv4/patch1.diff. Have fun with the server, if you try it, rick From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:07:15 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: by hub.freebsd.org (Postfix, from userid 758) id 2911416A4CF; Thu, 10 Mar 2005 17:07:15 +0000 (GMT) Date: Thu, 10 Mar 2005 17:07:15 +0000 From: Kris Kennaway To: "Marc G. Fournier" Message-ID: <20050310170715.GD34206@hub.freebsd.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> <20050310160852.GB1718@mail.crypta.net> <20050310123852.F92893@ganymede.hub.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20050310123852.F92893@ganymede.hub.org> User-Agent: Mutt/1.4.2.1i cc: freebsd-fs@freebsd.org cc: Denis Shaposhnikov cc: Andy Hilker Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:07:15 -0000 On Thu, Mar 10, 2005 at 12:45:04PM -0400, Marc G. Fournier wrote: > On Thu, 10 Mar 2005, Andy Hilker wrote: > > >Hi, > > > >You (Denis Shaposhnikov) wrote: > >>>>>>>"Kris" == Kris Kennaway writes: > >> > >> Kris> nullfs seems to work fine, unionfs is very fragile and easily > >> Kris> exploded. > >> > >>nullfs is absolutely useless for jail's because TOO slow. > > > > > >What do you mean exactly, how do you benchmark this? > > That's okay, my experiences are that nullfs is too fragile and easily > exploded ... I was referring to 5.x and above. Kris From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:24:18 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id ABFED16A4CE for ; Thu, 10 Mar 2005 17:24:18 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id EEC4A43D3F for ; Thu, 10 Mar 2005 17:24:17 +0000 (GMT) (envelope-from loukamenov@gmail.com) Received: by rproxy.gmail.com with SMTP id 34so364086rns for ; Thu, 10 Mar 2005 09:24:17 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=BP4j6Rp4oVLIHfbGKy38d1d/jLa6AdgzczL+pVkueGnhZZINSMOGYHM72Bqao9Qsb1+M03qa2Q5jhl4b2eSRrIxkcxtsFZn2+1opeITHGTofJ2QO/K5XXN60+duVnIsGdg8UxCuWBnJyAanhB/Jfu82mnegiav9q5K2tgw2Wu04= Received: by 10.38.179.14 with SMTP id b14mr663794rnf; Thu, 10 Mar 2005 09:24:17 -0800 (PST) Received: by 10.38.179.75 with HTTP; Thu, 10 Mar 2005 09:24:17 -0800 (PST) Message-ID: <76f962c6050310092461fc850@mail.gmail.com> Date: Thu, 10 Mar 2005 12:24:17 -0500 From: Lou Kamenov To: "Michael W. Lucas" In-Reply-To: <20050310141910.GA72868@bewilderbeast.blackhelicopters.org> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310023518.GA11712@VARK.MIT.EDU> <20050310113843.GJ34822@obiwan.tataz.chchile.org> <20050310141910.GA72868@bewilderbeast.blackhelicopters.org> cc: freebsd-fs@freebsd.org cc: David Schultz cc: hackers@freebsd.org cc: Jeremie Le Hen cc: Mikhail Teterin Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Lou Kamenov List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:24:18 -0000 On Thu, 10 Mar 2005 09:19:10 -0500, Michael W. Lucas wrote: > On Thu, Mar 10, 2005 at 12:38:43PM +0100, Jeremie Le Hen wrote: > But the mere existence of even a basic regression test would be a > start and would encourage people to not hose things further. [..] > Folks, don't let the fact that you're not a guru stop you from taking > a kiddie step and submitting a basic test! [..] I do use unionfs on daily basis. Mostly to union $home/bin directories and such. For the last 1.5y I had it crash only 2 times. Of course trying to unmount /bin will turn into hell. I've used it successfully with pdumpfs from ports to restore old filespace view. I surely think that a stable unionfs will be a good thing (tm). Erez's unionfs has the same problem, the case there is that you wont be able to unmount it at all. (At least last time I tried with 1.0.3) Problem or not it could be easily solved with simple heuristics. Building a filespace with unioning shouldnt really be that hard. best, l From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:46:21 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D24F116A4CE for ; Thu, 10 Mar 2005 17:46:21 +0000 (GMT) Received: from filer.fsl.cs.sunysb.edu (filer.fsl.cs.sunysb.edu [130.245.126.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 76E9A43D39 for ; Thu, 10 Mar 2005 17:46:21 +0000 (GMT) (envelope-from cwright@cs.sunysb.edu) Received: from polarbear.fsl.cs.sunysb.edu (polarbear.fsl.cs.sunysb.edu [130.245.126.42])j2AHkKmX016690; Thu, 10 Mar 2005 12:46:20 -0500 From: "Charles P. Wright" To: Lou Kamenov In-Reply-To: <76f962c6050310092461fc850@mail.gmail.com> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310023518.GA11712@VARK.MIT.EDU> <20050310113843.GJ34822@obiwan.tataz.chchile.org> <20050310141910.GA72868@bewilderbeast.blackhelicopters.org> <76f962c6050310092461fc850@mail.gmail.com> Content-Type: text/plain Date: Thu, 10 Mar 2005 12:45:53 -0500 Message-Id: <1110476753.20632.11.camel@polarbear.fsl.cs.sunysb.edu> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-8) Content-Transfer-Encoding: 7bit cc: freebsd-fs@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:46:22 -0000 On Thu, 2005-03-10 at 12:24 -0500, Lou Kamenov wrote: > Erez's unionfs has the same problem, the case there is that you wont be able to > unmount it at all. (At least last time I tried with 1.0.3) The code has improved quite a bit since then. We've ironed out most of of the big bugs (there are still other smaller ones to go, but we are making reasonable progress). A recent version has been included in Knoppix 3.8. > Problem or not it could be easily solved with simple heuristics. > Building a filespace > with unioning shouldnt really be that hard. That isn't quite true. In theory, all you have to do is repeat some operations over many branches. In practice, building a Unioning file system is not an easy task. There are very many corner cases to deal with, and what were previously atomic VFS ops can require many operations. Charles From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:53:56 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C81C016A4CE; Thu, 10 Mar 2005 17:53:56 +0000 (GMT) Received: from harik.murex.com (mail.murex.com [194.98.239.11]) by mx1.FreeBSD.org (Postfix) with ESMTP id 110F843D46; Thu, 10 Mar 2005 17:53:56 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: from interscan.fr.murex.com (iscan.murex.fr [172.21.17.207] (may be forged)) by harik.murex.com with ESMTP id j2AHh4bW000178; Thu, 10 Mar 2005 18:43:04 +0100 (CET) Received: from mxmail.murex.com (interscan.murex.fr [127.0.0.1]) by interscan.fr.murex.com (8.11.6/8.11.6) with ESMTP id j2AI2gd30117; Thu, 10 Mar 2005 19:02:45 +0100 Received: from mteterin.us.murex.com ([172.21.130.86]) by mxmail.murex.com with Microsoft SMTPSVC(6.0.3790.0); Thu, 10 Mar 2005 18:53:16 +0100 From: Mikhail Teterin Organization: Virtual Estates, Inc. To: Erez Zadok Date: Thu, 10 Mar 2005 12:53:20 -0500 User-Agent: KMail/1.7.2 References: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> In-Reply-To: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-u" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200503101253.20876.mi+mx@aldan.algebra.com> X-OriginalArrivalTime: 10 Mar 2005 17:53:17.0015 (UTC) FILETIME=[09D62E70:01C5259A] cc: freebsd-fs@freebsd.org cc: hackers@freebsd.org Subject: What about inode file system? (Re: the current status of nullfs, unionfs) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:53:56 -0000 A few years ago, there was a project making a filesystem, where a file's name will simply be its inode number. It was intended to save on the name-to-inode lookups of a regular filesystem, for applications like Squid, which keep file names in some sort of a database already. Does anyone know, what became of that? To the naive me it seems like this can just be a mount option for ufs. Thanks! -mi From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 17:59:06 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A8FA816A4CE; Thu, 10 Mar 2005 17:59:06 +0000 (GMT) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5C42943D67; Thu, 10 Mar 2005 17:59:06 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id j2AHwi2T001335; Thu, 10 Mar 2005 09:58:44 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id j2AHwiUX001334; Thu, 10 Mar 2005 09:58:44 -0800 Date: Thu, 10 Mar 2005 09:58:44 -0800 From: Brooks Davis To: Mikhail Teterin Message-ID: <20050310175844.GA697@odin.ac.hmc.edu> References: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> <200503101253.20876.mi+mx@aldan.algebra.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="IJpNTDwzlM2Ie8A6" Content-Disposition: inline In-Reply-To: <200503101253.20876.mi+mx@aldan.algebra.com> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu cc: freebsd-fs@freebsd.org cc: Erez Zadok cc: hackers@freebsd.org Subject: Re: What about inode file system? (Re: the current status of nullfs, unionfs) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 17:59:06 -0000 --IJpNTDwzlM2Ie8A6 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Mar 10, 2005 at 12:53:20PM -0500, Mikhail Teterin wrote: > A few years ago, there was a project making a filesystem, where a file's = name=20 > will simply be its inode number. It was intended to save on the name-to-i= node=20 > lookups of a regular filesystem, for applications like Squid, which keep = file=20 > names in some sort of a database already. >=20 > Does anyone know, what became of that? To the naive me it seems like this= can=20 > just be a mount option for ufs. Thanks! The inode file system was removed to ease UFS2 development. It's in the Attic under sys/ufs/ifs. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --IJpNTDwzlM2Ie8A6 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFCMIrTXY6L6fI4GtQRAmUFAKDZTgY8b92cdRxo57quKET/hNyzZgCfdDgC v38NNl406BDXuI4Bg3w3ZH4= =TpEj -----END PGP SIGNATURE----- --IJpNTDwzlM2Ie8A6-- From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 18:45:37 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 793AD16A4CE; Thu, 10 Mar 2005 18:45:37 +0000 (GMT) Received: from filer.fsl.cs.sunysb.edu (filer.fsl.cs.sunysb.edu [130.245.126.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id DFA8E43D1F; Thu, 10 Mar 2005 18:45:36 +0000 (GMT) (envelope-from ezk@fsl.cs.sunysb.edu) Received: from agora.fsl.cs.sunysb.edu (agora.fsl.cs.sunysb.edu [130.245.126.12])j2AIj1mX018840; Thu, 10 Mar 2005 13:45:01 -0500 Received: from agora.fsl.cs.sunysb.edu (localhost.localdomain [127.0.0.1]) j2AIj0aL008588; Thu, 10 Mar 2005 13:45:00 -0500 Received: (from ezk@localhost) by agora.fsl.cs.sunysb.edu (8.12.11/8.12.8/Submit) id j2AIj0LB008584; Thu, 10 Mar 2005 13:45:00 -0500 Date: Thu, 10 Mar 2005 13:45:00 -0500 Message-Id: <200503101845.j2AIj0LB008584@agora.fsl.cs.sunysb.edu> From: Erez Zadok To: Lou Kamenov In-reply-to: Your message of "Thu, 10 Mar 2005 12:24:17 EST." <76f962c6050310092461fc850@mail.gmail.com> X-MailKey: Erez_Zadok cc: cwright@cs.sunysb.edu cc: Mikhail Teterin cc: "Michael W. Lucas" cc: freebsd-fs@freebsd.org cc: hackers@freebsd.org cc: David Schultz cc: Jeremie Le Hen Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 18:45:37 -0000 In message <76f962c6050310092461fc850@mail.gmail.com>, Lou Kamenov writes: > On Thu, 10 Mar 2005 09:19:10 -0500, Michael W. Lucas > wrote: > > On Thu, Mar 10, 2005 at 12:38:43PM +0100, Jeremie Le Hen wrote: > > But the mere existence of even a basic regression test would be a > > start and would encourage people to not hose things further. > [..] > > Folks, don't let the fact that you're not a guru stop you from taking > > a kiddie step and submitting a basic test! > [..] > > I do use unionfs on daily basis. Mostly to union $home/bin directories and > such. For the last 1.5y I had it crash only 2 times. Of course trying > to unmount /bin > will turn into hell. I've used it successfully with pdumpfs from ports > to restore > old filespace view. I surely think that a stable unionfs will be a > good thing (tm). > > Erez's unionfs has the same problem, the case there is that you wont be > able to unmount it at all. (At least last time I tried with 1.0.3) You should NEVER be allowed to unmount an underlying file system of a stackable file system, if it's busy or in use, no more than you can remove a /dev/sda drive while ffs is mounted on it. Our approach in the Linux unionfs is to prevent users from shooting themselves too much in the foot. :-) However, our unionfs does provide mechanisms such that read-only or non-busy file system branches in the union, *can* indeed be removed safely. Generally we can support arbitrary insertions and removals of branches anywhere in the (fan-out) union; however, we found out that most of our unionfs users rarely want or need that. BTW, the latest version of our linux unionfs is 1.0.9. There has been a lot of work done on our unionfs recently, and it was deemed stable enough that several LiveCD distros, including the just-released Knoppix 3.8, are using it. > Problem or not it could be easily solved with simple heuristics. > Building a filespace > with unioning shouldnt really be that hard. > > best, > l > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > Erez. From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 18:51:50 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AA22516A4CE; Thu, 10 Mar 2005 18:51:50 +0000 (GMT) Received: from harik.murex.com (mail.murex.com [194.98.239.11]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1240B43D3F; Thu, 10 Mar 2005 18:51:50 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: from interscan.fr.murex.com (iscan.murex.fr [172.21.17.207] (may be forged)) by harik.murex.com with ESMTP id j2AIeubW003850; Thu, 10 Mar 2005 19:40:56 +0100 (CET) Received: from mxmail.murex.com (interscan.murex.fr [127.0.0.1]) by interscan.fr.murex.com (8.11.6/8.11.6) with ESMTP id j2AJ0ap01929; Thu, 10 Mar 2005 20:00:38 +0100 Received: from mteterin.us.murex.com ([172.21.130.86]) by mxmail.murex.com with Microsoft SMTPSVC(6.0.3790.0); Thu, 10 Mar 2005 19:51:09 +0100 From: Mikhail Teterin Organization: Virtual Estates, Inc. To: Brooks Davis Date: Thu, 10 Mar 2005 13:51:14 -0500 User-Agent: KMail/1.7.2 References: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> <200503101253.20876.mi+mx@aldan.algebra.com> <20050310175844.GA697@odin.ac.hmc.edu> In-Reply-To: <20050310175844.GA697@odin.ac.hmc.edu> MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-u" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200503101351.14424.mi+mx@aldan.algebra.com> X-OriginalArrivalTime: 10 Mar 2005 18:51:10.0311 (UTC) FILETIME=[20151770:01C525A2] cc: freebsd-fs@freebsd.org cc: Erez Zadok cc: hackers@freebsd.org Subject: Re: What about inode file system? (Re: the current status of nullfs, unionfs) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 18:51:50 -0000 > On Thu, Mar 10, 2005 at 12:53:20PM -0500, Mikhail Teterin wrote: > > A few years ago, there was a project making a filesystem, where a file's > > name will simply be its inode number. It was intended to save on the > > name-to-inode lookups of a regular filesystem, for applications like > > Squid, which keep file names in some sort of a database already. > > > > Does anyone know, what became of that? To the naive me it seems like this > > can just be a mount option for ufs. Thanks! > > The inode file system was removed to ease UFS2 development. It's in the > Attic under sys/ufs/ifs. If someone recovers it and makes it work on 5.x, I'll make a patch for Squid to take advantage of it. -mi From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:01:30 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9CBE916A4CE; Thu, 10 Mar 2005 19:01:30 +0000 (GMT) Received: from filer.fsl.cs.sunysb.edu (filer.fsl.cs.sunysb.edu [130.245.126.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 052A943D5C; Thu, 10 Mar 2005 19:01:30 +0000 (GMT) (envelope-from ezk@fsl.cs.sunysb.edu) Received: from agora.fsl.cs.sunysb.edu (agora.fsl.cs.sunysb.edu [130.245.126.12])j2AJ1LmX019476; Thu, 10 Mar 2005 14:01:21 -0500 Received: from agora.fsl.cs.sunysb.edu (localhost.localdomain [127.0.0.1]) j2AJ1KwD008867; Thu, 10 Mar 2005 14:01:20 -0500 Received: (from ezk@localhost) by agora.fsl.cs.sunysb.edu (8.12.11/8.12.8/Submit) id j2AJ1Kgw008863; Thu, 10 Mar 2005 14:01:20 -0500 Date: Thu, 10 Mar 2005 14:01:20 -0500 Message-Id: <200503101901.j2AJ1Kgw008863@agora.fsl.cs.sunysb.edu> From: Erez Zadok To: Jeremie Le Hen In-reply-to: Your message of "Thu, 10 Mar 2005 12:38:43 +0100." <20050310113843.GJ34822@obiwan.tataz.chchile.org> X-MailKey: Erez_Zadok cc: freebsd-fs@freebsd.org cc: David Schultz cc: hackers@freebsd.org cc: Mikhail Teterin Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:01:30 -0000 In message <20050310113843.GJ34822@obiwan.tataz.chchile.org>, Jeremie Le Hen writes: > A little time ago, phk@ asked for people to submit regression tests for > virtual filesystem like this [1]. AFAIK, nobody submitted even one test > so far. This could be a good starting point to have unionfs work > correctly again. However, I think FreeBSD VFS gurus should first spread > some ideas and clues about tests to do. I guess indeed there are very > tricky ones that most common mortals wouldn't even suspect. I fully agree that a regression suite is needed. Since my group develops a lot of file systems, we have been doing two new things in the past year: 1. We've extracted a subset of the VSX-PCTS posix test suite that just deals with file systems related system calls, and made some changes to it to make it easier to test an arbitrary file system (the package had all sorts of hard-coded assumptions). We've been running it for more than 2 months now and caught dozens of bugs in our file systems, which we're fixing nowadays. Note: in the past, we've used postmark, fsx, bonnie, large compiles, and more as ways of testing file systems' stability; but the posix test suite was able to catch lots of corner cases more directly that none of these other packages could. I fully intend to make this re-packaged VSX-PCTS tool available publicly. And I wholeheartedly recommend it to anyone who develops or maintains file systems. 2. Unionfs has different semantics than regular file systems. As Charles said in his email, unionfs *seems* easy conceptually (we thought so too), but the devil is in the details. It's much harder in practice to deal with all of the unusual border cases and semantic ambiguities that unioning introduces. So, we've begun building a unionfs-specific regression test suite, which we continue to enhance and release together with our unionfs sources. Examples of tests we try is mixes of readonly and write branches, forcing conditions that will result in copy-ups and whiteouts, etc. Although our test suite is specific to our linux implementation, conceptually both the bsd and linux unionfs's are the same, and so the test suite we have could be easily adapted to suite freebsd's needs. Anyone can download our unionfs software and the testsuite within from here: http://www.filesystems.org/project-unionfs.html You may consider it the first ever response to phk's request. :-) Cheers, Erez. From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:12:31 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A901316A4CE for ; Thu, 10 Mar 2005 19:12:31 +0000 (GMT) Received: from deliver.smtp.vlink.ru (alias.rigel.internal.vlink.ru [217.23.88.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id C04A043D54 for ; Thu, 10 Mar 2005 19:12:30 +0000 (GMT) (envelope-from dsh@vlink.ru) Received: from smtp.smtp.vlink.ru (clamav.smtp.vlink.ru [192.168.4.1]) by deliver.smtp.vlink.ru (Postfix) with ESMTP id 7A73B456E1; Thu, 10 Mar 2005 22:12:29 +0300 (MSK) Received: from neva.vlink.ru (neva.vlink.ru [217.107.252.29]) by smtp.smtp.vlink.ru (Postfix) with ESMTP id 4E85E4530E; Thu, 10 Mar 2005 22:12:29 +0300 (MSK) Received: from neva.vlink.ru (localhost [127.0.0.1]) by neva.vlink.ru (8.13.3/8.13.3) with ESMTP id j2AJCTot014130; Thu, 10 Mar 2005 22:12:29 +0300 (MSK) (envelope-from dsh@vlink.ru) Received: (from dsh@localhost) by neva.vlink.ru (8.13.3/8.13.3/Submit) id j2AJCS6l014127; Thu, 10 Mar 2005 22:12:28 +0300 (MSK) (envelope-from dsh@vlink.ru) X-Comment-To: Andy Hilker To: Andy Hilker References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> <20050310160852.GB1718@mail.crypta.net> From: Denis Shaposhnikov Date: Thu, 10 Mar 2005 22:12:28 +0300 In-Reply-To: <20050310160852.GB1718@mail.crypta.net> (Andy Hilker's message of "Thu, 10 Mar 2005 17:08:53 +0100") Message-ID: <87sm33z55v.fsf@neva.vlink.ru> User-Agent: Gnus/5.1006 (Gnus v5.10.6) XEmacs/21.4 (Jumbo Shrimp, berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Scanned: ClamAV using ClamSMTP cc: freebsd-fs@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:12:31 -0000 >>>>> "Andy" == Andy Hilker writes: >> nullfs is absolutely useless for jail's because TOO slow. Andy> What do you mean exactly, how do you benchmark this? Just ran build of databases/mysql41-server in a jail with nullfs mounted /bin /sbin /lib etc over r/w nfs mounted sandbox. -- DSS5-RIPE DSS-RIPN 2:550/5068@fidonet 2:550/5069@fidonet mailto:dsh@vlink.ru http://neva.vlink.ru/~dsh/ From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:17:19 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 90B0B16A4CE; Thu, 10 Mar 2005 19:17:19 +0000 (GMT) Received: from critter.freebsd.dk (f170.freebsd.dk [212.242.86.170]) by mx1.FreeBSD.org (Postfix) with ESMTP id 76E3F43D67; Thu, 10 Mar 2005 19:17:18 +0000 (GMT) (envelope-from phk@critter.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.13.1/8.13.1) with ESMTP id j2AJH0mv003969; Thu, 10 Mar 2005 20:17:01 +0100 (CET) (envelope-from phk@critter.freebsd.dk) To: Erez Zadok From: "Poul-Henning Kamp" In-Reply-To: Your message of "Thu, 10 Mar 2005 14:01:20 EST." <200503101901.j2AJ1Kgw008863@agora.fsl.cs.sunysb.edu> Date: Thu, 10 Mar 2005 20:17:00 +0100 Message-ID: <3968.1110482220@critter.freebsd.dk> Sender: phk@critter.freebsd.dk cc: freebsd-fs@freebsd.org cc: David Schultz cc: hackers@freebsd.org cc: Jeremie Le Hen cc: Mikhail Teterin Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:17:19 -0000 In message <200503101901.j2AJ1Kgw008863@agora.fsl.cs.sunysb.edu>, Erez Zadok wr ites: > Anyone can download our unionfs software and the testsuite within from > here: > > http://www.filesystems.org/project-unionfs.html > > You may consider it the first ever response to phk's request. :-) yeeeeEEEEEHAAAAA!!!!! Thankyouthankyouthankyou! -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:17:59 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: by hub.freebsd.org (Postfix, from userid 758) id 5DAF716A4CF; Thu, 10 Mar 2005 19:17:59 +0000 (GMT) Date: Thu, 10 Mar 2005 19:17:59 +0000 From: Kris Kennaway To: Denis Shaposhnikov Message-ID: <20050310191759.GI34206@hub.freebsd.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> <20050310160852.GB1718@mail.crypta.net> <87sm33z55v.fsf@neva.vlink.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87sm33z55v.fsf@neva.vlink.ru> User-Agent: Mutt/1.4.2.1i cc: freebsd-fs@freebsd.org cc: Andy Hilker Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:17:59 -0000 On Thu, Mar 10, 2005 at 10:12:28PM +0300, Denis Shaposhnikov wrote: > >>>>> "Andy" == Andy Hilker writes: > > >> nullfs is absolutely useless for jail's because TOO slow. > > Andy> What do you mean exactly, how do you benchmark this? > > Just ran build of databases/mysql41-server in a jail with nullfs > mounted /bin /sbin /lib etc over r/w nfs mounted sandbox. And compared it to what? What was your NFS setup? What measurements did you obtain? Kris From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:20:16 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4220616A4CE; Thu, 10 Mar 2005 19:20:16 +0000 (GMT) Received: from mail.vicor-nb.com (bigwoop.vicor-nb.com [208.206.78.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 093EA43D2F; Thu, 10 Mar 2005 19:20:16 +0000 (GMT) (envelope-from julian@elischer.org) Received: from [208.206.78.97] (julian.vicor-nb.com [208.206.78.97]) by mail.vicor-nb.com (Postfix) with ESMTP id AFF007A425; Thu, 10 Mar 2005 11:20:15 -0800 (PST) Message-ID: <42309DEF.2030609@elischer.org> Date: Thu, 10 Mar 2005 11:20:15 -0800 From: Julian Elischer User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050218 X-Accept-Language: en, hu MIME-Version: 1.0 To: Brooks Davis References: <200503100128.j2A1SP4h014420@agora.fsl.cs.sunysb.edu> <200503101253.20876.mi+mx@aldan.algebra.com> <20050310175844.GA697@odin.ac.hmc.edu> In-Reply-To: <20050310175844.GA697@odin.ac.hmc.edu> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-fs@freebsd.org cc: Mikhail Teterin cc: Erez Zadok cc: hackers@freebsd.org Subject: Re: What about inode file system? (Re: the current status ofnullfs, unionfs) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:20:16 -0000 Brooks Davis wrote: >On Thu, Mar 10, 2005 at 12:53:20PM -0500, Mikhail Teterin wrote: > > >>A few years ago, there was a project making a filesystem, where a file's name >>will simply be its inode number. It was intended to save on the name-to-inode >>lookups of a regular filesystem, for applications like Squid, which keep file >>names in some sort of a database already. >> >>Does anyone know, what became of that? To the naive me it seems like this can >>just be a mount option for ufs. Thanks! >> >> > >The inode file system was removed to ease UFS2 development. It's in the >Attic under sys/ufs/ifs. > > When it was removed it was t said that it would be easier to reimplement it again after the filesystem stuff quietenned down.. No-one has done htat, bu tit would progably be feasible to get ti foing again soon, or at least after jeff's next changes go in,.. >-- Brooks > > > From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 19:30:14 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0AEB516A4CE; Thu, 10 Mar 2005 19:30:14 +0000 (GMT) Received: from deliver.smtp.vlink.ru (alias.rigel.internal.vlink.ru [217.23.88.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8EAEF43D39; Thu, 10 Mar 2005 19:30:13 +0000 (GMT) (envelope-from dsh@vlink.ru) Received: from smtp.smtp.vlink.ru (clamav.smtp.vlink.ru [192.168.4.1]) by deliver.smtp.vlink.ru (Postfix) with ESMTP id 3602645443; Thu, 10 Mar 2005 22:30:12 +0300 (MSK) Received: from neva.vlink.ru (neva.vlink.ru [217.107.252.29]) by smtp.smtp.vlink.ru (Postfix) with ESMTP id 0994545425; Thu, 10 Mar 2005 22:30:12 +0300 (MSK) Received: from neva.vlink.ru (localhost [127.0.0.1]) by neva.vlink.ru (8.13.3/8.13.3) with ESMTP id j2AJUBPw014305; Thu, 10 Mar 2005 22:30:11 +0300 (MSK) (envelope-from dsh@vlink.ru) Received: (from dsh@localhost) by neva.vlink.ru (8.13.3/8.13.3/Submit) id j2AJUBpU014302; Thu, 10 Mar 2005 22:30:11 +0300 (MSK) (envelope-from dsh@vlink.ru) X-Comment-To: Kris Kennaway To: Kris Kennaway References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310004919.GA34206@hub.freebsd.org> <87ll8vn32j.fsf@neva.vlink.ru> <20050310160852.GB1718@mail.crypta.net> <87sm33z55v.fsf@neva.vlink.ru> <20050310191759.GI34206@hub.freebsd.org> From: Denis Shaposhnikov Date: Thu, 10 Mar 2005 22:30:11 +0300 In-Reply-To: <20050310191759.GI34206@hub.freebsd.org> (Kris Kennaway's message of "Thu, 10 Mar 2005 19:17:59 +0000") Message-ID: <878y4vxprw.fsf@neva.vlink.ru> User-Agent: Gnus/5.1006 (Gnus v5.10.6) XEmacs/21.4 (Jumbo Shrimp, berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Virus-Scanned: ClamAV using ClamSMTP cc: freebsd-fs@FreeBSD.ORG cc: Andy Hilker Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 19:30:14 -0000 >>>>> "Kris" == Kris Kennaway writes: >> >> nullfs is absolutely useless for jail's because TOO slow. >> Andy> What do you mean exactly, how do you benchmark this? >> >> Just ran build of databases/mysql41-server in a jail with nullfs >> mounted /bin /sbin /lib etc over r/w nfs mounted sandbox. Kris> And compared it to what? What was your NFS setup? What Kris> measurements did you obtain? Oops, sorry. Compared to the same configuration but unionfs -r -o ro instead of nullfs. Measurements are simple: for nullfs building is s...t...r...i...n...g by string (i mean a big pause between every compiled file). And for unionfs are stringbystringbystring :) as for just ufs mounted fs's. -- DSS5-RIPE DSS-RIPN 2:550/5068@fidonet 2:550/5069@fidonet mailto:dsh@vlink.ru http://neva.vlink.ru/~dsh/ From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 20:15:46 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9F8B216A4CE; Thu, 10 Mar 2005 20:15:46 +0000 (GMT) Received: from hub.org (hub.org [200.46.204.220]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4CE3843D3F; Thu, 10 Mar 2005 20:15:46 +0000 (GMT) (envelope-from scrappy@hub.org) Received: from localhost (unknown [200.46.204.144]) by hub.org (Postfix) with ESMTP id 601DF1299F6; Thu, 10 Mar 2005 16:15:43 -0400 (AST) Received: from hub.org ([200.46.204.220]) by localhost (av.hub.org [200.46.204.144]) (amavisd-new, port 10024) with ESMTP id 47284-01; Thu, 10 Mar 2005 20:15:43 +0000 (GMT) Received: from ganymede.hub.org (blk-222-46-186.eastlink.ca [24.222.46.186]) by hub.org (Postfix) with ESMTP id 6BF121299F2; Thu, 10 Mar 2005 16:15:42 -0400 (AST) Received: by ganymede.hub.org (Postfix, from userid 1000) id B0F5C5FC39; Thu, 10 Mar 2005 16:15:43 -0400 (AST) Received: from localhost (localhost [127.0.0.1]) by ganymede.hub.org (Postfix) with ESMTP id AD0415FBB9; Thu, 10 Mar 2005 16:15:43 -0400 (AST) Date: Thu, 10 Mar 2005 16:15:43 -0400 (AST) From: "Marc G. Fournier" To: Kris Kennaway In-Reply-To: <20050310170715.GD34206@hub.freebsd.org> Message-ID: <20050310161506.Y92893@ganymede.hub.org> References: <200503091838.06322.mi+mx@aldan.algebra.com> <87ll8vn32j.fsf@neva.vlink.ru> <20050310123852.F92893@ganymede.hub.org> <20050310170715.GD34206@hub.freebsd.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Virus-Scanned: by amavisd-new at hub.org cc: freebsd-fs@freebsd.org cc: Denis Shaposhnikov cc: Andy Hilker Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 20:15:46 -0000 On Thu, 10 Mar 2005, Kris Kennaway wrote: > On Thu, Mar 10, 2005 at 12:45:04PM -0400, Marc G. Fournier wrote: >> On Thu, 10 Mar 2005, Andy Hilker wrote: >> >>> Hi, >>> >>> You (Denis Shaposhnikov) wrote: >>>>>>>>> "Kris" == Kris Kennaway writes: >>>> >>>> Kris> nullfs seems to work fine, unionfs is very fragile and easily >>>> Kris> exploded. >>>> >>>> nullfs is absolutely useless for jail's because TOO slow. >>> >>> >>> What do you mean exactly, how do you benchmark this? >> >> That's okay, my experiences are that nullfs is too fragile and easily >> exploded ... > > I was referring to 5.x and above. Sorry, jump'd into the thread late, and ended up getting caught up in the archives *after* sending ... I haven't risked 5.x for production servers yet because of its issues :( ---- Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: scrappy@hub.org Yahoo!: yscrappy ICQ: 7615664 From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 20:35:00 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1F51A16A4CE; Thu, 10 Mar 2005 20:35:00 +0000 (GMT) Received: from mail.eecs.harvard.edu (bowser.eecs.harvard.edu [140.247.60.24]) by mx1.FreeBSD.org (Postfix) with ESMTP id AF51943D4C; Thu, 10 Mar 2005 20:34:59 +0000 (GMT) (envelope-from ellard@eecs.harvard.edu) Received: from localhost (localhost.eecs.harvard.edu [127.0.0.1]) by mail.eecs.harvard.edu (Postfix) with ESMTP id 94E5B54C791; Thu, 10 Mar 2005 15:34:58 -0500 (EST) Received: from mail.eecs.harvard.edu ([127.0.0.1]) by localhost (bowser.eecs.harvard.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 81391-03; Thu, 10 Mar 2005 15:34:58 -0500 (EST) Received: by mail.eecs.harvard.edu (Postfix, from userid 465) id 5D65054C7FD; Thu, 10 Mar 2005 15:34:58 -0500 (EST) Received: from localhost (localhost [127.0.0.1]) by mail.eecs.harvard.edu (Postfix) with ESMTP id 58EE354C7FC; Thu, 10 Mar 2005 15:34:58 -0500 (EST) Date: Thu, 10 Mar 2005 15:34:58 -0500 (EST) From: Daniel Ellard To: Jeremie Le Hen In-Reply-To: <20050310113843.GJ34822@obiwan.tataz.chchile.org> Message-ID: <20050310153251.J73108@bowser.eecs.harvard.edu> References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310113843.GJ34822@obiwan.tataz.chchile.org> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: by amavisd-new at eecs.harvard.edu cc: freebsd-fs@FreeBSD.ORG cc: David Schultz cc: hackers@FreeBSD.ORG cc: Mikhail Teterin Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 20:35:00 -0000 On Thu, 10 Mar 2005, Jeremie Le Hen wrote: > A little time ago, phk@ asked for people to submit regression tests for > virtual filesystem like this [1]. AFAIK, nobody submitted even one test > so far. This could be a good starting point to have unionfs work > correctly again. However, I think FreeBSD VFS gurus should first spread > some ideas and clues about tests to do. I guess indeed there are very > tricky ones that most common mortals wouldn't even suspect. I know that Kirk McKusick has a stress test he uses for his own stuff (in case you don't already know about it). -Dan From owner-freebsd-fs@FreeBSD.ORG Thu Mar 10 23:31:13 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0051C16A4CE; Thu, 10 Mar 2005 23:31:13 +0000 (GMT) Received: from harik.murex.com (mail.murex.com [194.98.239.11]) by mx1.FreeBSD.org (Postfix) with ESMTP id 697BD43D1F; Thu, 10 Mar 2005 23:31:12 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: from interscan.fr.murex.com (iscan.murex.fr [172.21.17.207] (may be forged)) by harik.murex.com with ESMTP id j2ANKTbW018025; Fri, 11 Mar 2005 00:20:29 +0100 (CET) Received: from mxmail.murex.com (interscan.murex.fr [127.0.0.1]) by interscan.fr.murex.com (8.11.6/8.11.6) with ESMTP id j2ANeD518554; Fri, 11 Mar 2005 00:40:13 +0100 Received: from mteterin.us.murex.com ([172.21.130.86]) by mxmail.murex.com with Microsoft SMTPSVC(6.0.3790.0); Fri, 11 Mar 2005 00:30:45 +0100 From: Mikhail Teterin Organization: Virtual Estates, Inc. To: David Schultz Date: Thu, 10 Mar 2005 18:30:48 -0500 User-Agent: KMail/1.7.2 References: <200503091838.06322.mi+mx@aldan.algebra.com> <20050310023518.GA11712@VARK.MIT.EDU> In-Reply-To: <20050310023518.GA11712@VARK.MIT.EDU> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200503101830.49047.mi+mx@aldan.algebra.com> X-OriginalArrivalTime: 10 Mar 2005 23:30:45.0429 (UTC) FILETIME=[2ED4F650:01C525C9] cc: freebsd-fs@freebsd.org cc: hackers@freebsd.org Subject: Re: the current status of nullfs, unionfs X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Mar 2005 23:31:13 -0000 > Nullfs works better than unionfs. Unionfs worked well in 4.X. > > What about the `union' option to regular mounts? Is that safe to use? [...] > Last I checked, it [mount -ounion -mi] was very broken, but I'm not sure. BTW, how is unionfs different from nullfs with the union option? mount -t nullfs -ounion /a /b vs. mount -t unionfs /a /b ? Thanks! -mi From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 14:56:35 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 95D3716A4CE; Fri, 11 Mar 2005 14:56:35 +0000 (GMT) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id A4FDE43D5F; Fri, 11 Mar 2005 14:56:34 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j2BEuXg6052135; Fri, 11 Mar 2005 08:56:33 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4231B19D.8060406@centtech.com> Date: Fri, 11 Mar 2005 08:56:29 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050210 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/761/Thu Mar 10 15:01:48 2005 on mh1.centtech.com X-Virus-Status: Clean Subject: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 14:56:35 -0000 Speaking of filesytems :), I have a real need for a global filesystem (or shared fs, or clustered fs, or whatever), and my favorite OS doesn't have one (that I know of!). I saw that a few years back a few people were working on getting GFS working on FreeBSD, but there's no recent mention of that. Is anyone working on this, or would someone like to work on it? I am not much of a code guru, but I have the resources to test this technology under all types of loads, and we are currently using a commercial software to handle my needs (polyserve - which they have flat out told me 'no' for FreeBSD support), but I would much prefer to be on FreeBSD. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology I have seen the future and it is just like the present, only longer. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:15:43 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8945916A4CE; Fri, 11 Mar 2005 15:15:43 +0000 (GMT) Received: from titan.whee.org (titan.whee.org [207.195.206.249]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1635A43D2D; Fri, 11 Mar 2005 15:15:43 +0000 (GMT) (envelope-from adam@whee.org) Received: from titan.whee.org (localhost [127.0.0.1]) by titan.whee.org (8.12.9/8.12.9) with ESMTP id j2BF27qb018604; Fri, 11 Mar 2005 09:02:07 -0600 (CST) Received: from localhost (adam@localhost) by titan.whee.org (8.12.9/8.12.9/Submit) with ESMTP id j2BF2696018601; Fri, 11 Mar 2005 09:02:06 -0600 (CST) X-Authentication-Warning: titan.whee.org: adam owned process doing -bs Date: Fri, 11 Mar 2005 09:02:06 -0600 (CST) From: Adam Maloney X-X-Sender: adam@titan To: Eric Anderson In-Reply-To: <4231B19D.8060406@centtech.com> Message-ID: References: <4231B19D.8060406@centtech.com> X-GPG-FINGERPRINT: E39B 8D34 5F0A EA2E 4CCA 5B1D 8D55 7C25 0061 10AF X-GPG-PUBLIC_KEY: http://www.whee.org/~adam/adam-whee-org-pubkey.asc MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed cc: freebsd-fs@freebsd.org cc: freebsd-hackers@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:15:43 -0000 On Fri, 11 Mar 2005, Eric Anderson wrote: > Speaking of filesytems :), I have a real need for a global filesystem (or "me too" I played with CODA a few months ago but it didn't seem to be solid, and didn't fit my needs. Everything else I've looked at is Linux-only. Please follow-up to the list, I'd be very interested in seeing what other projects are available. From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:23:19 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5342416A4CE; Fri, 11 Mar 2005 15:23:19 +0000 (GMT) Received: from smtp.xbsd.org (xbsd.org [82.233.2.192]) by mx1.FreeBSD.org (Postfix) with ESMTP id ED8D343D46; Fri, 11 Mar 2005 15:23:18 +0000 (GMT) (envelope-from flz@xbsd.org) Received: from localhost (localhost.xbsd.org [127.0.0.1]) by smtp.xbsd.org (Postfix) with ESMTP id 5C124118CC; Fri, 11 Mar 2005 16:27:50 +0100 (CET) Received: from smtp.xbsd.org ([127.0.0.1]) by localhost (srv1.xbsd.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 52734-07; Fri, 11 Mar 2005 16:27:41 +0100 (CET) Received: from [192.168.20.107] (ALagny-109-1-7-69.w81-50.abo.wanadoo.fr [81.50.48.69]) by smtp.xbsd.org (Postfix) with ESMTP id 8C81C118B8; Fri, 11 Mar 2005 16:27:40 +0100 (CET) Message-ID: <4231B7D5.3070306@xbsd.org> Date: Fri, 11 Mar 2005 16:23:01 +0100 From: Florent Thoumie User-Agent: Mozilla Thunderbird 1.0 (X11/20050107) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Adam Maloney References: <4231B19D.8060406@centtech.com> In-Reply-To: X-Enigmail-Version: 0.89.6.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig0EF28DF9D4686C8E7272200C" X-Virus-Scanned: amavisd-new at xbsd.org cc: freebsd-fs@freebsd.org cc: freebsd-hackers@freebsd.org cc: Eric Anderson Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:23:19 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig0EF28DF9D4686C8E7272200C Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Adam Maloney wrote: > On Fri, 11 Mar 2005, Eric Anderson wrote: > >> Speaking of filesytems :), I have a real need for a global filesystem >> (or > > > "me too" > > I played with CODA a few months ago but it didn't seem to be solid, and > didn't fit my needs. Everything else I've looked at is Linux-only. > Please follow-up to the list, I'd be very interested in seeing what > other projects are available. > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" I don't know if DRBD [1] is a good implementation (Linux only), but it works flawlessly, replication is fast (i got ~35MB/s) and it's quite simple to get it working. ENBD [2] isn't based on the same concept, it "exports" block devices through network via userland application, though it needs a kernel module for client side. I'd like something like DRBD exists for FreeBSD but I'm not aware of such an implementation. [1] http://www.drbd.org/ [2] http://www.it.uc3m.es/~ptb/nbd/ -- flz --------------enig0EF28DF9D4686C8E7272200C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCMbfZMxEkbVFH3PQRAgy4AJ92kdkJSTVpxMkajNLZq2sDUXqKjACfdOAJ e8MsjidFFmILVDsLOjWRZD8= =qesT -----END PGP SIGNATURE----- --------------enig0EF28DF9D4686C8E7272200C-- From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:27:36 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C6DE716A4CE; Fri, 11 Mar 2005 15:27:36 +0000 (GMT) Received: from citi.umich.edu (citi.umich.edu [141.211.133.111]) by mx1.FreeBSD.org (Postfix) with ESMTP id A625243D39; Fri, 11 Mar 2005 15:27:36 +0000 (GMT) (envelope-from rees@citi.umich.edu) Received: from citi.umich.edu (dumaguete.citi.umich.edu [141.211.133.51]) by citi.umich.edu (Postfix) with ESMTP id 63E7E1BB8B; Fri, 11 Mar 2005 10:27:36 -0500 (EST) To: freebsd-fs@freebsd.org, freebsd-hackers@freebsd.org From: Jim Rees In-Reply-To: Adam Maloney, Fri, 11 Mar 2005 09:02:06 CST Date: Fri, 11 Mar 2005 10:27:36 -0500 Sender: rees@citi.umich.edu Message-Id: <20050311152736.63E7E1BB8B@citi.umich.edu> Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:27:36 -0000 There are OpenAFS and NFSv4 clients for FreeBSD, but unfortunately neither is really production quality. It wouldn't take much to make at least the OpenAFS client usable but no one seems to be working on it now. From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:40:13 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AA37416A4CE; Fri, 11 Mar 2005 15:40:13 +0000 (GMT) Received: from dan.emsphone.com (dan.emsphone.com [199.67.51.101]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4ACC743D58; Fri, 11 Mar 2005 15:40:13 +0000 (GMT) (envelope-from dan@dan.emsphone.com) Received: (from dan@localhost) by dan.emsphone.com (8.13.1/8.13.1) id j2BFdse9025970; Fri, 11 Mar 2005 09:39:54 -0600 (CST) (envelope-from dan) Date: Fri, 11 Mar 2005 09:39:54 -0600 From: Dan Nelson To: Florent Thoumie Message-ID: <20050311153954.GC92140@dan.emsphone.com> References: <4231B19D.8060406@centtech.com> <4231B7D5.3070306@xbsd.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4231B7D5.3070306@xbsd.org> X-OS: FreeBSD 5.4-PRERELEASE X-message-flag: Outlook Error User-Agent: Mutt/1.5.8i cc: freebsd-fs@freebsd.org cc: Adam Maloney cc: Eric Anderson cc: freebsd-hackers@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:40:13 -0000 In the last episode (Mar 11), Florent Thoumie said: > Adam Maloney wrote: > >On Fri, 11 Mar 2005, Eric Anderson wrote: > >>Speaking of filesytems :), I have a real need for a global filesystem > >>(or > > > >"me too" > > I don't know if DRBD [1] is a good implementation (Linux only), > but it works flawlessly, replication is fast (i got ~35MB/s) > and it's quite simple to get it working. > > ENBD [2] isn't based on the same concept, it "exports" block > devices through network via userland application, though it > needs a kernel module for client side. > > I'd like something like DRBD exists for FreeBSD but I'm not aware of > such an implementation. You want geom_gate. See the ggatec, ggated, and ggatel manpages. Note that none of the packages mentioned so far will give you a cluster filesystem; they are just a cheaper way of sharing block devices than a Fibre Channel SAN. -- Dan Nelson dnelson@allantgroup.com From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:41:10 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8D51916A4CE; Fri, 11 Mar 2005 15:41:10 +0000 (GMT) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id EEC1F43D1D; Fri, 11 Mar 2005 15:41:09 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j2BFf93h052589; Fri, 11 Mar 2005 09:41:09 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4231BC11.7030604@centtech.com> Date: Fri, 11 Mar 2005 09:41:05 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050210 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Florent Thoumie References: <4231B19D.8060406@centtech.com> <4231B7D5.3070306@xbsd.org> In-Reply-To: <4231B7D5.3070306@xbsd.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/761/Thu Mar 10 15:01:48 2005 on mh1.centtech.com X-Virus-Status: Clean cc: freebsd-fs@freebsd.org cc: Adam Maloney cc: freebsd-hackers@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:41:10 -0000 Florent Thoumie wrote: > Adam Maloney wrote: > >> On Fri, 11 Mar 2005, Eric Anderson wrote: >> >>> Speaking of filesytems :), I have a real need for a global filesystem >>> (or >> >> >> >> "me too" >> >> I played with CODA a few months ago but it didn't seem to be solid, and >> didn't fit my needs. Everything else I've looked at is Linux-only. >> Please follow-up to the list, I'd be very interested in seeing what >> other projects are available. >> _______________________________________________ >> freebsd-hackers@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-hackers >> To unsubscribe, send any mail to >> "freebsd-hackers-unsubscribe@freebsd.org" > > > I don't know if DRBD [1] is a good implementation (Linux only), but it > works flawlessly, replication is fast (i got ~35MB/s) and it's quite > simple to get it working. > > ENBD [2] isn't based on the same concept, it "exports" block devices > through network via userland application, though it needs a kernel > module for client side. > > I'd like something like DRBD exists for FreeBSD but I'm not aware of > such an implementation. > > [1] http://www.drbd.org/ > [2] http://www.it.uc3m.es/~ptb/nbd/ GEOM Gate does a part of this. I thing using vinum+geom gate you could get a similar setup. However, this isn't exactly what I want - I don't need a 'mirror', I need a cluster of active machines serving the same disk data. For what it's worth, there is an nbd port: net/nbd-server Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology I have seen the future and it is just like the present, only longer. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 15:45:42 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1E13F16A4CE; Fri, 11 Mar 2005 15:45:42 +0000 (GMT) Received: from smtp.xbsd.org (xbsd.org [82.233.2.192]) by mx1.FreeBSD.org (Postfix) with ESMTP id 924F643D39; Fri, 11 Mar 2005 15:45:41 +0000 (GMT) (envelope-from flz@xbsd.org) Received: from localhost (localhost.xbsd.org [127.0.0.1]) by smtp.xbsd.org (Postfix) with ESMTP id EBFFB118C9; Fri, 11 Mar 2005 16:50:12 +0100 (CET) Received: from smtp.xbsd.org ([127.0.0.1]) by localhost (srv1.xbsd.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 53038-04; Fri, 11 Mar 2005 16:50:04 +0100 (CET) Received: from [192.168.20.107] (ALagny-109-1-7-69.w81-50.abo.wanadoo.fr [81.50.48.69]) by smtp.xbsd.org (Postfix) with ESMTP id 2D71211701; Fri, 11 Mar 2005 16:50:02 +0100 (CET) Message-ID: <4231BD14.3080506@xbsd.org> Date: Fri, 11 Mar 2005 16:45:24 +0100 From: Florent Thoumie User-Agent: Mozilla Thunderbird 1.0 (X11/20050107) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Eric Anderson References: <4231B19D.8060406@centtech.com> <4231B7D5.3070306@xbsd.org> <4231BC11.7030604@centtech.com> In-Reply-To: <4231BC11.7030604@centtech.com> X-Enigmail-Version: 0.89.6.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigB0C0EF517BD0A6FC0EC57F41" X-Virus-Scanned: amavisd-new at xbsd.org cc: freebsd-fs@freebsd.org cc: freebsd-hackers@freebsd.org cc: Dan Nelson Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 15:45:42 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigB0C0EF517BD0A6FC0EC57F41 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Eric Anderson wrote: > Florent Thoumie wrote: >> I don't know if DRBD [1] is a good implementation (Linux only), >> but it >> works flawlessly, replication is fast (i got ~35MB/s) and it's quite >> simple to get it working. >> >> ENBD [2] isn't based on the same concept, it "exports" block devices >> through network via userland application, though it needs a kernel >> module for client side. >> >> I'd like something like DRBD exists for FreeBSD but I'm not aware of >> such an implementation. >> >> [1] http://www.drbd.org/ >> [2] http://www.it.uc3m.es/~ptb/nbd/ > > > GEOM Gate does a part of this. I thing using vinum+geom gate you could > get a similar setup. > However, this isn't exactly what I want - I don't need a 'mirror', I > need a cluster of active machines serving the same disk data. Ok, good to know, thanks for pointing this. > For what it's worth, there is an nbd port: > net/nbd-server I think that's not really the good thing to do, and FreeBSD doesn't have support for nbd-client, so I may just forget it :) -- flz --------------enigB0C0EF517BD0A6FC0EC57F41 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.0 (FreeBSD) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCMb0YMxEkbVFH3PQRAoczAJ9S95VTX3riUxcad+5317RBHZYGTQCfT4E5 /Zcsxt085QphQgy1JpPPw94= =wYRE -----END PGP SIGNATURE----- --------------enigB0C0EF517BD0A6FC0EC57F41-- From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 17:11:37 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EE83316A4CE for ; Fri, 11 Mar 2005 17:11:37 +0000 (GMT) Received: from smtp.263.net (smtp.263.net [211.150.96.25]) by mx1.FreeBSD.org (Postfix) with ESMTP id 940E543D41 for ; Fri, 11 Mar 2005 17:11:27 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (mta5 [127.0.0.1]) by smtp.263.net (Postfix) with ESMTP id C6CE42FC93; Sat, 12 Mar 2005 01:11:19 +0800 (CST) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (unknown [61.48.130.243]) iWHcACjRMUKFGILz.1 for ; Sat, 12 Mar 2005 01:11:19 +0800 (CST) X-TEBIE-Originating-IP: [61.48.130.243] From: yf-263 To: Eric Anderson In-Reply-To: <4231B19D.8060406@centtech.com> References: <4231B19D.8060406@centtech.com> Content-Type: text/plain; charset=UTF-8 Organization: Unix-driver.org Date: Sat, 12 Mar 2005 01:10:41 +0800 Message-Id: <1110561042.5048.11.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 8bit cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: yfyoufeng@263.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 17:11:38 -0000 Hi, Eric, How about the MogileFS (http://www.danga.com/mogilefs/), which served a pictures web service at about twenty millions. And all in user level. It is also share some same ideas as GoogleFS (http://unix- driver.org/books/linux/filesystem/googlefs/p125-ghemawat.pdf). And for Sistina's GFS (which sold to Redhat now), its 2.0 version has an un-finished FreeBSD porting, which can be downloaded from its ftp server (the address is not on my hand now, and I can tell you if you really want it). Last year I have worked on porting that GFS to Darwin (since it use FreeBSD fs codebase), so I'll glad to talk to you about it ;) Sorry for confusing ! The mail is wrote very late here. Wish you a nice day ! 在 2005-03-11五的 08:56 -0600,Eric Anderson写é“: > Speaking of filesytems :), I have a real need for a global filesystem (or shared fs, or clustered fs, or whatever), and my favorite OS doesn't have one (that I know of!). I saw that a few years back a few people were working on getting GFS working on FreeBSD, but there's no recent mention of that. > > Is anyone working on this, or would someone like to work on it? I am not much of a code guru, but I have the resources to test this technology under all types of loads, and we are currently using a commercial software to handle my needs (polyserve - which they have flat out told me 'no' for FreeBSD support), but I would much prefer to be on FreeBSD. > > Eric > > > -- yf-263 Unix-driver.org From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 17:21:56 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 605B516A4CE for ; Fri, 11 Mar 2005 17:21:56 +0000 (GMT) Received: from ebb.errno.com (ebb.errno.com [66.127.85.87]) by mx1.FreeBSD.org (Postfix) with ESMTP id F411343D5C for ; Fri, 11 Mar 2005 17:21:55 +0000 (GMT) (envelope-from sam@errno.com) Received: from [66.127.85.91] (sam@[66.127.85.91]) (authenticated bits=0) by ebb.errno.com (8.12.9/8.12.6) with ESMTP id j2BHLtms072702 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Fri, 11 Mar 2005 09:21:55 -0800 (PST) (envelope-from sam@errno.com) Message-ID: <4231D417.9060705@errno.com> Date: Fri, 11 Mar 2005 09:23:35 -0800 From: Sam Leffler User-Agent: Mozilla Thunderbird 1.0RC1 (X11/20041208) X-Accept-Language: en-us, en MIME-Version: 1.0 To: fs@freebsd.org Content-Type: multipart/mixed; boundary="------------060406040607070405040007" Subject: dirhash potential bug X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 17:21:56 -0000 This is a multi-part message in MIME format. --------------060406040607070405040007 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Coverity's analysis tool claims there might be a null bp dereferenced in ufsdirhash_lookup. Attached is a patch to add a KASSERT but it'd be good for someone more familiar with the code to check if a change is required. Sam --------------060406040607070405040007 Content-Type: text/plain; name="dirhash.patch" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="dirhash.patch" ==== //depot/projects/wifi/sys/ufs/ufs/ufs_dirhash.c#3 - /usr/sam/wifi/sys/ufs/ufs/ufs_dirhash.c ==== @@ -420,6 +420,7 @@ if (UFS_BLKATOFF(vp, (off_t)blkoff, NULL, &bp) != 0) return (EJUSTRETURN); } + KASSERT(bp != NULL, ("no buf?")); dp = (struct direct *)(bp->b_data + (offset & bmask)); if (dp->d_reclen == 0 || dp->d_reclen > DIRBLKSIZ - (offset & (DIRBLKSIZ - 1))) { --------------060406040607070405040007-- From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 18:39:36 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id ECA0216A4CE for ; Fri, 11 Mar 2005 18:39:36 +0000 (GMT) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id BB97243D1F for ; Fri, 11 Mar 2005 18:39:36 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id j2BIdYs6010107; Fri, 11 Mar 2005 10:39:34 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id j2BIdYj7010106; Fri, 11 Mar 2005 10:39:34 -0800 Date: Fri, 11 Mar 2005 10:39:34 -0800 From: Brooks Davis To: Eric Anderson Message-ID: <20050311183934.GB29287@odin.ac.hmc.edu> References: <4231B19D.8060406@centtech.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FkmkrVfFsRoUs1wW" Content-Disposition: inline In-Reply-To: <4231B19D.8060406@centtech.com> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 18:39:37 -0000 --FkmkrVfFsRoUs1wW Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Mar 11, 2005 at 08:56:29AM -0600, Eric Anderson wrote: > Speaking of filesytems :), I have a real need for a global filesystem (o= r=20 > shared fs, or clustered fs, or whatever), and my favorite OS doesn't have= =20 > one (that I know of!). I saw that a few years back a few people were=20 > working on getting GFS working on FreeBSD, but there's no recent mention = of=20 > that. =20 > Is anyone working on this, or would someone like to work on it? I am not= =20 > much of a code guru, but I have the resources to test this technology und= er=20 > all types of loads, and we are currently using a commercial software to= =20 > handle my needs (polyserve - which they have flat out told me 'no' for=20 > FreeBSD support), but I would much prefer to be on FreeBSD. If you've got money to throw at the problem, you might talk to Isilon and Panasas. Both build clustered storge solutions (you buy their hardware) that happen to be based on FreeBSD. They are currently targeting Linux, but it might be fairly easy for them to support FreeBSD given sufficent motivation. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --FkmkrVfFsRoUs1wW Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFCMeXlXY6L6fI4GtQRAkYlAKCfIY79i8kY2lah6sWAKbcHi64YmwCeOAH9 P/oMfXL8gmngOoWFKWAeeqs= =JXWi -----END PGP SIGNATURE----- --FkmkrVfFsRoUs1wW-- From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:10:41 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BCAA216A4CE for ; Fri, 11 Mar 2005 19:10:41 +0000 (GMT) Received: from salmon.maths.tcd.ie (salmon.maths.tcd.ie [134.226.81.11]) by mx1.FreeBSD.org (Postfix) with SMTP id B413743D62 for ; Fri, 11 Mar 2005 19:10:40 +0000 (GMT) (envelope-from iedowse@maths.tcd.ie) Received: from walton.maths.tcd.ie by salmon.maths.tcd.ie with SMTP id ; 11 Mar 2005 19:10:39 +0000 (GMT) To: Sam Leffler In-Reply-To: Your message of "Fri, 11 Mar 2005 09:23:35 PST." <4231D417.9060705@errno.com> Date: Fri, 11 Mar 2005 19:10:38 +0000 From: Ian Dowse Message-ID: <200503111910.aa12186@salmon.maths.tcd.ie> cc: fs@freebsd.org Subject: Re: dirhash potential bug X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:10:42 -0000 In message <4231D417.9060705@errno.com>, Sam Leffler writes: >Coverity's analysis tool claims there might be a null bp dereferenced in >ufsdirhash_lookup. Attached is a patch to add a KASSERT but it'd be >good for someone more familiar with the code to check if a change is >required. Sam, maybe you missed my reply to your original message about this? Here it is again anyway. Ian (Message freebsd-commit:11710) -- using template mhl.format -- Date: Thu, 24 Feb 2005 01:32:24 GMT To: Sam Leffler cc: dwmalone@freebsd.org, iedowse@freebsd.org From: Ian Dowse Subject: Re: dirhash potential bug In message <421D0D59.1090001@errno.com>, Sam Leffler writes: >Coverity's analysis tool claims there might be a null bp dereferenced in >ufsdirhash_lookup. Attached is a patch to add a KASSERT but it'd be >good for someone more familiar with the code to check if a change is >required (the analysis tool can be fooled by indirect logic). > >If you commit a change (even this assert) please make sure you mark the >commit with attribution. If this cannot happen please let me know so I >can mark the analysis db I'm going through. Thanks. Hi Sam, As far as I can tell the code is safe as is. Simplified it looks like this: blkoff = -1; bp = NULL; for (...) { offset = non-negative value; if ((offset & ~bmask) != blkoff) bp = non-NULL; [dereference bp] } So it is guaranteed that `((offset & ~bmask) != blkoff)' will be true the first time around the loop and hence bp will be non-NULL. Does that seem ok? Ian From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:20:25 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 15B4F16A4CF for ; Fri, 11 Mar 2005 19:20:25 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id 945B543D2D for ; Fri, 11 Mar 2005 19:20:24 +0000 (GMT) (envelope-from phreaki@gmail.com) Received: by rproxy.gmail.com with SMTP id g11so1485838rne for ; Fri, 11 Mar 2005 11:20:24 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=Mm/Izobz/V0u3OaE/zY+xJiy03MLQ/UkBSlT3MJ5p8Yp6tDCSXKOoNAuLB+zE2QP3PwWG725btcH64pqE8wIN2G4n+JtzmHim2uQ+Ea7yiKw9xczBWM42SNUjZnaQD3/LENMlJhHxrz7Jbqgd48xKG0Nfcy1s9y7/f+z7ZAFjgM= Received: by 10.11.100.28 with SMTP id x28mr136935cwb; Fri, 11 Mar 2005 11:20:24 -0800 (PST) Received: by 10.11.120.23 with HTTP; Fri, 11 Mar 2005 11:20:24 -0800 (PST) Message-ID: <6fb2b4650503111120760d9335@mail.gmail.com> Date: Fri, 11 Mar 2005 14:20:24 -0500 From: Robert Atkinson To: Florent Thoumie In-Reply-To: <4231B7D5.3070306@xbsd.org> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <4231B19D.8060406@centtech.com> <4231B7D5.3070306@xbsd.org> cc: freebsd-fs@freebsd.org cc: Adam Maloney cc: Eric Anderson cc: freebsd-hackers@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Robert Atkinson List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:20:25 -0000 I'm still lurking and hoping the new GEOM will be used for such a system. On Fri, 11 Mar 2005 16:23:01 +0100, Florent Thoumie wrote: > Adam Maloney wrote: > > On Fri, 11 Mar 2005, Eric Anderson wrote: > > > >> Speaking of filesytems :), I have a real need for a global filesystem > >> (or > > > > > > "me too" > > > > I played with CODA a few months ago but it didn't seem to be solid, and > > didn't fit my needs. Everything else I've looked at is Linux-only. > > Please follow-up to the list, I'd be very interested in seeing what > > other projects are available. > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" > > I don't know if DRBD [1] is a good implementation (Linux only), but it > works flawlessly, replication is fast (i got ~35MB/s) and it's quite > simple to get it working. > > ENBD [2] isn't based on the same concept, it "exports" block devices > through network via userland application, though it needs a kernel > module for client side. > > I'd like something like DRBD exists for FreeBSD but I'm not aware of > such an implementation. > > [1] http://www.drbd.org/ > [2] http://www.it.uc3m.es/~ptb/nbd/ > > -- flz > > > From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:20:44 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F35BC16A4CE for ; Fri, 11 Mar 2005 19:20:43 +0000 (GMT) Received: from smtp3.server.rpi.edu (smtp3.server.rpi.edu [128.113.2.3]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9A95943D48 for ; Fri, 11 Mar 2005 19:20:43 +0000 (GMT) (envelope-from drosih@rpi.edu) Received: from [128.113.24.47] (gilead.netel.rpi.edu [128.113.24.47]) by smtp3.server.rpi.edu (8.13.0/8.13.0) with ESMTP id j2BJKYqI032460; Fri, 11 Mar 2005 14:20:35 -0500 Mime-Version: 1.0 Message-Id: In-Reply-To: <20050311183934.GB29287@odin.ac.hmc.edu> References: <4231B19D.8060406@centtech.com> <20050311183934.GB29287@odin.ac.hmc.edu> Date: Fri, 11 Mar 2005 14:20:32 -0500 To: Brooks Davis , Eric Anderson From: Garance A Drosihn Content-Type: text/plain; charset="us-ascii" ; format="flowed" X-CanItPRO-Stream: default X-RPI-SA-Score: undef - spam-scanning disabled X-Scanned-By: CanIt (www . canit . ca) on 128.113.2.3 cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:20:44 -0000 At 10:39 AM -0800 3/11/05, Brooks Davis wrote: >On Fri, Mar 11, 2005 at 08:56:29AM -0600, Eric Anderson wrote: > > > Is anyone working on this, or would someone like to work on it? > > I am not much of a code guru, but I have the resources to test > > this technology under all types of loads, and we are currently > > using a commercial software to handle my needs (polyserve - which > > they have flat out told me 'no' for FreeBSD support), but I would > > much prefer to be on FreeBSD. > >If you've got money to throw at the problem, you might talk to >Isilon and Panasas. If you've got money to throw at the problem, you could throw it at OpenAFS... :-) http://www.usenix.org/about/openafs/ However, usenix still haven't gotten back to me about whether I could earmark my donations for OpenAFS on *specific* platforms... -- Garance Alistair Drosehn = gad@gilead.netel.rpi.edu Senior Systems Programmer or gad@freebsd.org Rensselaer Polytechnic Institute or drosih@rpi.edu From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:31:18 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 67BD616A4CE for ; Fri, 11 Mar 2005 19:31:18 +0000 (GMT) Received: from duchess.speedfactory.net (duchess.speedfactory.net [66.23.201.84]) by mx1.FreeBSD.org (Postfix) with SMTP id D77ED43D49 for ; Fri, 11 Mar 2005 19:31:17 +0000 (GMT) (envelope-from ups@tree.com) Received: (qmail 32118 invoked by uid 89); 11 Mar 2005 19:31:17 -0000 Received: from duchess.speedfactory.net (66.23.201.84) by duchess.speedfactory.net with SMTP; 11 Mar 2005 19:31:17 -0000 Received: (qmail 32105 invoked by uid 89); 11 Mar 2005 19:31:16 -0000 Received: from unknown (HELO palm.tree.com) (66.23.216.49) by duchess.speedfactory.net with SMTP; 11 Mar 2005 19:31:16 -0000 Received: from [127.0.0.1] (localhost.tree.com [127.0.0.1]) by palm.tree.com (8.12.10/8.12.10) with ESMTP id j2BJVFw6067130; Fri, 11 Mar 2005 14:31:16 -0500 (EST) (envelope-from ups@tree.com) From: Stephan Uphoff To: Sam Leffler In-Reply-To: <4231D417.9060705@errno.com> References: <4231D417.9060705@errno.com> Content-Type: text/plain Message-Id: <1110569475.29804.23911.camel@palm> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.6 Date: Fri, 11 Mar 2005 14:31:15 -0500 Content-Transfer-Encoding: 7bit cc: fs@freebsd.org Subject: Re: dirhash potential bug X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:31:18 -0000 On Fri, 2005-03-11 at 12:23, Sam Leffler wrote: > Coverity's analysis tool claims there might be a null bp dereferenced in > ufsdirhash_lookup. Attached is a patch to add a KASSERT but it'd be > good for someone more familiar with the code to check if a change is > required. > > Sam In my opinion the change is not required. Not knowing how the tool works my guess is that the function pointer um_blkatoff used in UFS_BLKATOFF makes it impossible for the tool to prove that bp will always be non-zero at this point. Can you replace UFS_BLKATOFF(vp, (off_t)blkoff, NULL, &bp) with ffs_blkatoff(vp, (off_t)blkoff, NULL, &bp) and rerun the test? Stephan > > ______________________________________________________________________ > ==== //depot/projects/wifi/sys/ufs/ufs/ufs_dirhash.c#3 - /usr/sam/wifi/sys/ufs/ufs/ufs_dirhash.c ==== > @@ -420,6 +420,7 @@ > if (UFS_BLKATOFF(vp, (off_t)blkoff, NULL, &bp) != 0) > return (EJUSTRETURN); > } > + KASSERT(bp != NULL, ("no buf?")); > dp = (struct direct *)(bp->b_data + (offset & bmask)); > if (dp->d_reclen == 0 || dp->d_reclen > > DIRBLKSIZ - (offset & (DIRBLKSIZ - 1))) { > > > ______________________________________________________________________ > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:31:58 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DDFB416A4CE for ; Fri, 11 Mar 2005 19:31:58 +0000 (GMT) Received: from ebb.errno.com (ebb.errno.com [66.127.85.87]) by mx1.FreeBSD.org (Postfix) with ESMTP id A10ED43D3F for ; Fri, 11 Mar 2005 19:31:58 +0000 (GMT) (envelope-from sam@errno.com) Received: from [66.127.85.91] (sam@[66.127.85.91]) (authenticated bits=0) by ebb.errno.com (8.12.9/8.12.6) with ESMTP id j2BJVums073365 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 11 Mar 2005 11:31:57 -0800 (PST) (envelope-from sam@errno.com) Message-ID: <4231F290.2060308@errno.com> Date: Fri, 11 Mar 2005 11:33:36 -0800 From: Sam Leffler User-Agent: Mozilla Thunderbird 1.0RC1 (X11/20041208) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Ian Dowse References: <200503111910.aa12186@salmon.maths.tcd.ie> In-Reply-To: <200503111910.aa12186@salmon.maths.tcd.ie> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: fs@freebsd.org Subject: Re: dirhash potential bug X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:31:59 -0000 Ian Dowse wrote: > In message <4231D417.9060705@errno.com>, Sam Leffler writes: > >>Coverity's analysis tool claims there might be a null bp dereferenced in >>ufsdirhash_lookup. Attached is a patch to add a KASSERT but it'd be >>good for someone more familiar with the code to check if a change is >>required. > > > Sam, maybe you missed my reply to your original message about this? > Here it is again anyway. Never saw it; thanks for re-sending. Sam From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 19:53:20 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 289B316A4CE for ; Fri, 11 Mar 2005 19:53:20 +0000 (GMT) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id F0BB243D41 for ; Fri, 11 Mar 2005 19:53:18 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j2BJrHKU055236; Fri, 11 Mar 2005 13:53:17 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4231F729.2080107@centtech.com> Date: Fri, 11 Mar 2005 13:53:13 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050210 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Garance A Drosihn References: <4231B19D.8060406@centtech.com> <20050311183934.GB29287@odin.ac.hmc.edu> In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/761/Thu Mar 10 15:01:48 2005 on mh1.centtech.com X-Virus-Status: Clean cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 19:53:20 -0000 Garance A Drosihn wrote: > At 10:39 AM -0800 3/11/05, Brooks Davis wrote: > >> On Fri, Mar 11, 2005 at 08:56:29AM -0600, Eric Anderson wrote: >> >> > Is anyone working on this, or would someone like to work on it? >> > I am not much of a code guru, but I have the resources to test >> > this technology under all types of loads, and we are currently >> > using a commercial software to handle my needs (polyserve - which >> > they have flat out told me 'no' for FreeBSD support), but I would >> > much prefer to be on FreeBSD. >> >> If you've got money to throw at the problem, you might talk to >> Isilon and Panasas. > > > If you've got money to throw at the problem, you could throw it > at OpenAFS... :-) > > http://www.usenix.org/about/openafs/ > > However, usenix still haven't gotten back to me about whether I > could earmark my donations for OpenAFS on *specific* platforms... > I think if I knew it was going to FreeBSD work, I could swing that. I'm all for helping out a project like that, but in this case, I really need a result I can use in FreeBSD, not linux. If I needed it in linux, I'd just use GFS in it's current state :) Thanks for the link.. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology I have seen the future and it is just like the present, only longer. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 20:55:40 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BB8F816A4CF for ; Fri, 11 Mar 2005 20:55:40 +0000 (GMT) Received: from rproxy.gmail.com (rproxy.gmail.com [64.233.170.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D1C443D1F for ; Fri, 11 Mar 2005 20:55:40 +0000 (GMT) (envelope-from aaron.glenn@gmail.com) Received: by rproxy.gmail.com with SMTP id a41so918736rng for ; Fri, 11 Mar 2005 12:55:39 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references; b=Eo+2Q8LHbSEKhR8ypnSGqZZi5pDX2Ya5ifv7yPw3KTjY2P4ubCzxV27DzkbEvvthx2lZwh42QyisUZdI/cThzrJR360MMeUhWFNjllJzhiJybwtlUhi+1qiVmf43NQ/9CAJiZofoCCbf/nKHuz4l8XD7n9KXVn0kvVF7nfzta+8= Received: by 10.38.81.38 with SMTP id e38mr3046337rnb; Fri, 11 Mar 2005 12:55:39 -0800 (PST) Received: by 10.38.151.77 with HTTP; Fri, 11 Mar 2005 12:55:39 -0800 (PST) Message-ID: <18f6019405031112553b7286d2@mail.gmail.com> Date: Fri, 11 Mar 2005 12:55:39 -0800 From: Aaron Glenn To: Eric Anderson In-Reply-To: <4231B19D.8060406@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <4231B19D.8060406@centtech.com> cc: freebsd-fs@freebsd.org cc: freebsd-hackers@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Aaron Glenn List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 20:55:40 -0000 On Fri, 11 Mar 2005 08:56:29 -0600, Eric Anderson wrote: > Is anyone working on this, or would someone like to work on it? I am not much of a code guru, but I have the resources to test this technology under all types of loads, and we are currently using a commercial software to handle my needs (polyserve - which they have flat out told me 'no' for FreeBSD support), but I would much prefer to be on FreeBSD. This has been a persistant itch for as long as I can remember (4.3) but no one with the required skills has attempted to scratch it....yet aaron.glenn From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 21:15:51 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B125416A4CE for ; Fri, 11 Mar 2005 21:15:51 +0000 (GMT) Received: from mail.seekingfire.com (caliban.seekingfire.com [24.72.10.209]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6EEFB43D53 for ; Fri, 11 Mar 2005 21:15:51 +0000 (GMT) (envelope-from tillman@seekingfire.com) Received: by mail.seekingfire.com (Postfix, from userid 500) id 30F21E04; Fri, 11 Mar 2005 15:15:51 -0600 (CST) Date: Fri, 11 Mar 2005 15:15:51 -0600 From: Tillman Hodgson To: freebsd-fs@freebsd.org Message-ID: <20050311211551.GB60575@seekingfire.com> References: <4231B19D.8060406@centtech.com> <20050311183934.GB29287@odin.ac.hmc.edu> <4231F729.2080107@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <4231F729.2080107@centtech.com> X-Habeas-SWE-1: winter into spring X-Habeas-SWE-2: brightly anticipated X-Habeas-SWE-3: like Habeas SWE (tm) X-Habeas-SWE-4: Copyright 2002 Habeas (tm) X-Habeas-SWE-5: Sender Warranted Email (SWE) (tm). The sender of this X-Habeas-SWE-6: email in exchange for a license for this Habeas X-Habeas-SWE-7: warrant mark warrants that this is a Habeas Compliant X-Habeas-SWE-8: Message (HCM) and not spam. Please report use of this X-Habeas-SWE-9: mark in spam to . X-GPG-Key-ID: 828AFC7B X-GPG-Fingerprint: 5584 14BA C9EB 1524 0E68 F543 0F0A 7FBC 828A FC7B X-GPG-Key: http://www.seekingfire.com/personal/gpg_key.asc X-Urban-Legend: There is lots of hidden information in headers X-Tillman-rules: yes he does X-No-prize-winner: Nathanael User-Agent: Mutt/1.5.8i Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 21:15:51 -0000 On Fri, Mar 11, 2005 at 01:53:13PM -0600, Eric Anderson wrote: > Garance A Drosihn wrote: > > > >If you've got money to throw at the problem, you could throw it > >at OpenAFS... :-) > > > >http://www.usenix.org/about/openafs/ > > > >However, usenix still haven't gotten back to me about whether I > >could earmark my donations for OpenAFS on *specific* platforms... If they do, please let us know. I'd definitely toss in the equivalent of a couple of steak dinners (personally, not "corporately"). As the recent discussions on the SAGE mailing list (and elsewhere) have brought up, we're going to need either AFS or NFSv4 (client *and* server) or an equivalent in the near future to be able to meet newer and more stringent security policies. As a Unix and security consultant, solutions that address that on FreeBSD are a topic of interest to me :-) > I think if I knew it was going to FreeBSD work, I could swing that. I'm > all for helping out a project like that, but in this case, I really need a > result I can use in FreeBSD, not linux. If I needed it in linux, I'd just > use GFS in it's current state :) > > Thanks for the link.. Yes, thanks for the link Garance. -T -- Lonny: "What's that command to add something to SysV init?" Tillman: "c h k tab tab" Lonny: "chkconfig --add!" Tillman: "Cool. I just tab-completed Lonny's brain." From owner-freebsd-fs@FreeBSD.ORG Fri Mar 11 21:54:06 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 93F2716A4CE for ; Fri, 11 Mar 2005 21:54:06 +0000 (GMT) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1AEF543D4C for ; Fri, 11 Mar 2005 21:54:06 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j2BLrsDC056425; Fri, 11 Mar 2005 15:54:00 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4232136E.5090105@centtech.com> Date: Fri, 11 Mar 2005 15:53:50 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050210 X-Accept-Language: en-us, en MIME-Version: 1.0 To: yfyoufeng@263.net References: <4231B19D.8060406@centtech.com> <1110561042.5048.11.camel@localhost.localdomain> In-Reply-To: <1110561042.5048.11.camel@localhost.localdomain> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/761/Thu Mar 10 15:01:48 2005 on mh1.centtech.com X-Virus-Status: Clean cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2005 21:54:06 -0000 yf-263 wrote: > Hi, Eric, > > How about the MogileFS (http://www.danga.com/mogilefs/), which served a > pictures web service at about twenty millions. And all in user level. It > is also share some same ideas as GoogleFS (http://unix- > driver.org/books/linux/filesystem/googlefs/p125-ghemawat.pdf). > > And for Sistina's GFS (which sold to Redhat now), its 2.0 version has an > un-finished FreeBSD porting, which can be downloaded from its ftp server > (the address is not on my hand now, and I can tell you if you really > want it). > > Last year I have worked on porting that GFS to Darwin (since it use > FreeBSD fs codebase), so I'll glad to talk to you about it ;) Yes, please do send the link!! I couldn't find it in my meager googling. Do you have any insight as to when a 'real' FreeBSD port of GFS will be around? Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology I have seen the future and it is just like the present, only longer. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Sat Mar 12 01:35:07 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D240E16A4CE for ; Sat, 12 Mar 2005 01:35:07 +0000 (GMT) Received: from smtp.263.net (smtp.x263.net [211.150.96.25]) by mx1.FreeBSD.org (Postfix) with ESMTP id D1B9343D46 for ; Sat, 12 Mar 2005 01:35:00 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (mta5 [127.0.0.1]) by smtp.263.net (Postfix) with ESMTP id ADDB92F955; Sat, 12 Mar 2005 09:34:47 +0800 (CST) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (unknown [61.48.130.243]) JSHWADdHMkLDG4Lz.1 for ; Sat, 12 Mar 2005 09:34:47 +0800 (CST) X-TEBIE-Originating-IP: [61.48.130.243] From: yf-263 To: Brooks Davis In-Reply-To: <20050311183934.GB29287@odin.ac.hmc.edu> References: <4231B19D.8060406@centtech.com> <20050311183934.GB29287@odin.ac.hmc.edu> Content-Type: text/plain; charset=utf-8 Organization: Unix-driver.org Date: Sat, 12 Mar 2005 09:34:39 +0800 Message-Id: <1110591280.7030.17.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 8bit cc: freebsd-fs@freebsd.org cc: Eric Anderson Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: yfyoufeng@263.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2005 01:35:08 -0000 在 2005-03-11五的 10:39 -0800,Brooks Davis写é“: > On Fri, Mar 11, 2005 at 08:56:29AM -0600, Eric Anderson wrote: > > Speaking of filesytems :), I have a real need for a global filesystem (or > > shared fs, or clustered fs, or whatever), and my favorite OS doesn't have > > one (that I know of!). I saw that a few years back a few people were > > working on getting GFS working on FreeBSD, but there's no recent mention of > > that. > > Is anyone working on this, or would someone like to work on it? I am not > > much of a code guru, but I have the resources to test this technology under > > all types of loads, and we are currently using a commercial software to > > handle my needs (polyserve - which they have flat out told me 'no' for > > FreeBSD support), but I would much prefer to be on FreeBSD. > > If you've got money to throw at the problem, you might talk to Isilon > and Panasas. Both build clustered storge solutions (you buy their > hardware) that happen to be based on FreeBSD. They are currently > targeting Linux, but it might be fairly easy for them to support FreeBSD > given sufficent motivation. www.lustre.org of www.clusterfs.com is now working on porting its Lustre to Darwin/FreeBSD, and you may want have a look p(^o^)q > > -- Brooks > -- yf-263 Unix-driver.org From owner-freebsd-fs@FreeBSD.ORG Sat Mar 12 02:30:46 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A63D416A4CE for ; Sat, 12 Mar 2005 02:30:46 +0000 (GMT) Received: from smtp.263.net (smtp.263.net [211.150.96.25]) by mx1.FreeBSD.org (Postfix) with ESMTP id D3EEF43D39 for ; Sat, 12 Mar 2005 02:30:45 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (mta5 [127.0.0.1]) by smtp.263.net (Postfix) with ESMTP id 0FE622FB6D; Sat, 12 Mar 2005 10:30:43 +0800 (CST) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (unknown [61.48.130.243]) inHcAFJUMkIeHILz.1 for ; Sat, 12 Mar 2005 10:30:43 +0800 (CST) X-TEBIE-Originating-IP: [61.48.130.243] From: yf-263 To: Eric Anderson In-Reply-To: <4232136E.5090105@centtech.com> References: <4231B19D.8060406@centtech.com> <1110561042.5048.11.camel@localhost.localdomain> <4232136E.5090105@centtech.com> Content-Type: text/plain; charset=utf-8 Organization: Unix-driver.org Date: Sat, 12 Mar 2005 10:30:34 +0800 Message-Id: <1110594634.5048.29.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 8bit cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: yfyoufeng@263.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2005 02:30:46 -0000 在 2005-03-11五的 15:53 -0600,Eric Anderson写é“: > yf-263 wrote: > > Hi, Eric, > > > > How about the MogileFS (http://www.danga.com/mogilefs/), which served a > > pictures web service at about twenty millions. And all in user level. It > > is also share some same ideas as GoogleFS (http://unix- > > driver.org/books/linux/filesystem/googlefs/p125-ghemawat.pdf). > > > > And for Sistina's GFS (which sold to Redhat now), its 2.0 version has an > > un-finished FreeBSD porting, which can be downloaded from its ftp server > > (the address is not on my hand now, and I can tell you if you really > > want it). > > > > Last year I have worked on porting that GFS to Darwin (since it use > > FreeBSD fs codebase), so I'll glad to talk to you about it ;) > > Yes, please do send the link!! I couldn't find it in my meager googling. Do you have any insight as to when a 'real' FreeBSD port of GFS will be around? Sorry, seems I gave confuse. The code is old (which is GFS 3.0), and just can't work fully. It was in ftp.sistina.com/pub/GFS, and if you just open ftp.sistina.com, nothing will show-up (it hide its `pub' from public ;) ). 3.0 has a un- finished FreeBSD code described as following mail. 2.0 has GFS SGI code. http://docs.freebsd.org/cgi/getmsg.cgi?fetch=95974+0 +archive/2001/freebsd-fs/20010225.freebsd-fs serves its status. For when will it to be around, I'm sorry to say I don't know it. And seems RH has no plan to do it. > > > Eric > > > > -- yf-263 Unix-driver.org From owner-freebsd-fs@FreeBSD.ORG Sat Mar 12 02:36:57 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F09FC16A4F6 for ; Sat, 12 Mar 2005 02:36:57 +0000 (GMT) Received: from smtp.263.net (mx01.263.net.cn [211.150.96.22]) by mx1.FreeBSD.org (Postfix) with ESMTP id 746D843D55 for ; Sat, 12 Mar 2005 02:36:54 +0000 (GMT) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (localhost [127.0.0.1]) by smtp.263.net (Postfix) with ESMTP id 3D436C3590; Sat, 12 Mar 2005 10:36:45 +0800 (CST) (envelope-from yfyoufeng@263.net) Received: from 192.168.1.100 (unknown [61.48.130.243]) ouDMALxVMkLIDILz.1 for ; Sat, 12 Mar 2005 10:36:45 +0800 (CST) X-TEBIE-Originating-IP: [61.48.130.243] From: yf-263 To: Eric Anderson In-Reply-To: <1110594634.5048.29.camel@localhost.localdomain> References: <4231B19D.8060406@centtech.com> <1110561042.5048.11.camel@localhost.localdomain> <4232136E.5090105@centtech.com> <1110594634.5048.29.camel@localhost.localdomain> Content-Type: text/plain; charset=utf-8 Organization: Unix-driver.org Date: Sat, 12 Mar 2005 10:36:13 +0800 Message-Id: <1110594973.7028.33.camel@localhost.localdomain> Mime-Version: 1.0 X-Mailer: Evolution 2.0.2 (2.0.2-3) Content-Transfer-Encoding: 8bit cc: freebsd-fs@freebsd.org Subject: Re: Global / Cluster / Shared filesystem for FreeBSD? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: yfyoufeng@263.net List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2005 02:36:58 -0000 在 2005-03-12å…­çš„ 10:30 +0800,yf-263写é“: > 在 2005-03-11五的 15:53 -0600,Eric Anderson写é“: > > yf-263 wrote: > > > Hi, Eric, > > > > > > How about the MogileFS (http://www.danga.com/mogilefs/), which served a > > > pictures web service at about twenty millions. And all in user level. It > > > is also share some same ideas as GoogleFS (http://unix- > > > driver.org/books/linux/filesystem/googlefs/p125-ghemawat.pdf). > > > > > > And for Sistina's GFS (which sold to Redhat now), its 2.0 version has an > > > un-finished FreeBSD porting, which can be downloaded from its ftp server > > > (the address is not on my hand now, and I can tell you if you really > > > want it). > > > > > > Last year I have worked on porting that GFS to Darwin (since it use > > > FreeBSD fs codebase), so I'll glad to talk to you about it ;) > > > > Yes, please do send the link!! I couldn't find it in my meager googling. Do you have any insight as to when a 'real' FreeBSD port of GFS will be around? > > Sorry, seems I gave confuse. The code is old (which is GFS 3.0), and > just can't work fully. > > It was in ftp.sistina.com/pub/GFS, and if you just open ftp.sistina.com, > nothing will show-up (it hide its `pub' from public ;) ). 3.0 has a un- > finished FreeBSD code described as following mail. 2.0 has GFS SGI code. Sorry for mistaking, GFS 2.0 is for Irix, and the pub can be showd in lftp, I can't list it under firefox maybe because the slow adsl speed. > > http://docs.freebsd.org/cgi/getmsg.cgi?fetch=95974+0 > +archive/2001/freebsd-fs/20010225.freebsd-fs serves its status. > > For when will it to be around, I'm sorry to say I don't know it. And > seems RH has no plan to do it. > > > > > > > Eric > > > > > > > > -- yf-263 Unix-driver.org From owner-freebsd-fs@FreeBSD.ORG Sat Mar 12 16:20:54 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E95E816A4CE for ; Sat, 12 Mar 2005 16:20:54 +0000 (GMT) Received: from stewie.obfuscated.net (stewie.obfuscated.net [66.118.188.125]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3041A43D78 for ; Sat, 12 Mar 2005 16:20:54 +0000 (GMT) (envelope-from m@obmail.net) Received: from [192.168.1.13] (653259hfc120.tampabay.res.rr.com [65.32.59.120]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by stewie.obfuscated.net (Postfix) with ESMTP id C89E260D7 for ; Sat, 12 Mar 2005 11:20:53 -0500 (EST) Mime-Version: 1.0 (Apple Message framework v619.2) Content-Transfer-Encoding: 7bit Message-Id: <105f5f5fad6479848be727892a8444f4@obmail.net> Content-Type: text/plain; charset=US-ASCII; format=flowed To: freebsd-fs@freebsd.org From: Michael Conlen Date: Sat, 12 Mar 2005 11:20:52 -0500 X-Mailer: Apple Mail (2.619.2) Subject: Block size X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2005 16:20:55 -0000 I read somewhere (tuning?) that block sizes over 16k can be problematic. Can someone point me to info on why? I've got a filesystem that I think might benefit from it. From owner-freebsd-fs@FreeBSD.ORG Sat Mar 12 18:59:38 2005 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 779FE16A4CE; Sat, 12 Mar 2005 18:59:38 +0000 (GMT) Received: from beastie.mckusick.com (h000d932745f5.ne.client2.attbi.com [24.91.248.17]) by mx1.FreeBSD.org (Postfix) with ESMTP id C4F9443D39; Sat, 12 Mar 2005 18:59:37 +0000 (GMT) (envelope-from mckusick@mckusick.com) Received: from beastie.mckusick.com (localhost [127.0.0.1]) by beastie.mckusick.com (8.12.8/8.12.9) with ESMTP id j2C1HwqO070291; Fri, 11 Mar 2005 17:17:58 -0800 (PST) (envelope-from mckusick@beastie.mckusick.com) Message-Id: <200503120117.j2C1HwqO070291@beastie.mckusick.com> To: Alfred Perlstein In-Reply-To: Your message of "Mon, 28 Feb 2005 19:00:21 EST." Date: Fri, 11 Mar 2005 17:17:58 -0800 From: Kirk McKusick cc: Jeff Roberson cc: jeffr@freebsd.org cc: Xin LI cc: fs@freebsd.org Subject: Re: ffs softdeps fix request X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2005 18:59:38 -0000 > Date: Mon, 28 Feb 2005 19:00:21 -0500 (EST) > From: Jeff Roberson > To: Alfred Perlstein > cc: fs@freebsd.org, Xin LI , phk@freebsd.org, > jeffr@freebsd.org, mckusick@mckusick.com > Subject: Re: ffs softdeps fix request > In-Reply-To: <20050228235123.GC81082@elvis.mu.org> > Content-Type: TEXT/PLAIN; charset=US-ASCII > X-ASK-Info: Whitelist match [from jroberson@chesapeake.net] (2005/02/28 17:18:16) > > On Mon, 28 Feb 2005, Alfred Perlstein wrote: > > > There's an artifact of ffs softupdates that causes issues if a crash > > occurs while deleting or creating files. > > > > You should really ask Kirk about this sort of thing. > > > Basically, one can wind up with a directory that is empty, but the > > link count is artificially high. Then you can have a directory > > that is empty, but not removeable. It would be somewhat trivial > > to add some code to check the directory's contents when a VOP_RMDIR > > would have failed because of the link count check. > > > > But then my head went all explody when trying to figure out how > > that would impact the background fsck in progress. > > > > Any ideas? > > > > -- > > - Alfred Perlstein > > - Research Engineering Development Inc. > > - email: bright@mu.org cell: 408-480-4684 > > The background fsck assumes that the filesystem will act in expected ways. Notably, it will not "correct" improper reference counts. So, it would be OK to decide that it wanted to remove the directory, and to do so, provided that it consumed only two of the three reference counts on the directory inode. That is it could remove the name and contents of the directory, but it would have to leave the inode allocated (and unnamed) with a reference count of one. When the background fsck eventually came across it, it would decrement its reference count by one which would then cause it to be freed. Kirk McKusick