From owner-freebsd-cluster@FreeBSD.ORG Mon Mar 1 19:12:10 2010 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 999C3106566B for ; Mon, 1 Mar 2010 19:12:10 +0000 (UTC) (envelope-from doug@polands.org) Received: from hrndva-omtalb.mail.rr.com (hrndva-omtalb.mail.rr.com [71.74.56.125]) by mx1.freebsd.org (Postfix) with ESMTP id 519888FC22 for ; Mon, 1 Mar 2010 19:12:10 +0000 (UTC) Received: from hrndva-omtalb.mail.rr.com ([10.128.143.52]) by hrndva-qmta02.mail.rr.com with ESMTP id <20100301185243110.IUID1979@hrndva-qmta02.mail.rr.com> for ; Mon, 1 Mar 2010 18:52:43 +0000 X-Authority-Analysis: v=1.0 c=1 a=tH3TCQxNhl/vWwTfLVWeHw==:17 a=dwBwwg8NJ5-TyUHOnOIA:9 a=t2MhQW9mOcMmOmXw9uxwMWKHh5cA:4 a=0VRiniRuMFoA:10 X-Cloudmark-Score: 0 X-Originating-IP: 75.87.219.217 Received: from [75.87.219.217] ([75.87.219.217:62599] helo=haran.polands.org) by hrndva-oedge02.mail.rr.com (envelope-from ) (ecelerity 2.2.2.39 r()) with ESMTP id 27/F1-20266-4BC0C8B4; Mon, 01 Mar 2010 18:51:33 +0000 Received: from email.polands.org (ararat.polands.org [172.16.1.20]) by haran.polands.org (8.14.3/8.14.3) with ESMTP id o21IpUuh033429; Mon, 1 Mar 2010 12:51:30 -0600 (CST) (envelope-from doug@polands.org) Received: from 209.103.214.35 (SquirrelMail authenticated user djp) by email.polands.org with HTTP; Mon, 1 Mar 2010 12:51:30 -0600 Message-ID: In-Reply-To: References: <4B8A4EFF.9050207@argonsoft.de> Date: Mon, 1 Mar 2010 12:51:30 -0600 From: "Doug Poland" To: "Leinier Cruz Salfran" User-Agent: SquirrelMail/1.4.20-RC2 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal Cc: freebsd-cluster@freebsd.org Subject: Re: Cluster Filesystem on FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 01 Mar 2010 19:12:10 -0000 On Mon, March 1, 2010 12:11, Leinier Cruz Salfran wrote: > On Sun, Feb 28, 2010 at 6:09 AM, Erik Scholtz, ArgonSoft GmbH > wrote: > >> I did some research the last two weeks on how to build a cluster >> filesystem on FreeBSD. >> >> My solution at the moment is, to rsync all filesystems once a >> minute, which is rather to rare. So I tried to get a hook with >> KQueue to rsync the filesystems on data-change. Unfortunatly I could >> not find a working solution (had a try with IO::KQueue using perl). >> > > i use rsync to make partial data backup .. ie: /etc, /usr/local/etc, > /usr/home, /var/logs ... > >> How do you guys solve this problem (of a shared filesystem with >> rw-option)? >> Any hints are welcome, since I'm getting very frustrated at the >> moment. >> > > there is a project named 'hast'[1] for a clustered filesystem .. it's > being developed by pawel .. the project has some completed milestones, > so you can get it from fbsd src svn tree .. hast can do clustered > filesystem right now but it's not complete, so there is no stable yet > > other way is gmirror[2] + ggated .. with that you can get a raid1 over > net solution .. but i think it's not prepared to be used as > master-master soluction > Neither hast nor gmirror+ggatd are cluster filesystems, in that only one "side" of the storage is available for writes at a point in time. Filesystems like OCFS2 and GFS allow multiple, simultaneous read-write access to block devices. Given there is not true cluster filesystem available for FreeBSD at this time, I wonder aloud why so many people are so quick to dismiss NFS? NFS provides "most" of features of a cluster filesystem today. If one were to choose NFS for shared storage, one could use tools available today to make NFS highly available (hast, gmirror+ggated). -- Regards, Doug