From owner-freebsd-cluster@FreeBSD.ORG Sun Feb 28 11:36:39 2010 Return-Path: Delivered-To: freebsd-cluster@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9EAD2106564A for ; Sun, 28 Feb 2010 11:36:39 +0000 (UTC) (envelope-from escholtz@argonsoft.de) Received: from coyote.quickmin.net (coyote.quickmin.net [217.14.112.24]) by mx1.freebsd.org (Postfix) with ESMTP id 0E55E8FC12 for ; Sun, 28 Feb 2010 11:36:38 +0000 (UTC) Received: (qmail 53787 invoked from network); 28 Feb 2010 12:09:56 +0100 Received: by simscan 1.4.0 ppid: 53784, pid: 53785, t: 0.0148s scanners: clamav: 0.95.2/m:49/d:8609 Comment: DomainKeys? See http://antispam.yahoo.com/domainkeys DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=default; d=argonsoft.de; b=jX5ashBQDLvGhqhjtt5sjhZbX92icMCdiwFGvImckpy/SW5j9AfH6ZXv1Rzaq4wiif9c5gwJ4RSjgUz0oq/07EN/2jMYL5v7/jykyGU4L0ZWeeBWczNVzSIMCLw8FLRI0QZ2Fpdw64lMvrHIYWJZIxWXp0jPpnfWpKl3qm5utns= ; Received: from 190-170-20-212.dsl.globvill.net (HELO erik-scholtzs-macbook-pro-15.local) (00000150@212.20.170.190) by coyote.quickmin.net with SMTP; 28 Feb 2010 12:09:56 +0100 Message-ID: <4B8A4EFF.9050207@argonsoft.de> Date: Sun, 28 Feb 2010 12:09:51 +0100 From: "Erik Scholtz, ArgonSoft GmbH" User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812) MIME-Version: 1.0 To: freebsd-cluster@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Cluster Filesystem on FreeBSD X-BeenThere: freebsd-cluster@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Clustering FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2010 11:36:39 -0000 Hi, I did some research the last two weeks on how to build a cluster filesystem on FreeBSD. Since neither GFS ( http://sources.redhat.com/cluster/gfs/ ) nor OCFS2 ( http://oss.oracle.com/projects/ocfs2/ ) are ported to FreeBSD, I took a look at the GlusterFS-project ( http://www.gluster.org/ ), which also does not compile on FreeBSD 7.x, as well as PVFS ( http://www.pvfs.org/ ). My solution at the moment is, to rsync all filesystems once a minute, which is rather to rare. So I tried to get a hook with KQueue to rsync the filesystems on data-change. Unfortunatly I could not find a working solution (had a try with IO::KQueue using perl). NFS isn't really a solution, since it is slow (even on 1GBit) and is a single point of failure: Clustering the NFS server with machines in stand-by, that do a fail-over on a crash of the master-NFS is unstable and makes a lot more costs to the project. I'm with FreeBSD since the 2.1 release and I really love this system for it's performance and stability. But in the last year I came very often to a point, where I had no solution on FreeBSD and several solutions for Linux (like SAS-support, ...). How do you guys solve this problem (of a shared filesystem with rw-option)? Any hints are welcome, since I'm getting very frustrated at the moment. Greetings, Erik -- My blog: http://blog.elitecoderz.net