From owner-freebsd-fs@FreeBSD.ORG Sat Apr 21 02:04:16 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0C56116A401 for ; Sat, 21 Apr 2007 02:04:16 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id D295D13C44C for ; Sat, 21 Apr 2007 02:04:15 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from [192.168.42.21] (andersonbox1.centtech.com [192.168.42.21]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id l3L24BUn074195; Fri, 20 Apr 2007 21:04:12 -0500 (CDT) (envelope-from anderson@freebsd.org) Message-ID: <4629711B.9070902@freebsd.org> Date: Fri, 20 Apr 2007 21:04:11 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.10 (X11/20070320) MIME-Version: 1.0 To: Mike Wolman References: <20070420232209.G4559@nux.eros.office> <20070421000029.N4559@nux.eros.office> <20070421000805.GA64413@cicely12.cicely.de> <20070421011716.B4559@nux.eros.office> <20070421010734.GD64413@cicely12.cicely.de> <20070421021529.R16230@nux.eros.office> In-Reply-To: <20070421021529.R16230@nux.eros.office> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/3141/Fri Apr 20 15:23:13 2007 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: freebsd-fs@freebsd.org, ticso@cicely.de Subject: Re: lazy mirror / live backup X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Apr 2007 02:04:16 -0000 On 04/20/07 20:25, Mike Wolman wrote: > > On Sat, 21 Apr 2007, Bernd Walter wrote: > >> On Sat, Apr 21, 2007 at 01:38:31AM +0100, Mike Wolman wrote: >>> My only concern is zfs is quite heavy weight (memory wise) compared to >>> gmirror and ufs for a simple laptop/desktop setup which you may just want >>> to replicate the entire drive and grab the ggatec device and be ready to >>> run should anything happen to the machine. >> Yes - that's unfortunately true. >> >>> Im sure there are other situations where running zfs on the available >>> hardware is not an option compared to gmirror - im not sure what the >>> recommended amount for freebsd but as far as i can rember the suggested >>> about for solaris is 1Gb - comparing to gmirror i think i have run it on a >>> machine doing simple home fileserving with 128Mb. >> Ever thought about UFS snapshots backed with rsync? >> You get a consitent pseudo image of your running filesystem with >> unallocated blocks represented as zeros. >> rsync now allows comparing file chunks and copies only differences. >> Still every block need to be read, though. > > Yea i use rsync and snapshots quite a bit, but unfortunately rsync works > at the filesystem level so you cant really get a bootable image of the whole > device. It would be nice if this could be done without user interaction, > ie if the ggatec component of a mirror disappears and reappears gmirror > justs gets to work syncing things up. rsync and it's like are great tools, but traversing the tree every time is not only slow and heavy handed, but it takes an enormous amount of memory (akin to fsck) for large file systems. rsync isn't the right tool for lazy syncing. >> vbackup from devel/plan9port stores checksums and allows offering >> only different blocks to the other side. >> venti - the backing store behind vbackup - allows compression and >> single storage of different blocks with same data, which reduces >> the required backup capacity very impressive. >> My expirience with vbackup is that this mechanism is fast enough >> as long as there are no hughe differences. >> > > I'll take a peek as it sounds interesting, Eric