From owner-freebsd-questions@FreeBSD.ORG Wed May 16 20:15:50 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0373616A401 for ; Wed, 16 May 2007 20:15:50 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from mxfep04.bredband.com (mxfep04.bredband.com [195.54.107.79]) by mx1.freebsd.org (Postfix) with ESMTP id 46B9013C4B9 for ; Wed, 16 May 2007 20:15:49 +0000 (UTC) (envelope-from peter.schuller@infidyne.com) Received: from ironport2.bredband.com ([195.54.107.84] [195.54.107.84]) by mxfep04.bredband.com with ESMTP id <20070516201545.PHYK24095.mxfep04.bredband.com@ironport2.bredband.com> for ; Wed, 16 May 2007 22:15:45 +0200 Received: from c-5416e555.03-51-73746f3.cust.bredbandsbolaget.se (HELO scode.mine.nu) ([85.229.22.84]) by ironport2.bredband.com with ESMTP; 16 May 2007 22:15:42 +0200 Received: from scode.mine.nu (localhost [127.0.0.1]) by scode.mine.nu (Postfix) with ESMTP id CF55214678; Wed, 16 May 2007 22:15:17 +0200 (CEST) Message-ID: <464B6649.2030105@infidyne.com> Date: Wed, 16 May 2007 22:15:05 +0200 From: Peter Schuller User-Agent: Thunderbird 2.0.0.0 (X11/20070501) MIME-Version: 1.0 To: Paul Schmehl References: <437646E3279CED649940FB48@utd59514.utdallas.edu> In-Reply-To: <437646E3279CED649940FB48@utd59514.utdallas.edu> X-Enigmail-Version: 0.95.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="------------enig2F40474516E217B158ACF88A" Cc: FreeBSD Questions Subject: Re: Best remote backup method? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 May 2007 20:15:50 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig2F40474516E217B158ACF88A Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable > I'm presently backing up two servers in a remote location to a usb driv= e > located elsewhere by using rsync over ssh (all three are FreeBSD boxes.= ) > After the recent discussion about dump, I'm wondering if I would gain > anything by using dump rather than rsync. Has anyone used both? Any > thoughts as to which is "better" and why? >=20 > The rsync command I use is: > rsync -avz ${LOCALDIR} -e "ssh -i ${KEY}" ${REMOTEHOST}:${REMOTEDIR} Personally I never find dump/restore practical since I seldom want to backup entire filesystems for performance/diskspace reasons. I have not found any truly perfect solution; what I am using most often is rdiff-backup which combines the properties of incremental backups and rsync. It keeps an up-to-date mirror along with reverse diffs. The good parts are that: * It works without hassle right off the bat over ssh. No fuss. * It is able to backup ownership information without running as root, because meta-data is stored separately from the files (but at the same time the up-to-date mirror is a plain tree on disk so you do not actually have to use rdiff-backup for restores unless you care about ownership and such). * Other than using the rsync algorithm for transfers, the actual reverse diffs are also expressed at a more granular level than entire files. End result is that a daily backup of that 5 gig log file will not consume 5 gigs of storage per day (but will be very slow to backup). The main downsides are IMO: * It's fairly slow. I don't generally see it saturating neither disk nor networking. Sometimes it's CPU bound, but oftentimes it's just slow without an obvious bottleneck (probably architectural in the protocol). * It has some reliability issues. A common problem is that certain meta-dat is kept in gzip files, and in certain cases of rdiff-backup being interrupted these files will get corrupted and rdiff-backup will refuse to function due to the gzip library throwing an exception. * While it basically works like rsync with history and is thus very simple to get started with, it does just that. If you want things like automatic rotation schemes with hourly/daily/etc you have to script that on top. --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller ' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --------------enig2F40474516E217B158ACF88A Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.3 (FreeBSD) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFGS2ZVDNor2+l1i30RCBUAAJ0VGJ1SiY1G9wakueiAJ1q4+p5iBgCeLDKt s7ZYE2wPycaKRJOTdzyQHRI= =fVGk -----END PGP SIGNATURE----- --------------enig2F40474516E217B158ACF88A--