Date: Sat, 20 Dec 2008 10:20:12 +0100 From: Peter Schuller <peter.schuller@infidyne.com> To: David N <davidn04@gmail.com> Cc: questions@freebsd.org Subject: Re: Backing Up ZFS Message-ID: <20081220092011.GA88327@hyperion.scode.org> In-Reply-To: <4d7dd86f0812181647n7fb63aabi86baf8417bfa3966@mail.gmail.com> References: <4d7dd86f0812181647n7fb63aabi86baf8417bfa3966@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--T4sUOijqQbZv57TR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > I'm just curious at what others are currently doing to back up huge > amounts of data. eg. 2TB and onwards. I'm using rdiff-backup and some scripting to backup ZFS snapshots. Other than the use of the ZFS snapshots there's nothing special about it. If your use case is suitable for rdiff-backup, using it with ZFS is a nice combination. For 2 TB+ I do suspect you would want to divide that up into multiple distinct rdiff-backup sets and indeed dependening on situation you may still have a problem with performance. In general I don't know that there is a lot ZFS specific to know about backups other than the availability of snapshots, and other than the potential to use zfs send/receive. Personally I am reluctant to use ZFS send/receive at this stage, because it is too dependent on ZFS. I would love to use it for maintaining a hot standby machine, or having an almost-realtime backup in the best case senario. But I would probably want a generic non-ZFS specific backup as my primary backup as well. One risk that you want to target with ZFS is that of a bug in ZFS itself; such bugs could conceivably be such that it affects your zfs send/receive backup. You mention: > 3. ZFS -> Remote ZFS using RSync (Living in Australia, there are > limits on data transfer of a few hundred GB per month, to costs are > prohibitive) rdiff-backup will be good in this senario too, giving you a rolling window of history in addition to an up-to-date mirror. It does do incremental updates including applying the rsync algorithm on individual files. It is definitely slower, in terms of CPU usage, than rsync however so if you have massive amounts of small files you may feel there is an issue. That said, I'm using it regularly to backup millions of files (e.g. collections of Maildir mailboxes). I mention rdiff-backup but of course there are plenty of others. I just happen to prefer rdiff-backup, mostly because of it's "rsync mirror + history" semantics and completely trivial setup. --=20 / Peter Schuller PGP userID: 0xE9758B7D or 'Peter Schuller <peter.schuller@infidyne.com>' Key retrieval: Send an E-Mail to getpgpkey@scode.org E-Mail: peter.schuller@infidyne.com Web: http://www.scode.org --T4sUOijqQbZv57TR Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) iEYEARECAAYFAklMuMsACgkQDNor2+l1i31WvwCg630JsghFHth9SL31aGKjwU6c FGEAmwYS2Tz0GqN45mgD4JjMdtztIocH =5onU -----END PGP SIGNATURE----- --T4sUOijqQbZv57TR--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20081220092011.GA88327>