Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 28 Jul 2014 01:09:24 +0900
From:      DarkSoul <darksoul@darkbsd.org>
To:        Vladislav Prodan <universite@ukr.net>, questions@freebsd.org
Cc:        fs@freebsd.org, "net@freebsd.org net@freebsd.org" <net@freebsd.org>
Subject:   Re: Say me, please, how I can transfer between servers ZFS-partitions larger than 20Gb.
Message-ID:  <53D52434.7030308@darkbsd.org>
In-Reply-To: <1406471619.238727352.o7o2ccyx@frv35.fwdcdn.com>
References:  <1406471619.238727352.o7o2ccyx@frv35.fwdcdn.com>

Next in thread | Previous in thread | Raw E-Mail | Index | Archive | Help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--5jXL8L7B7ukTrP2NGVQMs1IExhQWAeuPa
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable

On 07/27/2014 11:45 PM, Vladislav Prodan wrote:
> Say me, please, how I can transfer between servers ZFS-partitions large=
r than 20Gb.
> I have 4 partitions with backup data. There are a lot of small pictures=
=2E
>
> NAME                                   USED  AVAIL  REFER  MOUNTPOINT
> tank2                                 1,42T  1,32T   118M  legacy
> ...
> tank2/ay-files                        31,9G  1,32T  31,8G  /backup/beas=
tie/upload_ftp/ay/files
> tank2/XXXXXmarket-images               135G  1,32T   135G  /backup/beas=
tie/upload_ftp/XXXXXmarket/images
> tank2/XXXXXmarket-uploads             17,6G  1,32T  17,5G  /backup/beas=
tie/upload_ftp/XXXXXmarket/uploads
> tank2/YYYYmarket                      24,4G  1,32T   152K  /backup/beas=
tie/upload_ftp/YYYYmarket
> tank2/YYYYmarket/uploads              24,4G  1,32T  24,2G  /backup/beas=
tie/upload_ftp/YYYYmarket/uploads
> ...
>
> Say me, please, how I can transfer it at another server with ZFS.
> Servers are connected through unmanaged 100M switch.
> Sending via (zfs send) and (ssh host2 zfs recv) ends with error after 2=
0GB of data.
> Sending via rsync is very lasting and requires often restart of rsync.
>
> What an alternative?

For the initial 20G upload, you could zfs send to a file, and transfer
that file via rsync or other resumable file transfer system that ensures
integrity :
host1# zfs send tank2/XXXXXmarket-images@snapshot >
tank2-XXXXXmarket-images@snapshot.zfs
host1# rsync tank2-XXXXXmarket-images@snapshot.zfs host2:

host2# cat tank2-XXXXXmarket-images@snapshot.zfs | zfs recv tank3

Then the rest can be done via small snapshots and plain zfs send | ssh
host2 zfs recv.
You could even add bzip2 compression and decompression at each endpoint.

This is what I am doing to replicate data of often updated filesystems
(mailbox filesystems, with LOTS of small files) between ZFS servers.

Cheers,

> --=20
> Stephane LAPIE, EPITA SRS, Promo 2005
> "Even when they have digital readouts, I can't understand them."
> --MegaTokyo
>
> --=20
> Stephane LAPIE, EPITA SRS, Promo 2005
> "Even when they have digital readouts, I can't understand them."
> --MegaTokyo


--5jXL8L7B7ukTrP2NGVQMs1IExhQWAeuPa
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.14 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iF4EAREIAAYFAlPVJDQACgkQDJ4OK7D3FWR20wEAlEwxKf4EqYiLuYSTLua3Pkdo
vGLQncD91yq63gc2CSoA/3skYXgw/ADY6Fq77LHEHxBnSeWhJYfID6Kd/pPtWy9B
=1/W9
-----END PGP SIGNATURE-----

--5jXL8L7B7ukTrP2NGVQMs1IExhQWAeuPa--



Want to link to this message? Use this URL: <http://docs.FreeBSD.org/cgi/mid.cgi?53D52434.7030308>