Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 29 Sep 2010 21:20:48 -0400
From:      Dan Langille <dan@langille.org>
To:        Artem Belevich <fbsdlist@src.cx>
Cc:        freebsd-stable@freebsd.org
Subject:   Re: zfs send/receive: is this slow?
Message-ID:  <4CA3E5F0.7000603@langille.org>
In-Reply-To: <AANLkTikb-uw25UJYT8bt_qWshRmz%2B=FcNzkSZt_eAe4q@mail.gmail.com>
References:  <a263c3beaeb0fa3acd82650775e31ee3.squirrel@nyi.unixathome.org> <AANLkTikb-uw25UJYT8bt_qWshRmz%2B=FcNzkSZt_eAe4q@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On 9/29/2010 3:57 PM, Artem Belevich wrote:
> On Wed, Sep 29, 2010 at 11:04 AM, Dan Langille<dan@langille.org>  wrote:
>> It's taken about 15 hours to copy 800GB.  I'm sure there's some tuning I
>> can do.
>>
>> The system is now running:
>>
>> # zfs send storage/bacula@transfer | zfs receive storage/compressed/bacula
>
> Try piping zfs data through mbuffer (misc/mbuffer in ports). I've
> found that it does help a lot to smooth out data flow and increase
> send/receive throughput even when send/receive happens on the same
> host. Run it with a buffer large enough to accommodate few seconds
> worth of write throughput for your target disks.

Thanks.  I just installed it.  I'll use it next time.  I don't want to 
interrupt this one.  I'd like to see how long it takes.  Then compare.

> Here's an example:
> http://blogs.everycity.co.uk/alasdair/2010/07/using-mbuffer-to-speed-up-slow-zfs-send-zfs-receive/

That looks really good. Thank you.

-- 
Dan Langille - http://langille.org/



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4CA3E5F0.7000603>