Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 21 Jun 2003 13:08:29 -0700 (PDT)
From:      Tom Samplonius <tom@sdf.com>
To:        Simon <simon@optinet.com>
Cc:        "freebsd-isp@freebsd.org" <freebsd-isp@freebsd.org>
Subject:   Re: What would be the best way to copy lots of files from oneserver to another.
Message-ID:  <Pine.BSF.4.05.10306211305250.16428-100000@misery.sdf.com>
In-Reply-To: <20030621182925.0A54143F3F@mx1.FreeBSD.org>

next in thread | previous in thread | raw e-mail | index | archive | help

On Sat, 21 Jun 2003, Simon wrote:

> I recently used rsync to copy ~35gb worth of data, 1,170,168 inodes,
> without any problem over 100mbps interface. Took 3 or so hours.
> You do need lots of RAM, if you swap, you're screwed. RAM
> usage would depend on number of files you need to copy at once.
> 
> -Simon

  Yes, rsync uses large amounts of memory when the fileset is large.
Plus, depending on your CPU, you might want to avoid using ssh encryption
too.

  Usually if it is a LAN to LAN copy, cpdup over NFS will be WAY faster
than rsync, and use little memory.  I've used cpdup for moving mail to a
new server.  I synced before the cutover, shutdown the mail server, synced
one more, and then brought up the mail server on the system.  Very tidy.

Tom






Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.BSF.4.05.10306211305250.16428-100000>