From owner-freebsd-questions@FreeBSD.ORG  Fri Oct 11 02:39:01 2013
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id 71CBC6BA
 for <freebsd-questions@freebsd.org>; Fri, 11 Oct 2013 02:39:01 +0000 (UTC)
 (envelope-from wblock@wonkity.com)
Received: from wonkity.com (wonkity.com [67.158.26.137])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 23B362ED0
 for <freebsd-questions@freebsd.org>; Fri, 11 Oct 2013 02:39:00 +0000 (UTC)
Received: from wonkity.com (localhost [127.0.0.1])
 by wonkity.com (8.14.7/8.14.7) with ESMTP id r9B2cxEF056025;
 Thu, 10 Oct 2013 20:39:00 -0600 (MDT)
 (envelope-from wblock@wonkity.com)
Received: from localhost (wblock@localhost)
 by wonkity.com (8.14.7/8.14.7/Submit) with ESMTP id r9B2cxCl056022;
 Thu, 10 Oct 2013 20:38:59 -0600 (MDT)
 (envelope-from wblock@wonkity.com)
Date: Thu, 10 Oct 2013 20:38:59 -0600 (MDT)
From: Warren Block <wblock@wonkity.com>
To: aurfalien <aurfalien@gmail.com>
Subject: Re: copying milllions of small files and millions of dirs
In-Reply-To: <852D7000-F9D2-4C63-8D68-A56F77EB9B8C@gmail.com>
Message-ID: <alpine.BSF.2.00.1310102038260.55372@wonkity.com>
References: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com>
 <20130816064612.GH1190@petole.demisel.net>
 <852D7000-F9D2-4C63-8D68-A56F77EB9B8C@gmail.com>
User-Agent: Alpine 2.00 (BSF 1167 2008-08-23)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3
 (wonkity.com [127.0.0.1]); Thu, 10 Oct 2013 20:39:00 -0600 (MDT)
Cc: freebsd-questions@freebsd.org,
 Nicolas KOWALSKI <nicolas.kowalski@gmail.com>
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 11 Oct 2013 02:39:01 -0000

On Thu, 10 Oct 2013, aurfalien wrote:

>
> On Aug 15, 2013, at 11:46 PM, Nicolas KOWALSKI wrote:
>
>> On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote:
>>> Is there a faster way to copy files over NFS?
>>
>> I would use find+cpio. This handles hard links, permissions, and in case
>> of later runs, will not copy files if they already exist on the
>> destination.
>>
>> # cd /source/dir
>> # find . | cpio -pvdm /destination/dir
>
>
> Old thread I know but cpio has proven twice as fast as rsync.
>
> Trusty ol cpio.
>
> Gonna try cpdup next.

Try sysutils/clone, too.