From owner-freebsd-questions@FreeBSD.ORG Fri Oct 1 12:42:29 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 65ABA16A4DE for ; Fri, 1 Oct 2004 12:42:29 +0000 (GMT) Received: from mproxy.gmail.com (rproxy.gmail.com [64.233.170.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1795543D2F for ; Fri, 1 Oct 2004 12:42:29 +0000 (GMT) (envelope-from bjmccann@gmail.com) Received: by mproxy.gmail.com with SMTP id v18so3599928rnb for ; Fri, 01 Oct 2004 05:42:28 -0700 (PDT) Received: by 10.38.206.80 with SMTP id d80mr830539rng; Fri, 01 Oct 2004 05:42:28 -0700 (PDT) Received: by 10.38.179.42 with HTTP; Fri, 1 Oct 2004 05:42:28 -0700 (PDT) Message-ID: <2b5f066d0410010542a38e93b@mail.gmail.com> Date: Fri, 1 Oct 2004 08:42:28 -0400 From: Brian McCann To: freebsd-questions@freebsd.org In-Reply-To: <2034.67.167.52.21.1096577945.squirrel@www.l-i-e.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit References: <2b5f066d04093013344d048003@mail.gmail.com> <2034.67.167.52.21.1096577945.squirrel@www.l-i-e.com> Subject: Re: Backup/Restore X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Brian McCann List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Oct 2004 12:42:29 -0000 I have the case where a new file is created about every second or two, nothing gets changed, but files get deleted occasionally (it's a mail server). I thought of using tar, but it would be just as slow as dump I would think. I've thought of breaking it up into chunks, but that still doesn't solve my speed issue...i'm beginning to consider using dd since it reads the actual disk bits, and just hope that a)I don't ever need one file and b) the system I restore to has at least or more space then the original server. Any other thoughts anyone? Thanks again, --Brian On Thu, 30 Sep 2004 13:59:05 -0700 (PDT), Richard Lynch wrote: > > > Brian McCann wrote: > > Hi all...I'm having a conceptual problem I can't get around and > > was hoping someone can change my focus here. I've been backing up > > roughly 6-8 million small files (roughly 2-4k each) using dump, but > > restores take forever due to the huge number of files and directories. > > Luckily, I haven't had to restore for an emergency yet...but if I > > need to, I'm kinda stuck. I've looked at distributed file systems > > like CODA, but the number of files I have to deal with will make it > > choke. Can anyone offer any suggestions? I've pondered running > > rsync, but am very worried about how long that will take... > > Do the files change a lot, or is it more like a few files added/changed > every day, and the bulk don't change? > > If it's the latter, you could maybe get best performance from something > like Subversion (a CVS derivative). > > Though I suspect rsync would also do well in that case. > > If a ton of those files are changing all the time, try doing a test on > creating a tarball and then backing up the tarball. That may be a simple > managable solution. There are probably other more complex solutions of > which I am ignorant :-) > > -- > Like Music? > http://l-i-e.com/artists.htm > > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" >