From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 8 08:35:27 2010 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BF788106566B for ; Thu, 8 Jul 2010 08:35:27 +0000 (UTC) (envelope-from cejkar@fit.vutbr.cz) Received: from kazi.fit.vutbr.cz (kazi6.fit.vutbr.cz [IPv6:2001:718:802:808::93e5:80c]) by mx1.freebsd.org (Postfix) with ESMTP id 4F24D8FC13 for ; Thu, 8 Jul 2010 08:35:26 +0000 (UTC) Received: from kazi.fit.vutbr.cz (localhost [127.0.0.1]) by kazi.fit.vutbr.cz (envelope-from cejkar@fit.vutbr.cz) (8.14.4/8.14.4) with ESMTP id o688ZN3Y094477 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 8 Jul 2010 10:35:23 +0200 (CEST) Received: (from cejkar@localhost) by kazi.fit.vutbr.cz (8.14.4/8.13.1/Submit) id o688ZMaK094476; Thu, 8 Jul 2010 10:35:22 +0200 (CEST) (envelope-from cejkar@fit.vutbr.cz) X-Authentication-Warning: kazi.fit.vutbr.cz: cejkar set sender to cejkar@fit.vutbr.cz using -f Date: Thu, 8 Jul 2010 10:35:22 +0200 From: Cejka Rudolf To: Ken Smith Message-ID: <20100708083522.GA89496@fit.vutbr.cz> References: <1278081504.83414.26.camel@bauer.cse.buffalo.edu> <201007071732.o67HWPN3034932@hergotha.csail.mit.edu> <1278524349.46615.32.camel@bauer.cse.buffalo.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1278524349.46615.32.camel@bauer.cse.buffalo.edu> User-Agent: Mutt/1.5.20 (2009-06-14) X-Scanned-By: MIMEDefang 2.70 on 147.229.8.12 Cc: Garrett Wollman , hubs@freebsd.org Subject: Re: FreeBSD 8.1-RC2 Available... X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Jul 2010 08:35:27 -0000 Ken Smith wrote (2010/07/07): > On Wed, 2010-07-07 at 13:32 -0400, Garrett Wollman wrote: > > I'm not sure how many months it will take for these to show up on ftp5 > > at the current rate of updates. Presently it takes about two and a > > half weeks just to synchronize all the packages, after which cvsup > > hits some sort of timeout and starts all over again. Did you try to use -Pa option for cvsup? It helped me very much, when I tried to compare speeds of cvsup with and without this option in the past. Speed increased from 50 KB/s to 500 KB/s. I still use this option today and the speed of updates on european ftp-master.eu.FreeBSD.org is sufficient. The mirror is currently synchronized and last bigger update including files FreeBSD-8.1-RC2-amd64-dvd1.iso.gz and FreeBSD-8.1-RC2-i386-dvd1.iso.gz ran under 3 hours. > > (This may be a result of switching to ZFS -- it seems that ZFS is > > about one tenth the speed of UFS2 on the same hardware -- but I > > haven't had time to investigate any more deeply than that. Any ZFS > > experts out there who could suggest a fruitful line of research?) I'm not ZFS expert either, but I have similar experiences and I rather stayed with UFS2. I think that long fsck is not such a big problem for our mirrors and I can see on my 8 x 500 GB HW RAID-5 sequential reads up to 300 MB/s using UFS2, instead of just 30 MB/s using ZFS (tested both over RAID-5 and JBOD). Raidtest showed me similar results too. My understading of ZFS is that it it great FS, when I have many disk subsystems, and I need to build one to many flexible filesystems over them. > As a heads-up switching over to rsync generally is in the works. Great, thanks ;o) I'm the first hungry customer with ftp-master.eu.FreeBSD.org ;o) > The motivation is being able to have files larger than 2Gb. > Pieces of cvsup keep track of file sizes as a signed integer > so max file size is 2^31... The other problems are limited capabilities using IPv6 and I really do not believe in identity of source and destination trees mirrored using cvsup... Regards. -- Rudolf Cejka http://www.fit.vutbr.cz/~cejkar Brno University of Technology, Faculty of Information Technology Bozetechova 2, 612 66 Brno, Czech Republic