From owner-freebsd-hubs Fri Apr 4 05:31:23 1997 Return-Path: Received: (from root@localhost) by freefall.freebsd.org (8.8.5/8.8.5) id FAA07661 for hubs-outgoing; Fri, 4 Apr 1997 05:31:23 -0800 (PST) Received: from Campino.Informatik.RWTH-Aachen.DE (campino.Informatik.RWTH-Aachen.DE [137.226.116.240]) by freefall.freebsd.org (8.8.5/8.8.5) with ESMTP id FAA07654 for ; Fri, 4 Apr 1997 05:31:20 -0800 (PST) Received: from gilberto.physik.rwth-aachen.de (gilberto.physik.rwth-aachen.de [137.226.31.2]) by Campino.Informatik.RWTH-Aachen.DE (RBI-Z-5/8.6.12) with ESMTP id PAA12053; Fri, 4 Apr 1997 15:31:36 +0200 (MET DST) Received: (from kuku@localhost) by gilberto.physik.rwth-aachen.de (8.8.5/8.6.9) id PAA07548; Fri, 4 Apr 1997 15:45:18 +0200 (MET DST) Message-ID: Date: Fri, 4 Apr 1997 15:45:17 +0200 From: kuku@gilberto.physik.rwth-aachen.de (Christoph Kukulies) To: jkh@time.cdrom.com (Jordan K. Hubbard) Cc: hubs@freebsd.org Subject: Re: Things moving around on ftp://ftp.freebsd.org/pub/FreeBSD References: <17711.860119647@time.cdrom.com> X-Mailer: Mutt 0.58e Mime-Version: 1.0 In-Reply-To: <17711.860119647@time.cdrom.com>; from Jordan K. Hubbard on Apr 3, 1997 18:07:27 -0800 Sender: owner-hubs@freebsd.org X-Loop: FreeBSD.org Precedence: bulk Jordan K. Hubbard writes: > We've overflowed our 1st 4Gb partition there and now need to go to a > 2nd, but that means splitting off some of the bits which were > traditionally confined to one filesystem, and I'm still not sure what > the effects on the mirrors is going to be. If you mirror individual > collections, like pub/FreeBSD/2.1.7.1-RELEASE/, then you should be OK I switched to mirroring single pieces although I have all /pub/FreeBSD in a single (dual drive) 6GB ccd device so it wouldn't affect ftp.de.freebsd.org. (Machine is a AmdK5/133 w 64MB and 128 MB swap). I switched because mirror 2.8 (with perl5.003) *never*, really *never*, finished mirroring the whole tree at once. I suspect it a problem deep in mirror and/or perl. One time I let the mirror process run for 5 days with debug on and it turned out that it needed 5 minutes to decide for the next Get (the actual file transfer time was negeglible). This resulted in a predicted (at 40,000 files to fetch - give some worse case) time of 158 days (theoretically). I was suspecting some 2^n effect in searching or db looking up. Anyway, now breaking it into pieces again seems to get through. So my question here - sorry that I jumped into this thread: Is *anyone* out there mirroring the whole tree in one piece using mirror *and* is using a FreeBSD-x.x.x machine for this? I would be very interested in knowing this. Some sites I know of use big Sun machines and they don't seem to suffer from this problem. > since mirror should follow the symlink. If you're grabbing all Does it? I'm not sure. mirror has a variable: follow_local_symlink='' ( define empty by default) and I'm not sure what this means, local from the view of mirror would be the machine mirror runs on from what I understand. > of pub/FreeBSD, however, what you're going to see afterwards is a link: > 2.1.7.1-RELEASE -> ../../.3/FreeBSD/2.1.7.1-RELEASE Is there a possibility to dump some part of the current FreeBSD tree? Like 2.1.6? > > I'm not quite sure what the "best" work-around for this is, but > I just thought I'd mention it. Sorry folks, but it had to happen > sooner or later - the ports and packages are huge! ;-) > > This doesn't effect users who get their bits from ftp.freebsd.org > directly, of course, only those who mirror it. > > Jordan -- --Chris Christoph P. U. Kukulies kuku@gil.physik.rwth-aachen.de