Date: Thu, 18 Jul 2013 12:45:42 -0700 From: Peter Wemm <peter@wemm.org> To: freebsd-hubs@freebsd.org Subject: ftp mirror Message-ID: <CAGE5yCoAn4c72R5OxRjMySfSSCvZ5JBUiBHLOhk9OiVhsM3ppw@mail.gmail.com>
next in thread | raw e-mail | index | archive | help
ftp-master: du -sh FreeBSD 914G FreeBSD There was a lot of stuff that was painful to rsync, eg: all the checked out branches, via cvs, cvsup etc. But that's mostly gone now. (If there's more that really needs to go, please say something) Most mirrors are syncing it as a unit, eg from the last 10 days logs: 544 rsync on FreeBSD/ 112 rsync on FreeBSD/ports/ 77 rsync on FreeBSD/releases/ 28 rsync on FreeBSD/snapshots/VM-IMAGES 28 rsync on FreeBSD/releases/i386 28 rsync on FreeBSD/releases/amd64 28 rsync on FreeBSD/ports/local-distfiles 28 rsync on FreeBSD/ports/i386/packages-9-stable 28 rsync on FreeBSD/ports/i386 28 rsync on FreeBSD/ports/amd64 27 rsync on FreeBSD/ports/amd64/packages-9-stable 26 rsync on FreeBSD/releases/sparc64/ISO-IMAGES 26 rsync on FreeBSD/releases/powerpc/ISO-IMAGES 26 rsync on FreeBSD/releases/pc98/ISO-IMAGES 26 rsync on FreeBSD/ports/i386/packages-8-stable 25 rsync on FreeBSD/releases/ia64/ISO-IMAGES 25 rsync on FreeBSD/ports/amd64/packages-8-stable 24 rsync on FreeBSD/development/ 22 rsync on FreeBSD/ports/distfiles/ 21 rsync on FreeBSD/CERT/ 16 rsync on FreeBSD/snapshots/ 14 rsync on FreeBSD/doc/ 14 rsync on FreeBSD/branches/ 11 rsync on FreeBSD/updates/ 11 rsync on FreeBSD/tools/ 8 rsync on FreeBSD/ports/local-distfiles/ 5 rsync on FreeBSD/releases/amd64/ 5 rsync on FreeBSD/ports/i386/packages-9-stable/ 4 rsync on FreeBSD/releases/i386/ 4 rsync on FreeBSD/ports/i386/packages-8-stable/ 3 rsync on FreeBSD/releases/powerpc/ 3 rsync on FreeBSD/releases/pc98/ 3 rsync on FreeBSD/ports/amd64/packages-9-stable/ 2 rsync on FreeBSD/releases/sparc64/ 2 rsync on FreeBSD/releases/ISO-IMAGES/8.4/ 2 rsync on FreeBSD/releases/ISO-IMAGES/ 2 rsync on FreeBSD/ports/amd64/packages-8-stable/ 1 rsync on FreeBSD/releases/ia64/ 1 rsync on FreeBSD/ports/i386/ 1 rsync on FreeBSD/ports/amd64/ There are some really weird outliers.. eg: some mirrors are fetching 95%+ of the content by carefully stepping around the old cvs / cvsup checkouts that have been gone for 8+ months. eg: internat.freebsd.org nephtys.lip6.fr ftp.gamma.ru freebsd.twaren.net It looks like most of those should be just syncing the entire tree. Please, make sure: running rsync-3.0+, the later the better make sure to use at least the rsync -a and -H (preserve hard links) flags use FreeBSD/ (or FreeBSD-master/) as a unit We are looking at the TIMESTAMP files in various places, including the *root of the archive*, to try and get a handle on staleness of mirrors. -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV UTF-8: So you can \342\200\231 .. for when a ' just won't do <brueffer> ZFS must be the bacon of file systems. "everything's better with ZFS"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGE5yCoAn4c72R5OxRjMySfSSCvZ5JBUiBHLOhk9OiVhsM3ppw>