Date: Thu, 6 Feb 2014 13:32:20 +1100 From: John Marshall <john.marshall@riverwillow.com.au> To: Peter Wemm <peter@wemm.org> Cc: hubs@freebsd.org Subject: Re: [hubs] cvsup-master changes Message-ID: <20140206023220.GC17736@rwpc15.gfn.riverwillow.net.au> In-Reply-To: <52F288CE.9070805@wemm.org> References: <52F288CE.9070805@wemm.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--p4qYPpj5QlsIQJ0K Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, 05 Feb 2014, 10:54 -0800, Peter Wemm wrote: > In order to tidy up some no-longer-needed complexity with cvsup-master I'= ve > done a final rebuild of the infrastructure supporting it. It's now a self > contained slave of other public data. Thank you for all of your work on this, and thank you for letting us know. I _love_ the CNAME target! > - The source for the www mirror data is now the same rsync pool that is > used on www.freebsd.org. The old cvsup data was being gathered from an > obsolete machine that was only doing a partial build - large chunks were = 1+ > years stale. So now the www mirrors served from www/current replicas are more like real mirrors. Lovely! > - I purged the 1-2 year stale ports and doc trees. I'll upload tarballs = of > the final versions of each onto ftp shortly. I hope you don't get too much backlash from this. All CVSup mirrors and probably all CVSup ports tree users would have "default delete" in their supfiles. So, by deleting the ports tree on cvsup-master, you have replicated the tree deletion out to the world: their (very stale) ports trees would have been replaced with your README.ports file. It looks like this was your intention but it might come as a bit of a shock to some. Did you consider the option of removing the ports-all collection directory? Would you consider doing that anyway? That way the sup client will see, 'Server message: Unknown collection "ports-all"' without having its very own copy of the stale CVS ports tree deleted. In any case, I suggest that some folks might find it helpful to find an announcement on ports-announce@ and/or ports@ to the effect that the ports collection has been removed from the CVSup servers. > After looking at the machine's logs, I'm wondering how much this stuff is > being used by end users relative to the number of mirrors still in > operation. I suspect it is really difficult to tell the difference betwe= en > somebody who's actually using the code from cvsup vs somebody who set up a > mirror years ago and forgot about it. Given that 25% of our server's daily synchronization requests are for the ports-all collection, I would suggest that many of the sync's. fall into the "set and forgot" category. > There's a public cvsup machine in the cluster (cvsup14.nyi) that appears = to > be desperately bored lately. It implements 12 of the cvsupN aliases and > seems to be doing about 50 client connections per hour. Is this comparab= le > with what other folks are seeing? We saw a 60% reduction in CVSup traffic early last year when svn exports to the CVS ports tree ceased. With the current, release and stable src branches, ports, doc and gnats no longer being updated via CVSup, I would guess that the majority of what's left is "set and forgot", apart =66rom some actual users of the mail-archive/current and www/current collections - and some of those may be "set and forgot" too. The bulk of our remaining CVSup traffic is attributable to about half a dozen downstream private mirrors (some of which are telco, ISP and government - I have no knowledge of the degree of usage made downstream of any of those). Here are some real numbers from the past 9 months. The graphs start a couple of months after the 60% drop-off. The 10GB/day spikes are now ancient history. This server takes all traffic for cvsup.au and cvsup[2-7].au and is the only FreeBSD CVSup mirror in the South Pacific/Australasian region. http://cvsup3.au.freebsd.org/stats.html As far as I know, there is still no official svn mirror available this side of the Pacific, so most of our former CVSup clients have probably switched to svn and using svn0.us-west (~200ms away). --=20 John Marshall --p4qYPpj5QlsIQJ0K Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iEYEARECAAYFAlLy9DQACgkQw/tAaKKahKJ8pgCgjqRqAX01Tp9b+/fDagQ2nVn9 4kwAnRj2hwM1pciCe1AkOUnI7EJ9EYTF =tQSH -----END PGP SIGNATURE----- --p4qYPpj5QlsIQJ0K--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20140206023220.GC17736>