From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 4 17:58:40 2014 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8803DB4E for ; Tue, 4 Feb 2014 17:58:40 +0000 (UTC) Received: from neptune.request.cz (porthos.dkm.cz [IPv6:2a02:8301:0:1::71]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 4650117A9 for ; Tue, 4 Feb 2014 17:58:39 +0000 (UTC) Received: from FatFox-2.local (unknown [192.168.49.6]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: fox@murder.cz) by neptune.request.cz (Postfix) with ESMTPSA id 87769D3E for ; Tue, 4 Feb 2014 18:58:37 +0100 (CET) Message-ID: <52F12A4C.5000403@zvala.cz> Date: Tue, 04 Feb 2014 18:58:36 +0100 From: Tomas Zvala User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: freebsd-hubs@freebsd.org Subject: distfiles stale? Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.17 X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Feb 2014 17:58:40 -0000 Hello hubs, I've just noticed, that distfiles directory (which I quite liked) got stale on 16-Sep-2013 20:15 on master and all mirrors. Is that intentional, or something worth fixing? Can't seem to find any information on this feature being discontinued. Thanks, Tomas From owner-freebsd-hubs@FreeBSD.ORG Wed Feb 5 04:26:31 2014 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ADC342F8 for ; Wed, 5 Feb 2014 04:26:31 +0000 (UTC) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 650D61A95 for ; Wed, 5 Feb 2014 04:26:31 +0000 (UTC) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.14.7/8.14.7) with ESMTP id s154QSVN004129; Tue, 4 Feb 2014 23:26:28 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.14.7/8.14.4/Submit) id s154QRVC004126; Tue, 4 Feb 2014 23:26:27 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <21233.48499.310809.81557@hergotha.csail.mit.edu> Date: Tue, 4 Feb 2014 23:26:27 -0500 From: Garrett Wollman To: Tomas Zvala Subject: UNS: distfiles stale? In-Reply-To: <52F12A4C.5000403@zvala.cz> References: <52F12A4C.5000403@zvala.cz> X-Mailer: VM 7.17 under 21.4 (patch 22) "Instant Classic" XEmacs Lucid X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (hergotha.csail.mit.edu [127.0.0.1]); Tue, 04 Feb 2014 23:26:28 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=disabled version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hergotha.csail.mit.edu Cc: freebsd-hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Feb 2014 04:26:31 -0000 < said: > I've just noticed, that distfiles directory (which I quite liked) got > stale on 16-Sep-2013 20:15 on master and all mirrors. Is that > intentional, or something worth fixing? Can't seem to find any > information on this feature being discontinued. It *has* to be fixed for GPL compliance. -GAWollman From owner-freebsd-hubs@FreeBSD.ORG Wed Feb 5 18:54:15 2014 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7249C4CF for ; Wed, 5 Feb 2014 18:54:15 +0000 (UTC) Received: from mail-pd0-x22e.google.com (mail-pd0-x22e.google.com [IPv6:2607:f8b0:400e:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 3CE9D1B2C for ; Wed, 5 Feb 2014 18:54:14 +0000 (UTC) Received: by mail-pd0-f174.google.com with SMTP id z10so709741pdj.33 for ; Wed, 05 Feb 2014 10:54:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wemm.org; s=google; h=message-id:date:from:user-agent:mime-version:to:subject :content-type; bh=K+LNN8yElBwdXKJY/f9LEiSDx3quQyv606xrUrRZ6zM=; b=IDCcwxTyuPU8EkEsON4u/Bgs4dMLDpqYTW73QeR1VK35tBaK/bncT/zXxKzfwgOhFY BmcTsNf5Dswf8jR2eZzuEUwS5RRgjppvUMotV7UfEY5XIS52QF1ja8TiXRFNxYyWv4Hh l5Mr2GCOlQe9pQBwCV4Om3kB5x4Tp4zh2PWi4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :subject:content-type; bh=K+LNN8yElBwdXKJY/f9LEiSDx3quQyv606xrUrRZ6zM=; b=aqo4xFGu9iwuRaDUfT9B6YR0xx1KNld0SxF7RnYG7VBgdOs1VNAgjFs7hJIkJ3cNxN RdUBZd0W1CXYlFDIQkKfizr7O2NeVJGf223J3TaZkvTVPqBKTiJgpmYcgxkhBSOcvdUQ a2sOOIKs8GvlyD6MOPZHmUHJcQzwq1zNnU+vxEKOdfwEAqq+T05q8n/gnZm4JCXLmP21 4BC4C7pU/LdB1ZieGld6XLQrrr0itmrenoo17Z8QvPsBa63BR+fwmn8geDxrBH5NOaLi 6xkDBSD9ZvTaSD1qGr5mZVo57xiZK1D75G/XdYI0eHehbETSPx9ITKVMAk7VgSZkdUu6 AElg== X-Gm-Message-State: ALoCoQkyThiHZ+WA2T2hLqLQXYCfNmHXilQuGI4KAhr/qw7dlLU0iWZ/tNB4WjqCwP5RWc11guNL X-Received: by 10.68.189.198 with SMTP id gk6mr4353399pbc.146.1391626453958; Wed, 05 Feb 2014 10:54:13 -0800 (PST) Received: from hater-dm.corp.yahoo.com (nat-dip4.cfw-a-gci.corp.yahoo.com. [209.131.62.113]) by mx.google.com with ESMTPSA id un5sm201866727pab.3.2014.02.05.10.54.12 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 05 Feb 2014 10:54:12 -0800 (PST) Message-ID: <52F288CE.9070805@wemm.org> Date: Wed, 05 Feb 2014 10:54:06 -0800 From: Peter Wemm User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: hubs@freebsd.org Subject: [hubs] cvsup-master changes X-Enigmail-Version: 1.6 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="l84S9eCTKdPXj7o1r63FkQEL2LOb4etSs" X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Feb 2014 18:54:15 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --l84S9eCTKdPXj7o1r63FkQEL2LOb4etSs Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable In order to tidy up some no-longer-needed complexity with cvsup-master I'= ve done a final rebuild of the infrastructure supporting it. It's now a sel= f contained slave of other public data. There's a couple of visible effects with this. - Latency is actually a little better for some collections, but worse for= others. - The source for the www mirror data is now the same rsync pool that is used on www.freebsd.org. The old cvsup data was being gathered from an obsolete machine that was only doing a partial build - large chunks were = 1+ years stale. - Timestamps on a number of files changed and that's caused a lot of internal one-time Rsync fixups. cvsup/cvsupd doesn't seem to deal with th= is very gracefully. - I purged the 1-2 year stale ports and doc trees. I'll upload tarballs = of the final versions of each onto ftp shortly. As a reminder, 9.2, 10.x and HEAD are NOT in cvs. 8-stable, 9-stable are still being periodically updated but there's no more _RELEASE tags after = 9.1. After looking at the machine's logs, I'm wondering how much this stuff is= being used by end users relative to the number of mirrors still in operation. I suspect it is really difficult to tell the difference betwe= en somebody who's actually using the code from cvsup vs somebody who set up = a mirror years ago and forgot about it. There's a public cvsup machine in the cluster (cvsup14.nyi) that appears = to be desperately bored lately. It implements 12 of the cvsupN aliases and seems to be doing about 50 client connections per hour. Is this comparab= le with what other folks are seeing? I don't have enough history in its logs, but I'm guessing there was a fairly big dropoff once ports stopped being in cvs and when we fully switched to svn based releases. I'd appreciate it if folks could turn a critical eye towards their cvsup mirror logs and see if they can get a feel for how much this is still bei= ng used. If it is the time to consolidate, we have plenty of headroom. --=20 Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6F= JV UTF-8: for when a ' just won\342\200\231t do. --l84S9eCTKdPXj7o1r63FkQEL2LOb4etSs Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.13 (Darwin) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iEYEARECAAYFAlLyiNMACgkQFRKuUnJ3cX+tDgCaAtrD0b5zeQRBwXrqZk9nsyKN /C0AoILJ4BGWUGLWkSbB+nG6PG9pdAWT =oD96 -----END PGP SIGNATURE----- --l84S9eCTKdPXj7o1r63FkQEL2LOb4etSs-- From owner-freebsd-hubs@FreeBSD.ORG Wed Feb 5 19:02:35 2014 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E25236DC for ; Wed, 5 Feb 2014 19:02:35 +0000 (UTC) Received: from hergotha.csail.mit.edu (wollman-1-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 97D191C14 for ; Wed, 5 Feb 2014 19:02:35 +0000 (UTC) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.14.7/8.14.7) with ESMTP id s15J2W1t013320; Wed, 5 Feb 2014 14:02:32 -0500 (EST) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.14.7/8.14.4/Submit) id s15J2WRq013317; Wed, 5 Feb 2014 14:02:32 -0500 (EST) (envelope-from wollman) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <21234.35528.766291.918377@hergotha.csail.mit.edu> Date: Wed, 5 Feb 2014 14:02:32 -0500 From: Garrett Wollman To: Peter Wemm Subject: [hubs] cvsup-master changes In-Reply-To: <52F288CE.9070805@wemm.org> References: <52F288CE.9070805@wemm.org> X-Mailer: VM 7.17 under 21.4 (patch 22) "Instant Classic" XEmacs Lucid X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (hergotha.csail.mit.edu [127.0.0.1]); Wed, 05 Feb 2014 14:02:32 -0500 (EST) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=disabled version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on hergotha.csail.mit.edu Cc: hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Feb 2014 19:02:35 -0000 < said: > I'd appreciate it if folks could turn a critical eye towards their cvsup > mirror logs and see if they can get a feel for how much this is still being > used. If it is the time to consolidate, we have plenty of headroom. As previously announced, I turned off cvsup services on xyz.csail.mit.edu last week. However, cvsup3.freebsd.org still points to it. -GAWollman From owner-freebsd-hubs@FreeBSD.ORG Wed Feb 5 19:20:38 2014 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0B39AA92 for ; Wed, 5 Feb 2014 19:20:38 +0000 (UTC) Received: from mail-pb0-x231.google.com (mail-pb0-x231.google.com [IPv6:2607:f8b0:400e:c01::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id C94AE1DA0 for ; Wed, 5 Feb 2014 19:20:37 +0000 (UTC) Received: by mail-pb0-f49.google.com with SMTP id up15so750405pbc.8 for ; Wed, 05 Feb 2014 11:20:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wemm.org; s=google; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=zwgoyUqqC8hYAzhCZ7NAi57NVwGrh1A1KMtEVEW/Z4o=; b=zY4ynJHCCFP7xdCVhT3SP2Dr4hlalAqfjaG4l0etGPJXil8ws4axcjKWi+ZcpNhzZi pM8wKvob0OwKOsma8RQVMnSVARYEQ4DAY37YywK0971r6dFqrQrOvUi7cWv0Z5zHXIqJ nDSAlTPKjpEZfmhv0L+z2JUIw9SDjO/QPI0a4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=zwgoyUqqC8hYAzhCZ7NAi57NVwGrh1A1KMtEVEW/Z4o=; b=CF0DKjY+hMJtnIFZCOUaFyljp7L7fAwMlckmQsBcL1In2EYG574YPKTPv6yDOa7wkx puyZpE7a8iTH2w2uXhx5/A8lchYA5Siu/KulyA26TGDUA96edNnaFQhAecN2Zxs56GeI TXOlx1ZN7qp6ma4ktgQoVSXKjkD3ieykjaD5pBXEGym7CUur1s/OkckRIgu4PJZaFXli 6hQODm32wdmUPVaowMK9AZQZu6owryV+5TI2nsg5fp5ZK9/c2yezzG1kH3DTMXivkSLJ WLhfNbd60943MNjW8+FEHbOYLq1YY3zMk19H8vgKe2JMtVakCj6jM4ysnBSG7TRgA8g/ QM+g== X-Gm-Message-State: ALoCoQmTEYx/FZIfww+u9Qo7wzQFQadMGUdZ7L7NnsyhaTWVOJIlC8zLp9RNOCH5iaIPmlUyF5xO X-Received: by 10.68.133.193 with SMTP id pe1mr4616665pbb.56.1391628037473; Wed, 05 Feb 2014 11:20:37 -0800 (PST) Received: from hater-dm.corp.yahoo.com (nat-dip4.cfw-a-gci.corp.yahoo.com. [209.131.62.113]) by mx.google.com with ESMTPSA id jk16sm79222902pbb.34.2014.02.05.11.20.36 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 05 Feb 2014 11:20:36 -0800 (PST) Message-ID: <52F28F03.5030205@wemm.org> Date: Wed, 05 Feb 2014 11:20:35 -0800 From: Peter Wemm User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.9; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Garrett Wollman Subject: Re: [hubs] cvsup-master changes References: <52F288CE.9070805@wemm.org> <21234.35528.766291.918377@hergotha.csail.mit.edu> In-Reply-To: <21234.35528.766291.918377@hergotha.csail.mit.edu> X-Enigmail-Version: 1.6 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Feb 2014 19:20:38 -0000 On 2/5/14, 11:02 AM, Garrett Wollman wrote: > < said: > >> I'd appreciate it if folks could turn a critical eye towards their cvsup >> mirror logs and see if they can get a feel for how much this is still being >> used. If it is the time to consolidate, we have plenty of headroom. > > As previously announced, I turned off cvsup services on > xyz.csail.mit.edu last week. However, cvsup3.freebsd.org still points > to it. > > -GAWollman > Fixed, thanks. -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV UTF-8: for when a ' just won\342\200\231t do. From owner-freebsd-hubs@FreeBSD.ORG Thu Feb 6 02:32:45 2014 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0D9A632D for ; Thu, 6 Feb 2014 02:32:45 +0000 (UTC) Received: from mail1.riverwillow.net.au (mail1.riverwillow.net.au [IPv6:2001:8000:1000:1801::36]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 5C25D1600 for ; Thu, 6 Feb 2014 02:32:38 +0000 (UTC) Received: from rwpc15.gfn.riverwillow.net.au (rwpc15.gfn.riverwillow.net.au [IPv6:2001:8000:1000:18e1:20c:76ff:fe0a:2117]) (authenticated bits=56) by mail1.riverwillow.net.au (8.14.8/8.14.8) with ESMTP id s162WKVF032092 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Thu, 6 Feb 2014 13:32:25 +1100 (AEDT) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=riverwillow.com.au; s=m1001; t=1391653945; bh=UL3mSE63TN9VHlmRrl550pc0BLobCXxwbXMviPjFpd4=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=Z0aRT0IHcDkPYwT8AVAwS0/dwNMG1LhiugUYkrBKko/lmKBowEKPVDpsgupXvUf9z aHxpZViVjT4KuiD2Kbo/ksbH2OeFJeL3xPcPhvMKW0kbVjwk1qZXikWKY1Kams++OT tUXexHT8XlSEW2rf2oH0BOCvqX4dl8Z/hm8BXVVU= Date: Thu, 6 Feb 2014 13:32:20 +1100 From: John Marshall To: Peter Wemm Subject: Re: [hubs] cvsup-master changes Message-ID: <20140206023220.GC17736@rwpc15.gfn.riverwillow.net.au> References: <52F288CE.9070805@wemm.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="p4qYPpj5QlsIQJ0K" Content-Disposition: inline In-Reply-To: <52F288CE.9070805@wemm.org> OpenPGP: id=A29A84A2; url=http://pki.riverwillow.com.au/pgp/johnmarshall.asc User-Agent: Mutt/1.5.22 (2013-10-16) Cc: hubs@freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Feb 2014 02:32:45 -0000 --p4qYPpj5QlsIQJ0K Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, 05 Feb 2014, 10:54 -0800, Peter Wemm wrote: > In order to tidy up some no-longer-needed complexity with cvsup-master I'= ve > done a final rebuild of the infrastructure supporting it. It's now a self > contained slave of other public data. Thank you for all of your work on this, and thank you for letting us know. I _love_ the CNAME target! > - The source for the www mirror data is now the same rsync pool that is > used on www.freebsd.org. The old cvsup data was being gathered from an > obsolete machine that was only doing a partial build - large chunks were = 1+ > years stale. So now the www mirrors served from www/current replicas are more like real mirrors. Lovely! > - I purged the 1-2 year stale ports and doc trees. I'll upload tarballs = of > the final versions of each onto ftp shortly. I hope you don't get too much backlash from this. All CVSup mirrors and probably all CVSup ports tree users would have "default delete" in their supfiles. So, by deleting the ports tree on cvsup-master, you have replicated the tree deletion out to the world: their (very stale) ports trees would have been replaced with your README.ports file. It looks like this was your intention but it might come as a bit of a shock to some. Did you consider the option of removing the ports-all collection directory? Would you consider doing that anyway? That way the sup client will see, 'Server message: Unknown collection "ports-all"' without having its very own copy of the stale CVS ports tree deleted. In any case, I suggest that some folks might find it helpful to find an announcement on ports-announce@ and/or ports@ to the effect that the ports collection has been removed from the CVSup servers. > After looking at the machine's logs, I'm wondering how much this stuff is > being used by end users relative to the number of mirrors still in > operation. I suspect it is really difficult to tell the difference betwe= en > somebody who's actually using the code from cvsup vs somebody who set up a > mirror years ago and forgot about it. Given that 25% of our server's daily synchronization requests are for the ports-all collection, I would suggest that many of the sync's. fall into the "set and forgot" category. > There's a public cvsup machine in the cluster (cvsup14.nyi) that appears = to > be desperately bored lately. It implements 12 of the cvsupN aliases and > seems to be doing about 50 client connections per hour. Is this comparab= le > with what other folks are seeing? We saw a 60% reduction in CVSup traffic early last year when svn exports to the CVS ports tree ceased. With the current, release and stable src branches, ports, doc and gnats no longer being updated via CVSup, I would guess that the majority of what's left is "set and forgot", apart =66rom some actual users of the mail-archive/current and www/current collections - and some of those may be "set and forgot" too. The bulk of our remaining CVSup traffic is attributable to about half a dozen downstream private mirrors (some of which are telco, ISP and government - I have no knowledge of the degree of usage made downstream of any of those). Here are some real numbers from the past 9 months. The graphs start a couple of months after the 60% drop-off. The 10GB/day spikes are now ancient history. This server takes all traffic for cvsup.au and cvsup[2-7].au and is the only FreeBSD CVSup mirror in the South Pacific/Australasian region. http://cvsup3.au.freebsd.org/stats.html As far as I know, there is still no official svn mirror available this side of the Pacific, so most of our former CVSup clients have probably switched to svn and using svn0.us-west (~200ms away). --=20 John Marshall --p4qYPpj5QlsIQJ0K Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iEYEARECAAYFAlLy9DQACgkQw/tAaKKahKJ8pgCgjqRqAX01Tp9b+/fDagQ2nVn9 4kwAnRj2hwM1pciCe1AkOUnI7EJ9EYTF =tQSH -----END PGP SIGNATURE----- --p4qYPpj5QlsIQJ0K--