From owner-freebsd-hubs@FreeBSD.ORG Tue Oct 9 21:29:02 2007 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 733C016A420 for ; Tue, 9 Oct 2007 21:29:02 +0000 (UTC) (envelope-from eric@anholt.net) Received: from vonnegut.anholt.net (69-30-77-85.dq1sn.easystreet.com [69.30.77.85]) by mx1.freebsd.org (Postfix) with ESMTP id 320C613C448 for ; Tue, 9 Oct 2007 21:29:02 +0000 (UTC) (envelope-from eric@anholt.net) Received: from vonnegut.anholt.net (localhost [127.0.0.1]) by vonnegut.anholt.net (8.14.1/8.14.1) with ESMTP id l99Kg6Xx084721 for ; Tue, 9 Oct 2007 13:42:08 -0700 (PDT) (envelope-from eric@anholt.net) Received: (from anholt@localhost) by vonnegut.anholt.net (8.14.1/8.14.1/Submit) id l99Kg5nm084719 for hubs@freebsd.org; Tue, 9 Oct 2007 13:42:05 -0700 (PDT) (envelope-from eric@anholt.net) X-Authentication-Warning: vonnegut.anholt.net: anholt set sender to eric@anholt.net using -f From: Eric Anholt To: hubs@freebsd.org Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-uwFvMkA88MyCXMUMYbyn" Date: Tue, 09 Oct 2007 13:42:04 -0700 Message-Id: <1191962524.84549.6.camel@localhost> Mime-Version: 1.0 X-Mailer: Evolution 2.10.3 FreeBSD GNOME Team Port Cc: Subject: public_distfiles mirroring delay X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2007 21:29:02 -0000 --=-uwFvMkA88MyCXMUMYbyn Content-Type: text/plain Content-Transfer-Encoding: quoted-printable In porting lame but useful software, I often have to roll up my own distfile because upstream doesn't bother ever releasing their code. I stick the distfiles in ~/public_distfiles so it gets the load-distribution love, but it seems that none of the mirrors updates from there very frequently -- I usually end up not getting the file to fetch until the next day. If I commit my port update before it gets distributed, I usually get email complaints from users that day. Would it be possible for a single mirror that is in MASTER_SITE_LOCAL to sync local-distfiles more frequently, so that porters can commit local-distfile ports quicker after rolling them? For reference, MASTER_SITE_LOCAL contains: ftp://ftp.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.se.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.uk.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.ru.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.jp.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.tw.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ ftp://ftp.cn.FreeBSD.org/pub/FreeBSD/ports/local-distfiles/ --=20 Eric Anholt anholt@FreeBSD.org eric@anholt.net eric.anholt@intel.com --=-uwFvMkA88MyCXMUMYbyn Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQBHC+eTHUdvYGzw6vcRAqWyAJsH90OQndm1C8pv3oS64Txp7Bz5rQCgjl1/ xiINHcj5eejzeyFMb7ipsZo= =eQ8H -----END PGP SIGNATURE----- --=-uwFvMkA88MyCXMUMYbyn-- From owner-freebsd-hubs@FreeBSD.ORG Tue Oct 9 21:59:59 2007 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A60A816A417 for ; Tue, 9 Oct 2007 21:59:59 +0000 (UTC) (envelope-from erwin@mail.droso.net) Received: from mail.droso.net (koala.ipv6.droso.net [IPv6:2001:6c8:6:0:206:5bff:fef8:267d]) by mx1.freebsd.org (Postfix) with ESMTP id 2E61313C469 for ; Tue, 9 Oct 2007 21:59:59 +0000 (UTC) (envelope-from erwin@mail.droso.net) Received: by mail.droso.net (Postfix, from userid 1001) id BA39A1CC11; Tue, 9 Oct 2007 23:59:57 +0200 (CEST) Date: Tue, 9 Oct 2007 23:59:57 +0200 From: Erwin Lansing To: freebsd-hubs@freebsd.org Message-ID: <20071009215957.GZ73011@droso.net> Mail-Followup-To: freebsd-hubs@freebsd.org References: <1191962524.84549.6.camel@localhost> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="DWg365Y4B18r8evw" Content-Disposition: inline In-Reply-To: <1191962524.84549.6.camel@localhost> X-Operating-System: FreeBSD/i386 6.2-STABLE User-Agent: Mutt/1.5.16 (2007-06-09) Subject: Re: public_distfiles mirroring delay X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Oct 2007 21:59:59 -0000 --DWg365Y4B18r8evw Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 09, 2007 at 01:42:04PM -0700, Eric Anholt wrote: > In porting lame but useful software, I often have to roll up my own > distfile because upstream doesn't bother ever releasing their code. I > stick the distfiles in ~/public_distfiles so it gets the > load-distribution love, but it seems that none of the mirrors updates > from there very frequently -- I usually end up not getting the file to > fetch until the next day. If I commit my port update before it gets > distributed, I usually get email complaints from users that day. >=20 > Would it be possible for a single mirror that is in MASTER_SITE_LOCAL to > sync local-distfiles more frequently, so that porters can commit > local-distfile ports quicker after rolling them? Given the asynchronous nature of the mirror updates, this is not a trivial issue to solve, and has been on my mind before. There are no less than three steps required before the files show up on an ftp mirror. First, you place the file in public_distfiles on freefall. From there, it has to be replicated to ftp-master(|.us|.eu). Finally, the mirrors have to pick it up from there. For ftp.freebsd.org, I can promise that the last step is done within hours (unless a very large dataset was just uploaded to ftp-master). Unless these files are made available directly =66rom freefall, adding even more traffic load to it, I don't really see that this delay can be brought down even more and will always be several hours. My conclusion so far as been that the best way is to put the file in public_distfiles the day before the commit. Best, -erwin --=20 Erwin Lansing http://droso.org Security is like an onion. (o_ _o) It's made up of several layers \\\_\ /_/// erwin@FreeBSD.org And it makes you cry. <____) (____> erwin@aauug.dk --DWg365Y4B18r8evw Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFHC/ndqy9aWxUlaZARAhtdAJ4watYy1H7ZTr+UHcJwL8xwQZb7nwCg/LB3 gTKp2emiUSTljA4O/93aF30= =xbqW -----END PGP SIGNATURE----- --DWg365Y4B18r8evw-- From owner-freebsd-hubs@FreeBSD.ORG Wed Oct 10 14:52:03 2007 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E000216A419 for ; Wed, 10 Oct 2007 14:52:03 +0000 (UTC) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: from svm.csie.ntu.edu.tw (svm.csie.ntu.edu.tw [140.112.90.75]) by mx1.freebsd.org (Postfix) with ESMTP id 88AE013C48E for ; Wed, 10 Oct 2007 14:52:03 +0000 (UTC) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: from svm.csie.ntu.edu.tw (localhost [127.0.0.1]) by svm.csie.ntu.edu.tw (8.14.1/8.14.1) with ESMTP id l9AEKrHZ026089 for ; Wed, 10 Oct 2007 22:20:53 +0800 (CST) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: (from rafan@localhost) by svm.csie.ntu.edu.tw (8.14.1/8.14.1/Submit) id l9AEKrE3019306 for freebsd-hubs@freebsd.org; Wed, 10 Oct 2007 22:20:53 +0800 (CST) (envelope-from rafan) Date: Wed, 10 Oct 2007 22:20:53 +0800 From: Rong-En Fan To: freebsd-hubs@freebsd.org Message-ID: <20071010142053.GA26962@svm.csie.ntu.edu.tw> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="vtzGhvizbBRQ85DL" Content-Disposition: inline User-Agent: Mutt/1.5.16 (2007-06-09) Subject: can not access ftp-master X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Oct 2007 14:52:04 -0000 --vtzGhvizbBRQ85DL Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, I can not connect to ftp-master since yesterday or so =66rom ftp6.tw.freebsd.org (140.112.8.141). I can see that my ip is still listed in acl. The last hop from=20 traceroute is=20 9 209.131.32.55 131.475 ms 209.131.32.39 131.582 ms 209.131.32.51 132.069 ms Regards, Rong-En Fan --vtzGhvizbBRQ85DL Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHDN/E144QkYb9jGgRAmSlAJwKn6ASbcU8AuZFSn9UK0VUzQStxACfS/O4 yLieUZsjJL77t5KG2NnkOBU= =Y/l2 -----END PGP SIGNATURE----- --vtzGhvizbBRQ85DL-- From owner-freebsd-hubs@FreeBSD.ORG Thu Oct 11 02:57:25 2007 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id EE49016A417 for ; Thu, 11 Oct 2007 02:57:25 +0000 (UTC) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: from svm.csie.ntu.edu.tw (svm.csie.ntu.edu.tw [140.112.90.75]) by mx1.freebsd.org (Postfix) with ESMTP id 8F53D13C478 for ; Thu, 11 Oct 2007 02:57:25 +0000 (UTC) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: from svm.csie.ntu.edu.tw (localhost [127.0.0.1]) by svm.csie.ntu.edu.tw (8.14.1/8.14.1) with ESMTP id l9B2vOBW037398 for ; Thu, 11 Oct 2007 10:57:24 +0800 (CST) (envelope-from rafan@svm.csie.ntu.edu.tw) Received: (from rafan@localhost) by svm.csie.ntu.edu.tw (8.14.1/8.14.1/Submit) id l9B2vOC4007755 for freebsd-hubs@freebsd.org; Thu, 11 Oct 2007 10:57:24 +0800 (CST) (envelope-from rafan) Date: Thu, 11 Oct 2007 10:57:24 +0800 From: Rong-En Fan To: freebsd-hubs@freebsd.org Message-ID: <20071011025724.GA27974@svm.csie.ntu.edu.tw> References: <20071010142053.GA26962@svm.csie.ntu.edu.tw> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="LZvS9be/3tNcYl/X" Content-Disposition: inline In-Reply-To: <20071010142053.GA26962@svm.csie.ntu.edu.tw> User-Agent: Mutt/1.5.16 (2007-06-09) Subject: Re: can not access ftp-master X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2007 02:57:26 -0000 --LZvS9be/3tNcYl/X Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Oct 10, 2007 at 10:20:53PM +0800, Rong-En Fan wrote: > Hi, >=20 > I can not connect to ftp-master since yesterday or so > from ftp6.tw.freebsd.org (140.112.8.141). I can see > that my ip is still listed in acl. The last hop from=20 > traceroute is=20 >=20 > 9 209.131.32.55 131.475 ms > 209.131.32.39 131.582 ms > 209.131.32.51 132.069 ms okay, now I can access ftp-master again. Regards, Rong-En Fan >=20 > Regards, > Rong-En Fan --LZvS9be/3tNcYl/X Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFHDZEU144QkYb9jGgRAi4TAJ42zLOCmYgvb7Ag44cxIREn0nnQZACfX6c5 Ycq44pqmkB8eolsKmFNuCYk= =KtlK -----END PGP SIGNATURE----- --LZvS9be/3tNcYl/X--