From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 12:27:26 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 92E5637B401 for ; Sun, 27 Jul 2003 12:27:26 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id E14F943F85 for ; Sun, 27 Jul 2003 12:27:25 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6RJRPbr011204 for ; Sun, 27 Jul 2003 15:27:25 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6RJRPl6011203 for freebsd-hubs@freebsd.org; Sun, 27 Jul 2003 15:27:25 -0400 (EDT) Date: Sun, 27 Jul 2003 15:27:24 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030727192724.GA10869@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 19:27:27 -0000 I think this reflects our latest thoughts. If I missed let me know. Note the distinction between Primary and Secondary doesn't really have any "functional" meaning - it is just to help provide users with an indication that a site *might* not have what they're looking for in the case of a site being Secondary. Beta testers should also be able to use the list of Primaries as a guide to where they're likely to find the pre-release builds sooner versus later (or not at all). We can work a bit on fine tuning what's available where later (see comment at the bottom). Mirror Site Categories ---------------------- - Distribution Site: ftp-master* site, ftp-master itself plus a set of other machines that sync frequently from ftp-master and allow only Official Mirror Sites to connect to them. - Primary Mirror Site: Sync at least once a day from a Distribution Site, carry everything currently on ftp-master. - Secondary Mirror Site: Does not carry everything on ftp-master, and/or syncs from a Primary Mirror Site (thus getting stuff slower). Which category a Mirror Site fits in will be indicated on the Web page listing the FTP mirrors, and that page will include a description of what "Primary" versus "Secondary" means. End-users don't need to know anything about the Distribution Servers so they won't be mentioned in the Handbook but will be described in the hubs article. Requirements of all Mirror Sites -------------------------------- 1) Different user for sync jobs than anonymous FTP (and, if HTTP access is available, httpd). 2) Mechanism used for sync preserves (and can change later) file permissions. 3) Site Admin on mirror-announce@ list (still being created, not ready yet). This will be a private (Official Mirrors only) list used only for announcements by mirror-admin@ and re@. hubs@ will remain an open discussion list. 4) Directory archive sits in is /pub/FreeBSD. Requirements for Primary Mirror Sites ------------------------------------- 1) Carries everything currently on ftp-master (note that is changing, we hope to drop the branches/ stuff). 2) Syncs with a Distribution Site at least once a day, preferrably twice a day. 3) Optionally provides access to other Official Mirror Sites through a secure mechanism (only allowing Official Mirror Sites to download "staged" releases). This typically means running a special cvsupd or rsyncd with access restrictions. Must check with mirror-admin@ before granting this sort of access to confirm the requesting site is an Official Mirror Site. 4) Site Admin on hubs@ in addition to mirror-announce@. 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate for becoming a "ftpX.freebsd.org" hostname. Requirements for Secondary Mirror Sites --------------------------------------- 1) Simply carry all files needed for latest Production Release, which includes the packages for that release. Note this means the packages in the -release directory for this release, not necessarily the package set that gets built on a roughly weekly basis. Using FreeBSD 4.8 for the i386 architecture as an example this means carrying: releases/i386/4.8-RELEASE/ releases/i386/ISO-IMAGES/4.8/ ports/i386/packages-4.8-release/ 2) Syncs at least once a day from a Distribution Site or a Primary Mirror Site. 3) Will be given a "ftpX.CC.freebsd.org" name. Misc. Comments -------------- The http://www.freebsdmirrors.org/ site was mentioned. We're talking to the person who developed it now. I had noticed its accuracy varies quite a bit over time. The way he collects the data relies on noticing NS records and doing zone transfers which will break for zones we handle centrally (e.g. the new us.freebsd.org zone :-/) and typically DNS Admins are beginning to limit zone transfers as a security precaution. IMO it's a good idea but needs some re-working because of this issue along with the extra architectures now (it only handles i386/alpha). We're not sure if he's interested in mucking with it at this point. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 12:53:55 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5986F37B401 for ; Sun, 27 Jul 2003 12:53:55 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9562943F85 for ; Sun, 27 Jul 2003 12:53:54 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6RJrsbr011515 for ; Sun, 27 Jul 2003 15:53:54 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6RJrrjT011514 for freebsd-hubs@freebsd.org; Sun, 27 Jul 2003 15:53:53 -0400 (EDT) Date: Sun, 27 Jul 2003 15:53:53 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030727195353.GA11351@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: us.freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 19:53:55 -0000 Just FYI. The us.freebsd.org zone is functional now. The two WWW Mirror Sites listed as USA (both are IPV6 as well as IPV4) are set up in that zone. Early this week we'll submit the request to copy the set of ftpX.freebsd.org sites that are in the USA into the us.freebsd.org zone, keeping the same name (e.g. ftp5.freebsd.org will be keep that name, and will also become ftp5.us.freebsd.org). We also have a new zone (hr.freebsd.org) functioning in the "non-delegated" mode. So a fair chunk of what got proposed for the DNS support is moving into place. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:06:45 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3D66C37B401 for ; Sun, 27 Jul 2003 13:06:45 -0700 (PDT) Received: from arthur.nitro.dk (port324.ds1-khk.adsl.cybercity.dk [212.242.113.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9407A43F85 for ; Sun, 27 Jul 2003 13:06:44 -0700 (PDT) (envelope-from simon@arthur.nitro.dk) Received: by arthur.nitro.dk (Postfix, from userid 1000) id 8D71810BFA8; Sun, 27 Jul 2003 22:06:42 +0200 (CEST) Date: Sun, 27 Jul 2003 22:06:42 +0200 From: "Simon L. Nielsen" To: Ken Smith Message-ID: <20030727200640.GA387@FreeBSD.org> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="1yeeQ81UyVL57Vl7" Content-Disposition: inline In-Reply-To: <20030727192724.GA10869@electra.cse.Buffalo.EDU> User-Agent: Mutt/1.5.4i cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:06:45 -0000 --1yeeQ81UyVL57Vl7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2003.07.27 15:27:24 -0400, Ken Smith wrote: > Requirements of all Mirror Sites > -------------------------------- >=20 [CUT] > 4) Directory archive sits in is /pub/FreeBSD. At least ftp9.freebsd.org doesn't do this... Is it that important, since the FreeBSD mirror directory is mentioned in the Handbook? I can see the benefit for users from having all mirrors having the /pub/FreeBSD directory, but some large mirrors might like to subdivide their mirrors and it would be a shame to disqualify them on this reason alone. Other than that I think the document is really good. Good work! Just my 0.02c. --=20 Simon L. Nielsen FreeBSD Documentation Project New PGP key 0x27359A51 Fingerprint: 912B F341 7E90 2049 05B4 3800 87DA 5C0D 2735 9A51 --1yeeQ81UyVL57Vl7 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (FreeBSD) iD8DBQE/JDDQh9pcDSc1mlERAvODAJ41CiLVFe4Fe8BaeRDKRQI+mSG7QQCeImof ZYl4YPTIt7C2nG0Ef2RJQws= =YGYf -----END PGP SIGNATURE----- --1yeeQ81UyVL57Vl7-- From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:08:33 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5C1CB37B401 for ; Sun, 27 Jul 2003 13:08:33 -0700 (PDT) Received: from itaqui.terra.com.br (itaqui.terra.com.br [200.176.3.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 05D3543F3F for ; Sun, 27 Jul 2003 13:08:32 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from tucuriba.terra.com.br (tucuriba.terra.com.br [200.176.3.53]) by itaqui.terra.com.br (Postfix) with ESMTP id 7123B81041B; Sun, 27 Jul 2003 17:08:30 -0300 (BRT) Received: from jonny.eng.br (unknown [200.165.170.243]) (authenticated user dioni21) by tucuriba.terra.com.br (Postfix) with ESMTP id 66A4F2641D8; Sun, 27 Jul 2003 17:08:28 -0300 (BRT) Message-ID: <3F24313F.7040109@jonny.eng.br> Date: Sun, 27 Jul 2003 17:08:31 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Ken Smith References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> In-Reply-To: <20030727192724.GA10869@electra.cse.Buffalo.EDU> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:08:33 -0000 Ken Smith wrote: > I think this reflects our latest thoughts. If I missed let me know. Note > the distinction between Primary and Secondary doesn't really have any > "functional" meaning - it is just to help provide users with an indication > that a site *might* not have what they're looking for in the case of > a site being Secondary. Beta testers should also be able to use the > list of Primaries as a guide to where they're likely to find the pre-release > builds sooner versus later (or not at all). We can work a bit on fine > tuning what's available where later (see comment at the bottom). > > Mirror Site Categories > ---------------------- > > - Distribution Site: ftp-master* site, ftp-master itself plus a set > of other machines that sync frequently from ftp-master and allow > only Official Mirror Sites to connect to them. > > - Primary Mirror Site: Sync at least once a day from a Distribution > Site, carry everything currently on ftp-master. > > - Secondary Mirror Site: Does not carry everything on ftp-master, > and/or syncs from a Primary Mirror Site (thus getting stuff slower). > > Which category a Mirror Site fits in will be indicated on the Web page > listing the FTP mirrors, and that page will include a description of what > "Primary" versus "Secondary" means. End-users don't need to know anything > about the Distribution Servers so they won't be mentioned in the Handbook > but will be described in the hubs article. > > > Requirements of all Mirror Sites > -------------------------------- > > 1) Different user for sync jobs than anonymous FTP (and, if HTTP > access is available, httpd). > 2) Mechanism used for sync preserves (and can change later) file > permissions. > 3) Site Admin on mirror-announce@ list (still being created, not ready > yet). This will be a private (Official Mirrors only) list used only > for announcements by mirror-admin@ and re@. hubs@ will remain an > open discussion list. > 4) Directory archive sits in is /pub/FreeBSD. > > Requirements for Primary Mirror Sites > ------------------------------------- > > 1) Carries everything currently on ftp-master (note that is changing, we > hope to drop the branches/ stuff). > 2) Syncs with a Distribution Site at least once a day, preferrably twice > a day. > 3) Optionally provides access to other Official Mirror Sites through a > secure mechanism (only allowing Official Mirror Sites to download > "staged" releases). This typically means running a special cvsupd > or rsyncd with access restrictions. Must check with mirror-admin@ > before granting this sort of access to confirm the requesting site > is an Official Mirror Site. > 4) Site Admin on hubs@ in addition to mirror-announce@. > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > for becoming a "ftpX.freebsd.org" hostname. > > Requirements for Secondary Mirror Sites > --------------------------------------- > > 1) Simply carry all files needed for latest Production Release, which > includes the packages for that release. Note this means the packages > in the -release directory for this release, not necessarily the package > set that gets built on a roughly weekly basis. Using FreeBSD 4.8 > for the i386 architecture as an example this means carrying: > > releases/i386/4.8-RELEASE/ > releases/i386/ISO-IMAGES/4.8/ > ports/i386/packages-4.8-release/ > > 2) Syncs at least once a day from a Distribution Site or a Primary Mirror > Site. > 3) Will be given a "ftpX.CC.freebsd.org" name. Did you forgot the part about possibly not carrying all architectures, or is it intentional? And isn't once a day too much for something that generally do not changes after beeing released? Also, did you mean to put and end to ftp.CC.freebsd.org? Or maybe turning it into a Round Robin of the other ftpX.CC.freebsd.org sites? Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:18:20 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 19E7737B401 for ; Sun, 27 Jul 2003 13:18:18 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id A1DFA43FB1 for ; Sun, 27 Jul 2003 13:18:17 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6RKIFbr011818; Sun, 27 Jul 2003 16:18:15 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6RKIFS0011816; Sun, 27 Jul 2003 16:18:15 -0400 (EDT) Date: Sun, 27 Jul 2003 16:18:15 -0400 From: Ken Smith To: =?unknown-8bit?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= Message-ID: <20030727201815.GB11351@electra.cse.Buffalo.EDU> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <3F24313F.7040109@jonny.eng.br> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F24313F.7040109@jonny.eng.br> User-Agent: Mutt/1.4.1i cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:18:20 -0000 On Sun, Jul 27, 2003 at 05:08:31PM -0300, Joo Carlos Mendes Lus wrote: > >Requirements for Secondary Mirror Sites > >--------------------------------------- > > > >1) Simply carry all files needed for latest Production Release, which > > includes the packages for that release. Note this means the packages > > in the -release directory for this release, not necessarily the package > > set that gets built on a roughly weekly basis. Using FreeBSD 4.8 > > for the i386 architecture as an example this means carrying: > > > > releases/i386/4.8-RELEASE/ > > releases/i386/ISO-IMAGES/4.8/ > > ports/i386/packages-4.8-release/ > > > >2) Syncs at least once a day from a Distribution Site or a Primary Mirror > > Site. > >3) Will be given a "ftpX.CC.freebsd.org" name. > > Did you forgot the part about possibly not carrying all > architectures, or is it intentional? And isn't once a day too much for > something that generally do not changes after beeing released? Sorry, as you say I didn't make that clear. It should read you need to "Carry all files needed for latest Production Release for at least one architecture, which ..." > Also, did you mean to put and end to ftp.CC.freebsd.org? Or maybe > turning it into a Round Robin of the other ftpX.CC.freebsd.org sites? No, it's hard to give a generic enough name but "ftpX.CC.freebsd.org" would include the case where "X" is "". If the Zone Admins want to set up the Round Robin thing that's fine - it would be up to them to decide and implement. :-) -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:22:29 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B902537B401; Sun, 27 Jul 2003 13:22:29 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id DA9B043FAF; Sun, 27 Jul 2003 13:22:28 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6RKMSbr011862; Sun, 27 Jul 2003 16:22:28 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6RKMSf3011861; Sun, 27 Jul 2003 16:22:28 -0400 (EDT) Date: Sun, 27 Jul 2003 16:22:28 -0400 From: Ken Smith To: "Simon L. Nielsen" Message-ID: <20030727202228.GC11351@electra.cse.Buffalo.EDU> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030727200640.GA387@FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20030727200640.GA387@FreeBSD.org> User-Agent: Mutt/1.4.1i cc: Ken Smith cc: freebsd-hubs@FreeBSD.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:22:30 -0000 On Sun, Jul 27, 2003 at 10:06:42PM +0200, Simon L. Nielsen wrote: > On 2003.07.27 15:27:24 -0400, Ken Smith wrote: > > 4) Directory archive sits in is /pub/FreeBSD. > > At least ftp9.freebsd.org doesn't do this... Is it that important, since > the FreeBSD mirror directory is mentioned in the Handbook? > > I can see the benefit for users from having all mirrors having the > /pub/FreeBSD directory, but some large mirrors might like to subdivide > their mirrors and it would be a shame to disqualify them on this reason > alone. I inherited that requirement from the existing docs so I don't know exactly what prompted it as a requirement. I *think* it has to do with sysinstall in install-via-ftp mode but that's just a guess. Does anyone else know for sure? -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:29:25 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9C90E37B401 for ; Sun, 27 Jul 2003 13:29:25 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id D440F43FDF for ; Sun, 27 Jul 2003 13:29:24 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6RKTObr011917; Sun, 27 Jul 2003 16:29:24 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6RKTOa6011916; Sun, 27 Jul 2003 16:29:24 -0400 (EDT) Date: Sun, 27 Jul 2003 16:29:23 -0400 From: Ken Smith To: =?unknown-8bit?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= Message-ID: <20030727202923.GD11351@electra.cse.Buffalo.EDU> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <3F24313F.7040109@jonny.eng.br> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F24313F.7040109@jonny.eng.br> User-Agent: Mutt/1.4.1i cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:29:26 -0000 On Sun, Jul 27, 2003 at 05:08:31PM -0300, Joo Carlos Mendes Lus wrote: > And isn't once a day too much for > something that generally do not changes after beeing released? That I'm "waffling" over. :-/ If the mirror-announce@ list works well enough then syncing once a day for mostly static data is, as you point out, wasteful. But once a week would be too much of a delay at Release Time. I'm inclined to leave this requirement as-is for now and review it later, after mirror-announce@ has been in place for a while. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:39:50 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0864F37B404 for ; Sun, 27 Jul 2003 13:39:49 -0700 (PDT) Received: from itaqui.terra.com.br (itaqui.terra.com.br [200.176.3.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6753A43F3F for ; Sun, 27 Jul 2003 13:39:48 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from jurere.terra.com.br (jurere.terra.com.br [200.176.3.49]) by itaqui.terra.com.br (Postfix) with ESMTP id 9269C81046C; Sun, 27 Jul 2003 17:39:47 -0300 (BRT) Received: from jonny.eng.br (unknown [200.165.170.243]) (authenticated user dioni21) by jurere.terra.com.br (Postfix) with ESMTP id 8723F13845C; Sun, 27 Jul 2003 17:39:46 -0300 (BRT) Message-ID: <3F243896.9080600@jonny.eng.br> Date: Sun, 27 Jul 2003 17:39:50 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Ken Smith References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <3F24313F.7040109@jonny.eng.br> <20030727201815.GB11351@electra.cse.Buffalo.EDU> In-Reply-To: <20030727201815.GB11351@electra.cse.Buffalo.EDU> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:39:50 -0000 Ken Smith wrote: > On Sun, Jul 27, 2003 at 05:08:31PM -0300, Joo Carlos Mendes Lus wrote: > > >>>Requirements for Secondary Mirror Sites >>>--------------------------------------- >>> >>>1) Simply carry all files needed for latest Production Release, which >>> includes the packages for that release. Note this means the packages >>> in the -release directory for this release, not necessarily the package >>> set that gets built on a roughly weekly basis. Using FreeBSD 4.8 >>> for the i386 architecture as an example this means carrying: >>> >>> releases/i386/4.8-RELEASE/ >>> releases/i386/ISO-IMAGES/4.8/ >>> ports/i386/packages-4.8-release/ >>> >>>2) Syncs at least once a day from a Distribution Site or a Primary Mirror >>> Site. >>>3) Will be given a "ftpX.CC.freebsd.org" name. >> >> Did you forgot the part about possibly not carrying all >>architectures, or is it intentional? And isn't once a day too much for >>something that generally do not changes after beeing released? > > > Sorry, as you say I didn't make that clear. It should read you need > to "Carry all files needed for latest Production Release for at least > one architecture, which ..." > > >> Also, did you mean to put and end to ftp.CC.freebsd.org? Or maybe >>turning it into a Round Robin of the other ftpX.CC.freebsd.org sites? > > > No, it's hard to give a generic enough name but "ftpX.CC.freebsd.org" > would include the case where "X" is "". If the Zone Admins want to set > up the Round Robin thing that's fine - it would be up to them to decide > and implement. :-) This is not only a choice. This would have implications in release engineering. A user must not see diferent stuff when going back to the same "site". If all sites in the RR are primary, it's ok, but if they are secondary, they could not carry the same set. Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:43:03 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B0CEC37B405 for ; Sun, 27 Jul 2003 13:43:03 -0700 (PDT) Received: from paiol.terra.com.br (paiol.terra.com.br [200.176.3.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7F37C43F75 for ; Sun, 27 Jul 2003 13:43:02 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from barra.terra.com.br (barra.terra.com.br [200.176.3.52]) by paiol.terra.com.br (Postfix) with ESMTP id 3BA3C84844D; Sun, 27 Jul 2003 17:43:01 -0300 (BRT) Received: from jonny.eng.br (unknown [200.165.170.243]) (authenticated user dioni21) by barra.terra.com.br (Postfix) with ESMTP id F02DB234419; Sun, 27 Jul 2003 17:42:59 -0300 (BRT) Message-ID: <3F243957.20704@jonny.eng.br> Date: Sun, 27 Jul 2003 17:43:03 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Ken Smith References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <3F24313F.7040109@jonny.eng.br> <20030727202923.GD11351@electra.cse.Buffalo.EDU> In-Reply-To: <20030727202923.GD11351@electra.cse.Buffalo.EDU> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:43:04 -0000 Ken Smith wrote: > On Sun, Jul 27, 2003 at 05:08:31PM -0300, Joo Carlos Mendes Lus wrote: > > >>And isn't once a day too much for >>something that generally do not changes after beeing released? > > > That I'm "waffling" over. :-/ > > If the mirror-announce@ list works well enough then syncing once a > day for mostly static data is, as you point out, wasteful. But > once a week would be too much of a delay at Release Time. I'm > inclined to leave this requirement as-is for now and review it > later, after mirror-announce@ has been in place for a while. Surely, there should be some kind of release effort from all mirror managers. And mirroring everyday is just not enough. You would just mirror an older release. This is something that cannot be automated for secondary mirrors (disk space, the final frontier). Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 13:44:47 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D591237B404; Sun, 27 Jul 2003 13:44:47 -0700 (PDT) Received: from itaqui.terra.com.br (itaqui.terra.com.br [200.176.3.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id C34EA43F85; Sun, 27 Jul 2003 13:44:46 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from barra.terra.com.br (barra.terra.com.br [200.176.3.52]) by itaqui.terra.com.br (Postfix) with ESMTP id EBCA081048F; Sun, 27 Jul 2003 17:44:45 -0300 (BRT) Received: from jonny.eng.br (unknown [200.165.170.243]) (authenticated user dioni21) by barra.terra.com.br (Postfix) with ESMTP id C748E2343B2; Sun, 27 Jul 2003 17:44:44 -0300 (BRT) Message-ID: <3F2439C0.2030002@jonny.eng.br> Date: Sun, 27 Jul 2003 17:44:48 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: "Simon L. Nielsen" References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030727200640.GA387@FreeBSD.org> In-Reply-To: <20030727200640.GA387@FreeBSD.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 20:44:48 -0000 Simon L. Nielsen wrote: > On 2003.07.27 15:27:24 -0400, Ken Smith wrote: > > >>Requirements of all Mirror Sites >>-------------------------------- >> > > [CUT] > >>4) Directory archive sits in is /pub/FreeBSD. > > > At least ftp9.freebsd.org doesn't do this... Is it that important, since > the FreeBSD mirror directory is mentioned in the Handbook? It's important. Think sysinstall... > I can see the benefit for users from having all mirrors having the > /pub/FreeBSD directory, but some large mirrors might like to subdivide > their mirrors and it would be a shame to disqualify them on this reason > alone. There are large mirrors that use this structure without problems. And you could always use symbolic links, if needed. Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 14:34:14 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9A5ED37B401 for ; Sun, 27 Jul 2003 14:34:14 -0700 (PDT) Received: from basm.cerias.purdue.edu (basm.cerias.purdue.edu [128.10.243.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id D730143FA3 for ; Sun, 27 Jul 2003 14:34:13 -0700 (PDT) (envelope-from raj@cerias.purdue.edu) Received: from basm.cerias.purdue.edu (raj@localhost [127.0.0.1]) ESMTP id h6RLYCQb026025 for ; Sun, 27 Jul 2003 16:34:13 -0500 (EST) Received: (from raj@localhost) by basm.cerias.purdue.edu (8.12.9/8.12.9/Submit) id h6RLYCPT026024 for freebsd-hubs@freebsd.org; Sun, 27 Jul 2003 16:34:12 -0500 (EST) Date: Sun, 27 Jul 2003 16:34:12 -0500 From: Brian Poole To: freebsd-hubs@freebsd.org Message-ID: <20030727213412.GC21867@basm.cerias.purdue.edu> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030727200640.GA387@FreeBSD.org> <3F2439C0.2030002@jonny.eng.br> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F2439C0.2030002@jonny.eng.br> Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jul 2003 21:34:14 -0000 Quoting Joo Carlos Mendes Lus (jonny@jonny.eng.br) from 27 July 2003: > Simon L. Nielsen wrote: > > >On 2003.07.27 15:27:24 -0400, Ken Smith wrote: > > > >>4) Directory archive sits in is /pub/FreeBSD. > > > >At least ftp9.freebsd.org doesn't do this... Is it that important, since > >the FreeBSD mirror directory is mentioned in the Handbook? Right-o. We never have either, it was known when we signed up (3+ years ago?) that this was the case. We'll either become an unofficial mirror or add an alias to separate the OS mirrors from the rest of our archives. > It's important. Think sysinstall... Agreed, for some reason I was under the impression that sysintall had a way of handling this but looking at the code it doesn't appear to. Official mirrors should meet this requirement if the install scripts don't have a method for handling mirrors with different directory structures. OpenBSD handles this by leaving the ftplist on the master site and the ftplist includes the directory as well as hostname. I'm not sure if Debian handles this correctly or not. Oh well. > >I can see the benefit for users from having all mirrors having the > >/pub/FreeBSD directory, but some large mirrors might like to subdivide > >their mirrors and it would be a shame to disqualify them on this reason > >alone. > > There are large mirrors that use this structure without problems. And > you could always use symbolic links, if needed. And they are ugly and disorganized IMO. I never liked putting everything in one directory and I still don't. The only way I can see us changing to meet this requirement is splitting the OSes off onto "another server" by aliasing another IP to the current server and having only OS mirrors there. I'm not sure if this will be the case or if we will just become an unofficial mirror for our campus. Will discuss it locally and let Ken or someone know when the decision has been made. -b From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 17:54:23 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5D49337B401 for ; Sun, 27 Jul 2003 17:54:23 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9D7A243F75 for ; Sun, 27 Jul 2003 17:54:22 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6S0sLbr014998; Sun, 27 Jul 2003 20:54:21 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6S0sL6C014997; Sun, 27 Jul 2003 20:54:21 -0400 (EDT) Date: Sun, 27 Jul 2003 20:54:21 -0400 From: Ken Smith To: Oliver Fromme Message-ID: <20030728005421.GA14711@electra.cse.Buffalo.EDU> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <200307272137.h6RLbov2023926@lurza.secnetix.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200307272137.h6RLbov2023926@lurza.secnetix.de> User-Agent: Mutt/1.4.1i cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2003 00:54:23 -0000 On Sun, Jul 27, 2003 at 11:37:50PM +0200, Oliver Fromme wrote: > Now tell me, Ken, would you disqualify ftp7.de.freebsd.org > as a "primary" mirror? I'm curious ... :-) Umm. No. > I think the important thing is _what_ stuff is on a mirror, > not how it got there. And I think that ftp7.de is more up- > to-date than certain mirror sites which strictly comply with > your definition of a primary site. Point taken. I'll see if I can describe the desired end result without the description being so complex nobody can understand it. ;-) It was mentioned earler I'm putting too much emphasis on sync rates, this makes it even clearer. > Just my 0.02 Euro. :-) That was at least 0.04. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Sun Jul 27 19:06:45 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E2D337B401 for ; Sun, 27 Jul 2003 19:06:45 -0700 (PDT) Received: from itaqui.terra.com.br (itaqui.terra.com.br [200.176.3.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 92AE043F75 for ; Sun, 27 Jul 2003 19:06:44 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from jurere.terra.com.br (jurere.terra.com.br [200.176.3.49]) by itaqui.terra.com.br (Postfix) with ESMTP id 0585E8101C8; Sun, 27 Jul 2003 23:06:43 -0300 (BRT) Received: from jonny.eng.br (unknown [200.165.170.243]) (authenticated user dioni21) by jurere.terra.com.br (Postfix) with ESMTP id 298001380CE; Sun, 27 Jul 2003 23:06:40 -0300 (BRT) Message-ID: <3F248536.8020908@jonny.eng.br> Date: Sun, 27 Jul 2003 23:06:46 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Brian Poole References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030727200640.GA387@FreeBSD.org> <3F2439C0.2030002@jonny.eng.br> <20030727213412.GC21867@basm.cerias.purdue.edu> In-Reply-To: <20030727213412.GC21867@basm.cerias.purdue.edu> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2003 02:06:45 -0000 Brian Poole wrote: > Quoting Joo Carlos Mendes Lus (jonny@jonny.eng.br) from 27 July 2003: > >>Simon L. Nielsen wrote: >> >> >>>On 2003.07.27 15:27:24 -0400, Ken Smith wrote: >>> >>> >>>>4) Directory archive sits in is /pub/FreeBSD. >>> >>>At least ftp9.freebsd.org doesn't do this... Is it that important, since >>>the FreeBSD mirror directory is mentioned in the Handbook? > > Right-o. We never have either, it was known when we signed up (3+ > years ago?) that this was the case. We'll either become an unofficial > mirror or add an alias to separate the OS mirrors from the rest of > our archives. > >>It's important. Think sysinstall... > > > Agreed, for some reason I was under the impression that sysintall had > a way of handling this but looking at the code it doesn't appear to. > Official mirrors should meet this requirement if the install scripts > don't have a method for handling mirrors with different directory > structures. OpenBSD handles this by leaving the ftplist on the master > site and the ftplist includes the directory as well as hostname. I'm This sounds good! And we can have a first guess in cache (sysinstall) for when it's not possible to reach the mirror list site. Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 05:14:25 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B424E37B401 for ; Mon, 28 Jul 2003 05:14:25 -0700 (PDT) Received: from lurza.secnetix.de (mail2.secnetix.de [195.143.231.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id AD2B943F85 for ; Mon, 28 Jul 2003 05:14:23 -0700 (PDT) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (pahevu@localhost [127.0.0.1]) by lurza.secnetix.de (8.12.8p1/8.12.8) with ESMTP id h6RLbpgC023927; Sun, 27 Jul 2003 23:37:51 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.12.8p1/8.12.8/Submit) id h6RLbov2023926; Sun, 27 Jul 2003 23:37:50 +0200 (CEST) From: Oliver Fromme Message-Id: <200307272137.h6RLbov2023926@lurza.secnetix.de> To: kensmith@cse.Buffalo.EDU (Ken Smith) Date: Sun, 27 Jul 2003 23:37:50 +0200 (CEST) In-Reply-To: <20030727192724.GA10869@electra.cse.Buffalo.EDU> from "Ken Smith" at Jul 27, 2003 03:27:24 PM X-Mailer: ELM [version 2.5 PL3] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2003 12:14:26 -0000 Hi, First of all, you're doing a great job, Ken. Thanks a bunch. Here are a few comments of mine on the latest draft. I am the maintainer of the FreeBSD mirror ftp7.de.freebsd.org, which is on of the more popular mirrors in Germany, because I always try to keep it as up-to-date as possible, especially during release times. Actually I would regard this mirror as a "primary" one, but it somewhat differs from your definition of a primary mirror site. Let me explain. First, it is a complete mirror, even with some additional "bonus features" (e.g. daily -stable and -current snapshots). We're carrying all platforms and all releases, even a few more (e.g. 3.5.1/i386 which isn't on the master anymore). Except for one detail: I have opted to omit a few things from the "branches" directory. In particular, I removed the extracted ports tree. It is just a waste of space, inodes and time, in my opinion. Second, I am not syncing the whole /pub/FreeBSD from the master every day. I think that would be a waste, too. I'm only syncing those parts regularly that change often, e.g. the distfiles, packages for -stable and -current, and similar things. Those things that come once and never change (e.g. releases) are mirrored manually, once they have been announced on the hubs@ list. Of course, I also watch out for "fixes" which cause a release to be re-rolled, so I have to sync again. That happened a few times in the past. I usually re-sync again a few days after the release, just to be sure, but after that, I never sync that release again. I usually start syncing a few minutes after the announcement has been made on the list, so the mirror is as up-to-date as it could possibly ever be. :-) Now tell me, Ken, would you disqualify ftp7.de.freebsd.org as a "primary" mirror? I'm curious ... :-) I think the important thing is _what_ stuff is on a mirror, not how it got there. And I think that ftp7.de is more up- to-date than certain mirror sites which strictly comply with your definition of a primary site. Just my 0.02 Euro. :-) Regards Oliver -- Oliver Fromme, secnetix GmbH & Co KG, Oettingenstr. 2, 80538 München Any opinions expressed in this message may be personal to the author and may not necessarily reflect the opinions of secnetix in any way. "If you do things right, people won't be sure you've done anything at all." -- God in Futurama season 4 episode 8 From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 07:28:11 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5D59737B401 for ; Mon, 28 Jul 2003 07:28:10 -0700 (PDT) Received: from arthur.nitro.dk (port324.ds1-khk.adsl.cybercity.dk [212.242.113.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 05D2D43F75 for ; Mon, 28 Jul 2003 07:28:10 -0700 (PDT) (envelope-from simon@arthur.nitro.dk) Received: by arthur.nitro.dk (Postfix, from userid 1000) id 5DF3C10BFA8; Mon, 28 Jul 2003 16:28:08 +0200 (CEST) Date: Mon, 28 Jul 2003 16:28:08 +0200 From: "Simon L. Nielsen" To: Ken Smith Message-ID: <20030728142808.GB849@FreeBSD.org> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030727200640.GA387@FreeBSD.org> <20030727202228.GC11351@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="PmA2V3Z32TCmWXqI" Content-Disposition: inline In-Reply-To: <20030727202228.GC11351@electra.cse.Buffalo.EDU> User-Agent: Mutt/1.5.4i cc: freebsd-hubs@FreeBSD.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2003 14:28:11 -0000 --PmA2V3Z32TCmWXqI Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2003.07.27 16:22:28 -0400, Ken Smith wrote: > On Sun, Jul 27, 2003 at 10:06:42PM +0200, Simon L. Nielsen wrote: > > On 2003.07.27 15:27:24 -0400, Ken Smith wrote: > > > 4) Directory archive sits in is /pub/FreeBSD. > >=20 > > At least ftp9.freebsd.org doesn't do this... Is it that important, since > > the FreeBSD mirror directory is mentioned in the Handbook? > >=20 > > I can see the benefit for users from having all mirrors having the > > /pub/FreeBSD directory, but some large mirrors might like to subdivide > > their mirrors and it would be a shame to disqualify them on this reason > > alone. >=20 > I inherited that requirement from the existing docs so I don't know > exactly what prompted it as a requirement. I *think* it has to > do with sysinstall in install-via-ftp mode but that's just a guess. > Does anyone else know for sure? I just did a quick check in the sysinstall source, and it appears like you are right. From what I can see sysinstall does require the files to be in pub/FreeBSD... Sorry about the noice. --=20 Simon L. Nielsen New PGP key 0x27359A51 Fingerprint: 912B F341 7E90 2049 05B4 3800 87DA 5C0D 2735 9A51 --PmA2V3Z32TCmWXqI Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (FreeBSD) iD8DBQE/JTL4h9pcDSc1mlERArVBAKCxAd2MGQ0KCferg+yImWbhO0Nt0QCffLfh cFXFbdI/XEU283fOxqEukws= =Z/1/ -----END PGP SIGNATURE----- --PmA2V3Z32TCmWXqI-- From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 22:26:21 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5635437B401 for ; Mon, 28 Jul 2003 22:26:21 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id A400843FA3 for ; Mon, 28 Jul 2003 22:26:20 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6T5QKbr016562 for ; Tue, 29 Jul 2003 01:26:20 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6T5QJlK016561 for freebsd-hubs@freebsd.org; Tue, 29 Jul 2003 01:26:19 -0400 (EDT) Date: Tue, 29 Jul 2003 01:26:19 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030729052619.GA16116@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 05:26:21 -0000 Mirror Site Categories ---------------------- - Distribution Site: ftp-master* site, ftp-master itself plus a set of other machines that sync frequently from ftp-master and allow only Official Mirror Sites to connect to them. - Primary Mirror Site: Sync at least once a day from a Distribution Site, carry everything currently on ftp-master. - Secondary Mirror Site: Does not carry everything on ftp-master, and/or syncs from a Primary Mirror Site (thus getting stuff slower). Which category a Mirror Site fits in will be indicated on the Web page listing the FTP mirrors, and that page will include a description of what "Primary" versus "Secondary" means. End-users don't need to know anything about the Distribution Servers so they won't be mentioned in the Handbook but will be described in the hubs article. Requirements of all Mirror Sites -------------------------------- 1) Different user for sync jobs than anonymous FTP (and, if HTTP access is available, httpd). 2) Mechanism used for sync preserves (and can change later) file permissions. 3) Site Admin on mirror-announce@ list (still being created, not ready yet). This will be a private (Official Mirrors only) list used only for announcements by mirror-admin@ and re@. hubs@ will remain an open discussion list. 4) Directory archive sits in is /pub/FreeBSD. Requirements for Primary Mirror Sites ------------------------------------- 1) Carries everything currently on ftp-master (note that is changing, we hope to drop the branches/ stuff). 2) New data posted to the Distribution Sites should reach a Primary Mirror site within a day to a day and a half. See note below about sync-ing. 3) Optionally provides access to other Official Mirror Sites through a secure mechanism (only allowing Official Mirror Sites to download "staged" releases). This typically means running a special cvsupd or rsyncd with access restrictions. Must check with mirror-admin@ before granting this sort of access to confirm the requesting site is an Official Mirror Site. 4) Site Admin on hubs@ in addition to mirror-announce@. 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate for becoming a "ftpX.freebsd.org" hostname. Requirements for Secondary Mirror Sites --------------------------------------- 1) Carry all files needed for latest Production Release for at least one architecture. This includes the packages for that release. Note this means the packages in the -release directory for this release, not necessarily the package set that gets built on a roughly weekly basis. Using FreeBSD 4.8 for the i386 architecture as an example this means carrying: releases/i386/4.8-RELEASE/ releases/i386/ISO-IMAGES/4.8/ ports/i386/packages-4.8-release/ 2) Syncs from a Distribution Site or a Primary Mirror Site. New data posted to the Distribution Servers (in the area(s) a Secondary Mirror Site chooses to carry) should reach the Secondary Mirror Site within two to three days. See note below about sync-ing. 3) Will be given a "ftpX.CC.freebsd.org" name. Sync-ing Strategies ------------------- The FreeBSD site can be challenging to sync with depending on a wide variety of things (your machine's capabilities, the network bandwidth to your upstream site, the capabilities of that upstream site, how much of the site you choose to mirror, the mechanism you use to sync, etc.). At first it is probably easiest to sync everything you choose to carry once a day from your upstream site. However as time goes on you will notice which pieces of the site tend to be active (e.g. parts of the ports/ section of the site are updated roughly weekly) versus which pieces of the site tend to be less active (e.g. the releases/ section of the site is only active when a new Release is being prepared). Primary/Secondary Mirror Sites should try to abide by the time frames mentioned above for the data they choose to carry. By choosing to sync active pieces of the site on a regular basis and by paying attention to announcements on the mailing list to adapt syncing the less active parts of the site as appropriate the time frames mentioned above can be achieved. Note we do hope to streamline the site a bit to make this easier down the road. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 22:53:25 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4B4BE37B401 for ; Mon, 28 Jul 2003 22:53:25 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6C88243FA3 for ; Mon, 28 Jul 2003 22:53:24 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6T5rNbr016988 for ; Tue, 29 Jul 2003 01:53:23 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6T5rNGO016987 for freebsd-hubs@freebsd.org; Tue, 29 Jul 2003 01:53:23 -0400 (EDT) Date: Tue, 29 Jul 2003 01:53:23 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030729055323.GB16116@electra.cse.Buffalo.EDU> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <200307272137.h6RLbov2023926@lurza.secnetix.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200307272137.h6RLbov2023926@lurza.secnetix.de> User-Agent: Mutt/1.4.1i Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 05:53:25 -0000 On Sun, Jul 27, 2003 at 11:37:50PM +0200, Oliver Fromme wrote: > First, it is a complete mirror, even with some additional > "bonus features" (e.g. daily -stable and -current snapshots). > We're carrying all platforms and all releases, even a few > more (e.g. 3.5.1/i386 which isn't on the master anymore). > Except for one detail: I have opted to omit a few things > from the "branches" directory. In particular, I removed the > extracted ports tree. It is just a waste of space, inodes > and time, in my opinion. We hope to drop branches/ completely. Still working out some details but so far nobody has screamed (loudly anyway). > Second, I am not syncing the whole /pub/FreeBSD from the > master every day. I think that would be a waste, too. > I'm only syncing those parts regularly that change often, > e.g. the distfiles, packages for -stable and -current, and > similar things. I *think* I found a way to describe that which is not too confusing or ambiguous. Let me know... > I think the important thing is _what_ stuff is on a mirror, > not how it got there. And I think that ftp7.de is more up- > to-date than certain mirror sites which strictly comply with > your definition of a primary site. Depending on what stuff is there, whether you are feeding other sites, etc. how long it takes to get there *might* be an important thing. But as you say exactly how it got there is not important. :-) Someone mentioned privately that it would be nice to have a "Mirror Site Wannabe Kit". I'll add that to the list of projects but if someone(s) else want to take a whack at it feel free. Jun posted some cvsup related stuff a little while ago, I'd start off with that and add in rsync and omi suggestions. The article on how to mirror stuff is a good start but could use some more details (that article is where the "Mirror Site Requirements" we've been working on is supposed to go). It has also been pointed out FreeBSD is a real "heavyweight" compared to pretty much everything else. I do carry other things I can compare it to and thoughts have started forming but a lot of factors need to be considered before I start to mention them anywhere. :-/ Targetting the removal of branches/ was brought up by several people before I became active and Jun wanted it to happen too - there were just some small entanglements like Web docs that someone needed to have the time to hunt down and fix. But that was the only truly easy target, the other possible targets involve a lot more factors as far as I can tell. The ports/ in particular. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 23:12:42 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5154A37B401 for ; Mon, 28 Jul 2003 23:12:42 -0700 (PDT) Received: from itaqui.terra.com.br (itaqui.terra.com.br [200.176.3.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id DB5FC43F85 for ; Mon, 28 Jul 2003 23:12:40 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from tucuriba.terra.com.br (tucuriba.terra.com.br [200.176.3.53]) by itaqui.terra.com.br (Postfix) with ESMTP id 5695F81065F; Tue, 29 Jul 2003 03:12:39 -0300 (BRT) Received: from jonny.eng.br (unknown [200.141.120.134]) (authenticated user dioni21) by tucuriba.terra.com.br (Postfix) with ESMTP id 8FB03264078; Tue, 29 Jul 2003 03:12:37 -0300 (BRT) Message-ID: <3F26105D.5090207@jonny.eng.br> Date: Tue, 29 Jul 2003 03:12:45 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Ken Smith References: <20030729052619.GA16116@electra.cse.Buffalo.EDU> In-Reply-To: <20030729052619.GA16116@electra.cse.Buffalo.EDU> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 06:12:42 -0000 Hi Ken, We're getting there! Thanks for your efforts. Ken Smith wrote: > Mirror Site Categories > ---------------------- > > - Distribution Site: ftp-master* site, ftp-master itself plus a set > of other machines that sync frequently from ftp-master and allow > only Official Mirror Sites to connect to them. > > - Primary Mirror Site: Sync at least once a day from a Distribution I would rather remove "at least a day", it's better explained below. > Site, carry everything currently on ftp-master. > > - Secondary Mirror Site: Does not carry everything on ftp-master, > and/or syncs from a Primary Mirror Site (thus getting stuff slower). > > Which category a Mirror Site fits in will be indicated on the Web page > listing the FTP mirrors, and that page will include a description of what > "Primary" versus "Secondary" means. End-users don't need to know anything > about the Distribution Servers so they won't be mentioned in the Handbook > but will be described in the hubs article. > > > Requirements of all Mirror Sites > -------------------------------- > > 1) Different user for sync jobs than anonymous FTP (and, if HTTP > access is available, httpd). > 2) Mechanism used for sync preserves (and can change later) file > permissions. > 3) Site Admin on mirror-announce@ list (still being created, not ready > yet). This will be a private (Official Mirrors only) list used only > for announcements by mirror-admin@ and re@. hubs@ will remain an > open discussion list. > 4) Directory archive sits in is /pub/FreeBSD. Leave here a note about possible future enhancements with mirror lists that would remove this restriction. > > Requirements for Primary Mirror Sites > ------------------------------------- > > 1) Carries everything currently on ftp-master (note that is changing, we > hope to drop the branches/ stuff). > 2) New data posted to the Distribution Sites should reach a Primary Mirror > site within a day to a day and a half. See note below about sync-ing. > 3) Optionally provides access to other Official Mirror Sites through a > secure mechanism (only allowing Official Mirror Sites to download > "staged" releases). This typically means running a special cvsupd > or rsyncd with access restrictions. Must check with mirror-admin@ > before granting this sort of access to confirm the requesting site > is an Official Mirror Site. > 4) Site Admin on hubs@ in addition to mirror-announce@. > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > for becoming a "ftpX.freebsd.org" hostname. > > Requirements for Secondary Mirror Sites > --------------------------------------- > > 1) Carry all files needed for latest Production Release for at least one > architecture. This includes the packages for that release. Note this > means the packages in the -release directory for this release, not > necessarily the package set that gets built on a roughly weekly basis. > Using FreeBSD 4.8 for the i386 architecture as an example this means > carrying: > > releases/i386/4.8-RELEASE/ > releases/i386/ISO-IMAGES/4.8/ > ports/i386/packages-4.8-release/ Another note: TODO in sysinstall: check safely for existence of architecture in selected mirror, and ask the user another mirror (or use the mirror lists enhancement). > > 2) Syncs from a Distribution Site or a Primary Mirror Site. New data > posted to the Distribution Servers (in the area(s) a Secondary Mirror > Site chooses to carry) should reach the Secondary Mirror Site within > two to three days. See note below about sync-ing. > 3) Will be given a "ftpX.CC.freebsd.org" name. > > Sync-ing Strategies > ------------------- > > The FreeBSD site can be challenging to sync with depending on a wide > variety of things (your machine's capabilities, the network bandwidth > to your upstream site, the capabilities of that upstream site, how much > of the site you choose to mirror, the mechanism you use to sync, etc.). > At first it is probably easiest to sync everything you choose to carry > once a day from your upstream site. However as time goes on you will > notice which pieces of the site tend to be active (e.g. parts of the ports/ > section of the site are updated roughly weekly) versus which pieces of the > site tend to be less active (e.g. the releases/ section of the site is > only active when a new Release is being prepared). Primary/Secondary > Mirror Sites should try to abide by the time frames mentioned above for > the data they choose to carry. By choosing to sync active pieces of the > site on a regular basis and by paying attention to announcements on the > mailing list to adapt syncing the less active parts of the site as appropriate > the time frames mentioned above can be achieved. Note we do hope to > streamline the site a bit to make this easier down the road. My experience with this is that release dates are announced very early, and I've never missed one, only by reading my email. I like this part of the text. BTW, this remember me something that probably belongs here: The contents in /pub/FreeBSD/doc is constantly changing, probably because of daily compilations of source code. I just stopped mirroring this daily, until I find a smarter mechanism to do that. For now, it's a bandwidth waster! Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Mon Jul 28 23:39:04 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B4FB937B401 for ; Mon, 28 Jul 2003 23:39:04 -0700 (PDT) Received: from thanatos.is.co.za (thanatos.is.co.za [196.4.160.229]) by mx1.FreeBSD.org (Postfix) with ESMTP id 10F4943FAF for ; Mon, 28 Jul 2003 23:39:01 -0700 (PDT) (envelope-from geoffr@hermwas.is.co.za) Received: from hermwas.is.co.za (hermwas.is.co.za [196.23.0.8]) by thanatos.is.co.za (Postfix) with ESMTP id E00009BFB3; Tue, 29 Jul 2003 08:38:55 +0200 (SAST) Received: by hermwas.is.co.za (Postfix, from userid 1333) id ABFF530AFB; Tue, 29 Jul 2003 08:38:55 +0200 (SAT) Date: Tue, 29 Jul 2003 08:38:55 +0200 From: Geoff Rehmet To: Ken Smith Message-ID: <20030729083855.B13802@hermwas.is.co.za> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20030727192724.GA10869@electra.cse.Buffalo.EDU>; from kensmith@cse.Buffalo.EDU on Sun, Jul 27, 2003 at 03:27:24PM -0400 cc: freebsd-hubs@freebsd.org Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: Geoff Rehmet List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 06:39:05 -0000 It seems that, on Sun, Jul 27, 2003 at 03:27:24PM -0400, in message <20030727192724.GA10869@electra.cse.Buffalo.EDU>, Ken Smith wrote: > > I think this reflects our latest thoughts. If I missed let me know. Note > the distinction between Primary and Secondary doesn't really have any > "functional" meaning - it is just to help provide users with an indication > that a site *might* not have what they're looking for in the case of > a site being Secondary. Beta testers should also be able to use the > list of Primaries as a guide to where they're likely to find the pre-release > builds sooner versus later (or not at all). We can work a bit on fine > tuning what's available where later (see comment at the bottom). I haven't managed to read all the mails in this thread, however, I have one or two thoughts: - The splitting out of parts of the tree, so that primary servers do not need to carry everything that is on ftp-master is probably a good idea - the archive is growing to the size that is not justified by the volume of downloads that it generates. - Some thought should be taken towards ensuring that there is at least one primary mirror in each geographic region (probably on each continent). -- It is enough of a problem with the delays in syning, due to the high latency all the way from ftp-master. (Remember that in South Africa, we are dealing with at least 250ms, or more - up to 600ms - RTT to ftp-master, which seems to affect cvsup quite adversely. By having at least one primary mirror in country, that allows other mirrors in the country to get the bits quicker. My second comment must be seen in the light of the first. Regards, Geoff. -- Geoff Rehmet - New Business Development - Internet Solutions email: geoffr@is.co.za, geoff@is.co.za tel: +27-11-575-0426, fax/voicemail: +27-11-388-3205 mobile: +27-83-292-5800 www: http://www.is.co.za From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 00:00:46 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 44D7037B401 for ; Tue, 29 Jul 2003 00:00:46 -0700 (PDT) Received: from paiol.terra.com.br (paiol.terra.com.br [200.176.3.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0A8E543F93 for ; Tue, 29 Jul 2003 00:00:45 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from bertioga.terra.com.br (bertioga.terra.com.br [200.176.3.77]) by paiol.terra.com.br (Postfix) with ESMTP id BEE4D848013; Tue, 29 Jul 2003 04:00:43 -0300 (BRT) Received: from jonny.eng.br (unknown [200.141.120.134]) (authenticated user dioni21) by bertioga.terra.com.br (Postfix) with ESMTP id 7C1313F8042; Tue, 29 Jul 2003 04:00:41 -0300 (BRT) Message-ID: <3F261BA1.9070509@jonny.eng.br> Date: Tue, 29 Jul 2003 04:00:49 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Geoff Rehmet References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> In-Reply-To: <20030729083855.B13802@hermwas.is.co.za> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 07:00:46 -0000 Geoff Rehmet wrote: > - Some thought should be taken towards ensuring that there is at least > one primary mirror in each geographic region (probably on each > continent). -- It is enough of a problem with the delays in > syning, due to the high latency all the way from ftp-master. > (Remember that in South Africa, we are dealing with at least > 250ms, or more - up to 600ms - RTT to ftp-master, which seems > to affect cvsup quite adversely. By having at least one > primary mirror in country, that allows other mirrors in the > country to get the bits quicker. Just notice that geographic distribution is not always equivalent to topological distribution. For example, in South America is much faster to go anywhere in USA or Europe than another South America country. Sometime time ago it was even true for different providers in the same country, I not sure this is not a problem anymore. Even inside Brazil we have similar problems. Depending on where you are and where you want to go, it may be faster to go outside Brazil and get another copy. On the other hand, Brazil has probably lots of free outgoing bandwidth to other countries, and a primary mirror here would not be a very bad idea. No, I'm not candidating, I don't have the resources. :-( Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 00:19:44 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 26AFB37B401 for ; Tue, 29 Jul 2003 00:19:44 -0700 (PDT) Received: from luna.rtfmconsult.com (luna.rtfmconsult.com [202.83.72.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4B20743FBD for ; Tue, 29 Jul 2003 00:19:41 -0700 (PDT) (envelope-from jason@rtfmconsult.com) Received: by luna.rtfmconsult.com (Postfix, from userid 42) id A9E1648E6F; Tue, 29 Jul 2003 17:19:39 +1000 (EST) Received: from localhost (localhost [127.0.0.1]) by luna.rtfmconsult.com (Postfix) with ESMTP id A1D7552D96; Tue, 29 Jul 2003 17:19:39 +1000 (EST) Date: Tue, 29 Jul 2003 17:19:39 +1000 (EST) From: jason andrade To: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= In-Reply-To: <3F261BA1.9070509@jonny.eng.br> Message-ID: References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> <3F261BA1.9070509@jonny.eng.br> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-1 Content-Transfer-Encoding: QUOTED-PRINTABLE cc: Geoff Rehmet cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 07:19:44 -0000 On Tue, 29 Jul 2003, [ISO-8859-1] Jo=E3o Carlos Mendes Lu=EDs wrote: Hi Jonny, > Just notice that geographic distribution is not always equivalent > to topological distribution. For example, in South America is much > faster to go anywhere in USA or Europe than another South America > country. Sometime time ago it was even true for different providers in [...] > On the other hand, Brazil has probably lots of free outgoing > bandwidth to other countries, and a primary mirror here would not be a > very bad idea. No, I'm not candidating, I don't have the resources. :-= ( I'd like to add $0.02 here. When i did some research for a paper presented by a couple of my collegues for network topology and drivers in the asia pacific region one of the observations was there are two trends that develo= p for networking. o a 'region' or even country might have all its bandwidth routed via the US - which is great if you work for a US telco but less so for the people buying the links - in general non US sites have to pay for 100% of the cost of the international link.. to send bytes to or via the US. o as 'content' and in particular localized content becomes available then there is a push towards a concept of 'local' peering as this starts making economic sense. this happens faster when internet penetration increases in 'local' areas as clusters of users start wanting to do things where latency starts being an issue. The corollory to this is the dramatic reduction in a lot of places of international bandwidth which is encouraging (in the short term) the use of international pipes rather than local ones. So right now it might be that one south american country can talk to another only via the US but i would predict this is less likely 1-2 or 5 years from now and it will be better to plan for having a south american 'tier1/primary' in the future to sync from. regards, -jason From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 00:35:45 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2614D37B401 for ; Tue, 29 Jul 2003 00:35:45 -0700 (PDT) Received: from luna.rtfmconsult.com (luna.rtfmconsult.com [202.83.72.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5199043F75 for ; Tue, 29 Jul 2003 00:35:44 -0700 (PDT) (envelope-from jason@rtfmconsult.com) Received: by luna.rtfmconsult.com (Postfix, from userid 42) id 3061D48E6F; Tue, 29 Jul 2003 17:35:43 +1000 (EST) Received: from localhost (localhost [127.0.0.1]) by luna.rtfmconsult.com (Postfix) with ESMTP id 1C95A52D96; Tue, 29 Jul 2003 17:35:43 +1000 (EST) Date: Tue, 29 Jul 2003 17:35:42 +1000 (EST) From: jason andrade To: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= In-Reply-To: Message-ID: References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> <3F261BA1.9070509@jonny.eng.br> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: Geoff Rehmet cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 07:35:45 -0000 On Tue, 29 Jul 2003, jason andrade wrote: sigh.. > I'd like to add $0.02 here. When i did some research for a paper presented > by a couple of my collegues for network topology and drivers in the asia drivers of internet bandwidth takeup.. [...] > The corollory to this is the dramatic reduction in a lot of places of reduction in prices regards, -jason From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 12:21:07 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 68F3B37B401 for ; Tue, 29 Jul 2003 12:21:07 -0700 (PDT) Received: from mail.tcoip.com.br (erato.tco.net.br [200.220.254.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2156B43F93 for ; Tue, 29 Jul 2003 12:21:05 -0700 (PDT) (envelope-from dcs@tcoip.com.br) Received: from tcoip.com.br ([10.0.2.6]) by mail.tcoip.com.br (8.11.6/8.11.6) with ESMTP id h6TJK5j30780; Tue, 29 Jul 2003 16:20:07 -0300 Message-ID: <3F26C8E4.5060301@tcoip.com.br> Date: Tue, 29 Jul 2003 16:20:04 -0300 From: "Daniel C. Sobral" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.4) Gecko/20030702 X-Accept-Language: en-us, en, pt-br, ja MIME-Version: 1.0 To: jason andrade References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> <3F261BA1.9070509@jonny.eng.br> In-Reply-To: Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: Geoff Rehmet cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 19:21:07 -0000 jason andrade wrote: > > So right now it might be that one south american country can talk to > another only via the US but i would predict this is less likely 1-2 or > 5 years from now and it will be better to plan for having a south > american 'tier1/primary' in the future to sync from. I don't put much faith in this hypothesis, particularly in the case of Brazil vs the other SA countries. -- Daniel C. Sobral (8-DCS) Gerencia de Operacoes Divisao de Comunicacao de Dados Coordenacao de Seguranca VIVO Centro Oeste Norte Fones: 55-61-313-7654/Cel: 55-61-9618-0904 E-mail: Daniel.Capo@tco.net.br Daniel.Sobral@tcoip.com.br dcs@tcoip.com.br Outros: dcs@newsguy.com dcs@freebsd.org capo@notorious.bsdconspiracy.net If you're not very clever you should be conciliatory. -- Benjamin Disraeli From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 13:18:09 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4496C37B401 for ; Tue, 29 Jul 2003 13:18:09 -0700 (PDT) Received: from coe.ufrj.br (roma.coe.ufrj.br [146.164.53.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id DA00543F75 for ; Tue, 29 Jul 2003 13:18:07 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: by coe.ufrj.br (Postfix, from userid 2000) id 16D3757D837; Tue, 29 Jul 2003 17:18:02 -0300 (BRT) Date: Tue, 29 Jul 2003 17:18:01 -0300 To: jason andrade Message-ID: <20030729201801.GE23216@roma.coe.ufrj.br> References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> <3F261BA1.9070509@jonny.eng.br> Mime-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.4i X-Quote: What are you looking for in my mail headers ? X-Operating-System: FreeBSD X-URL: http://www.jonny.eng.br From: jonny@jonny.eng.br (Joao Carlos Mendes Luis) cc: Geoff Rehmet cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 20:18:09 -0000 Somebody told me that jason andrade said: > On Tue, 29 Jul 2003, [ISO-8859-1] João Carlos Mendes Luís wrote: > Hi Jonny, > > > Just notice that geographic distribution is not always equivalent > > to topological distribution. For example, in South America is much > > faster to go anywhere in USA or Europe than another South America > > country. Sometime time ago it was even true for different providers in > > [...] > > > On the other hand, Brazil has probably lots of free outgoing > > bandwidth to other countries, and a primary mirror here would not be a > > very bad idea. No, I'm not candidating, I don't have the resources. :-( > > I'd like to add $0.02 here. When i did some research for a paper presented > by a couple of my collegues for network topology and drivers in the asia > pacific region one of the observations was there are two trends that develop > for networking. > > o a 'region' or even country might have all its bandwidth routed via the > US - which is great if you work for a US telco but less so for the > people buying the links - in general non US sites have to pay for 100% > of the cost of the international link.. to send bytes to or via the US. > > o as 'content' and in particular localized content becomes available then > there is a push towards a concept of 'local' peering as this starts > making economic sense. this happens faster when internet penetration > increases in 'local' areas as clusters of users start wanting to do > things where latency starts being an issue. > > The corollory to this is the dramatic reduction in a lot of places of > international bandwidth which is encouraging (in the short term) the > use of international pipes rather than local ones. It's happening here inside Brazil, but I think there's little interest in other SA countries around here. Even direct links to Europe are smaller than I think they should be today. > So right now it might be that one south american country can talk to > another only via the US but i would predict this is less likely 1-2 or > 5 years from now and it will be better to plan for having a south > american 'tier1/primary' in the future to sync from. As I said in my first email, I think it may be good to have a tier1 TODAY in Brazil. We just have to know if there's somebody with the necessary resources... I don't! (matrix.com.br, where are you?) Jonny -- João Carlos Mendes Luís jonny@jonny.eng.br Networking Engineer jonny@coe.ufrj.br From owner-freebsd-hubs@FreeBSD.ORG Tue Jul 29 13:42:49 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B4B4837B401 for ; Tue, 29 Jul 2003 13:42:49 -0700 (PDT) Received: from mail.tcoip.com.br (erato.tco.net.br [200.220.254.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id C6B6543F3F for ; Tue, 29 Jul 2003 13:42:43 -0700 (PDT) (envelope-from dcs@tcoip.com.br) Received: from tcoip.com.br ([10.0.2.6]) by mail.tcoip.com.br (8.11.6/8.11.6) with ESMTP id h6TKg9j00406; Tue, 29 Jul 2003 17:42:09 -0300 Message-ID: <3F26DC1F.7060005@tcoip.com.br> Date: Tue, 29 Jul 2003 17:42:07 -0300 From: "Daniel C. Sobral" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.4) Gecko/20030702 X-Accept-Language: en-us, en, pt-br, ja MIME-Version: 1.0 To: Joao Carlos Mendes Luis References: <20030727192724.GA10869@electra.cse.Buffalo.EDU> <20030729083855.B13802@hermwas.is.co.za> <3F261BA1.9070509@jonny.eng.br> <20030729201801.GE23216@roma.coe.ufrj.br> In-Reply-To: <20030729201801.GE23216@roma.coe.ufrj.br> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: jason andrade cc: freebsd-hubs@freebsd.org cc: Geoff Rehmet cc: Ken Smith Subject: Re: Mirror Site Requirements - Final Draft? X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Jul 2003 20:42:50 -0000 Joao Carlos Mendes Luis wrote: > > As I said in my first email, I think it may be good to have a > tier1 TODAY in Brazil. We just have to know if there's somebody with > the necessary resources... I don't! (matrix.com.br, where are you?) On a happy note, I think I might get the resources for a a full mirror. :-) Except for bw. :-( -- Daniel C. Sobral (8-DCS) Gerencia de Operacoes Divisao de Comunicacao de Dados Coordenacao de Seguranca VIVO Centro Oeste Norte Fones: 55-61-313-7654/Cel: 55-61-9618-0904 E-mail: Daniel.Capo@tco.net.br Daniel.Sobral@tcoip.com.br dcs@tcoip.com.br Outros: dcs@newsguy.com dcs@freebsd.org capo@notorious.bsdconspiracy.net You're all clear now, kid. Now blow this thing so we can all go home. -- Han Solo From owner-freebsd-hubs@FreeBSD.ORG Wed Jul 30 11:19:11 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D371737B401 for ; Wed, 30 Jul 2003 11:19:11 -0700 (PDT) Received: from khavrinen.lcs.mit.edu (khavrinen.lcs.mit.edu [18.24.4.193]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0802243FBF for ; Wed, 30 Jul 2003 11:19:11 -0700 (PDT) (envelope-from wollman@khavrinen.lcs.mit.edu) Received: from khavrinen.lcs.mit.edu (localhost.nic.fr [IPv6:::1] (may be forged)) by khavrinen.lcs.mit.edu (8.12.9/8.12.9) with ESMTP id h6UIJ896040304 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK CN=khavrinen.lcs.mit.edu issuer=SSL+20Client+20CA); Wed, 30 Jul 2003 14:19:09 -0400 (EDT) (envelope-from wollman@khavrinen.lcs.mit.edu) Received: (from wollman@localhost) by khavrinen.lcs.mit.edu (8.12.9/8.12.9/Submit) id h6UIJ8gw040301; Wed, 30 Jul 2003 14:19:08 -0400 (EDT) (envelope-from wollman) Date: Wed, 30 Jul 2003 14:19:08 -0400 (EDT) From: Garrett Wollman Message-Id: <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> To: Ken Smith In-Reply-To: <20030729052619.GA16116@electra.cse.Buffalo.EDU> References: <20030729052619.GA16116@electra.cse.Buffalo.EDU> X-Spam-Score: -9.9 () IN_REP_TO,REFERENCES X-Scanned-By: MIMEDefang 2.33 (www . roaringpenguin . com / mimedefang) cc: freebsd-hubs@freebsd.org Subject: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2003 18:19:12 -0000 < said: > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > for becoming a "ftpX.freebsd.org" hostname. > 3) Will be given a "ftpX.CC.freebsd.org" name. I think that this would be more helpful if sites were categorized along a different axis: architecture. It doesn't make sense to require every primary mirror site everywhere in the world to carry every architecture. Few people outside of Japan, for example, have need of PC98 releases. Other places may want to cut out Alpha or sparc64 bits if those distributions are very infrequently downloaded. -GAWollman From owner-freebsd-hubs@FreeBSD.ORG Wed Jul 30 13:47:43 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C19B37B401 for ; Wed, 30 Jul 2003 13:47:43 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6436443F75 for ; Wed, 30 Jul 2003 13:47:40 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h6UKldbr005294 for ; Wed, 30 Jul 2003 16:47:39 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h6UKldFc005293 for freebsd-hubs@freebsd.org; Wed, 30 Jul 2003 16:47:39 -0400 (EDT) Date: Wed, 30 Jul 2003 16:47:39 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030730204739.GA4916@electra.cse.Buffalo.EDU> References: <20030729052619.GA16116@electra.cse.Buffalo.EDU> <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> User-Agent: Mutt/1.4.1i Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jul 2003 20:47:43 -0000 On Wed, Jul 30, 2003 at 02:19:08PM -0400, Garrett Wollman wrote: > < said: > > > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > > for becoming a "ftpX.freebsd.org" hostname. > > > 3) Will be given a "ftpX.CC.freebsd.org" name. > > I think that this would be more helpful if sites were categorized > along a different axis: architecture. It doesn't make sense to > require every primary mirror site everywhere in the world to carry > every architecture. Few people outside of Japan, for example, have > need of PC98 releases. Other places may want to cut out Alpha or > sparc64 bits if those distributions are very infrequently downloaded. This all depends on what (if anything) we want to tell users the distinction is between TLD machines and the rest of them. Based mostly on some chats with someone on re@ I got the impression the most useful thing would be if we could tell end-users: You will find what you are looking for on the TLD machines, and they will have it very shortly after it gets posted to the Distribution Servers. You might get better performance from a CC-listed machine because it is "closer" to you but what those hosts carry and how fast they get it varies. It seems simple and clean. :-) I'm open to suggestions on what would be a better way to use the TLD designation, though I figured one of the things we were moving towards was TLD-based things are of "International" interest versus "Regional" interest. I don't mind doing more fine-grained cataloging and having that reflected in the Handbook but it's a two-way street. I'd need to provide more info in the Handbook and probably would need to update it more often but you guys would need to keep me informed whenever you make changes like dropping an architecture, or getting more disk space and deciding to carry more, etc. That said the freebsdmirrors.org maintainer got back to us this morning and seems interested in working with us to adjust the site to the newer status of things (DNS layout as well as architectures supported, etc). Just needs to find the time. That might be a solution as well. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Wed Jul 30 18:22:48 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5EFC837B401 for ; Wed, 30 Jul 2003 18:22:48 -0700 (PDT) Received: from bast.unixathome.org (bast.unixathome.org [66.11.174.150]) by mx1.FreeBSD.org (Postfix) with ESMTP id BFAEC43F85 for ; Wed, 30 Jul 2003 18:22:47 -0700 (PDT) (envelope-from dan@langille.org) Received: from wocker (wocker.unixathome.org [192.168.0.99]) by bast.unixathome.org (Postfix) with ESMTP id 7BF983D28; Wed, 30 Jul 2003 21:22:46 -0400 (EDT) From: "Dan Langille" To: Garrett Wollman Date: Wed, 30 Jul 2003 21:22:45 -0400 MIME-Version: 1.0 Message-ID: <3F283725.11219.7DFB7A87@localhost> Priority: normal In-reply-to: <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> References: <20030729052619.GA16116@electra.cse.Buffalo.EDU> X-mailer: Pegasus Mail for Windows (v4.02a) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body cc: freebsd-hubs@freebsd.org Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2003 01:22:48 -0000 On 30 Jul 2003 at 14:19, Garrett Wollman wrote: > < said: > > > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > > for becoming a "ftpX.freebsd.org" hostname. > > > 3) Will be given a "ftpX.CC.freebsd.org" name. > > I think that this would be more helpful if sites were categorized > along a different axis: architecture. It doesn't make sense to > require every primary mirror site everywhere in the world to carry > every architecture. Few people outside of Japan, for example, have > need of PC98 releases. Other places may want to cut out Alpha or > sparc64 bits if those distributions are very infrequently downloaded. That can be done with additional DNS zones can't it? Categorize them by what they carry. -- Dan Langille : http://www.langille.org/ From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 31 02:08:11 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A6B8637B401 for ; Thu, 31 Jul 2003 02:08:11 -0700 (PDT) Received: from burka.carrier.kiev.ua (burka.carrier.kiev.ua [193.193.193.107]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2B0DB43F75 for ; Thu, 31 Jul 2003 02:08:09 -0700 (PDT) (envelope-from netch@lucky.net) Received: from netch@localhost [127.0.0.1] (netch@localhost [127.0.0.1]) by burka.carrier.kiev.ua with ESMTP id h6V97pPX098613; Thu, 31 Jul 2003 12:07:52 +0300 (EEST) (envelope-from netch@burka.carrier.kiev.ua) Received: (from netch@localhost) by burka.carrier.kiev.ua (8.12.8p1/8.12.8/Submit) id h6V97m2v098587; Thu, 31 Jul 2003 12:07:48 +0300 (EEST) (envelope-from netch) Date: Thu, 31 Jul 2003 12:07:48 +0300 From: Valentin Nechayev To: Garrett Wollman Message-ID: <20030731090748.GM43099@lucky.net> References: <20030729052619.GA16116@electra.cse.Buffalo.EDU> <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200307301819.h6UIJ8gw040301@khavrinen.lcs.mit.edu> X-42: On X-Verify-Sender: verified cc: freebsd-hubs@freebsd.org cc: Ken Smith Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: netch@lucky.net List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2003 09:08:11 -0000 Wed, Jul 30, 2003 at 14:19:08, wollman wrote about "Requirements Final Draft Attempt #2 :-/": > I think that this would be more helpful if sites were categorized > along a different axis: architecture. It doesn't make sense to > require every primary mirror site everywhere in the world to carry > every architecture. Few people outside of Japan, for example, have > need of PC98 releases. Other places may want to cut out Alpha or > sparc64 bits if those distributions are very infrequently downloaded. Agreed. Architectures other than i386 are used rarely in order of a few magnitudes. -netch- From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 31 03:35:58 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DEFB937B401 for ; Thu, 31 Jul 2003 03:35:58 -0700 (PDT) Received: from stingray.amis.net (stingray.amis.net [212.18.32.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 02D4A43FAF for ; Thu, 31 Jul 2003 03:35:58 -0700 (PDT) (envelope-from blaz@amis.net) Received: from localhost (localhost [127.0.0.1]) by stingray.amis.net (Postfix) with ESMTP id 8C4EF38662F for ; Thu, 31 Jul 2003 12:35:56 +0200 (CEST) Received: from stingray.amis.net ([127.0.0.1]) by localhost (stingray.amis.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 33921-01-21 for ; Thu, 31 Jul 2003 12:35:56 +0200 (CEST) Received: from blaz.medinet.si (blaz.medinet.si [212.18.42.11]) by stingray.amis.net (Postfix) with ESMTP id 0DF2F38661D for ; Thu, 31 Jul 2003 12:35:56 +0200 (CEST) From: Blaz Zupan To: freebsd-hubs@freebsd.org Content-Type: text/plain Organization: Message-Id: <1059647755.21509.54.camel@blaz.medinet.si> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.2.2 (1.2.2-5) Date: 31 Jul 2003 12:35:56 +0200 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by Amis Safe Mail Subject: cvsup from ftp-master.cz.freebsd.org errors X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2003 10:35:59 -0000 Is anybody else getting this from cvsup when trying to sync their FTP mirror with ftp-master.cz.freebsd.org? > Parsing supfile "/home/blaz/mirror/ftp.cvsup" > Connecting to ftp-master.cz.FreeBSD.org > Connected to ftp-master.cz.FreeBSD.org > Server software version: SNAP_16_1h > Negotiating file attribute support > Exchanging collection information > Establishing multiplexed-mode data connection > Running > Updating collection FreeBSD-archive/all > Rmdir FreeBSD/branches/2.2-stable/src > Cannot remove directory "/ftp/.1/FreeBSD/branches/2.2-stable/src": Directory not empty > Rmdir FreeBSD/branches/2.2-stable/sup > Cannot remove directory "/ftp/.1/FreeBSD/branches/2.2-stable/sup": Directory not empty > Rmdir FreeBSD/branches/3.0-stable/src > Cannot remove directory "/ftp/.1/FreeBSD/branches/3.0-stable/src": Directory not empty > Rmdir FreeBSD/branches/3.0-stable/sup > Cannot remove directory "/ftp/.1/FreeBSD/branches/3.0-stable/sup": Directory not empty > Rmdir FreeBSD/branches/4.0-stable/src > Cannot remove directory "/ftp/.1/FreeBSD/branches/4.0-stable/src": Directory not empty > Rmdir FreeBSD/branches/4.0-stable/sup > Cannot remove directory "/ftp/.1/FreeBSD/branches/4.0-stable/sup": Directory not empty > Shutting down connection to server > Finished successfully Why is it trying to remove directories when they contain files? I tried removing all of the above directories plus their contents, but on the next try cvsup brought back all the files and the above errors. From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 31 06:14:54 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 20DC837B401 for ; Thu, 31 Jul 2003 06:14:53 -0700 (PDT) Received: from white.imgsrc.co.jp (ns.imgsrc.co.jp [210.226.20.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9E4A443FCB for ; Thu, 31 Jul 2003 06:14:52 -0700 (PDT) (envelope-from kuriyama@imgsrc.co.jp) Received: from localhost (localhost [127.0.0.1]) by white.imgsrc.co.jp (Postfix) with ESMTP id 5529641DA for ; Thu, 31 Jul 2003 22:14:51 +0900 (JST) Received: from black.imgsrc.co.jp (black.imgsrc.co.jp [2001:218:422:2::130]) by white.imgsrc.co.jp (Postfix) with ESMTP id 8A2974116 for ; Thu, 31 Jul 2003 22:14:50 +0900 (JST) Received: from black.imgsrc.co.jp (black.imgsrc.co.jp [2001:218:422:2::130]) by black.imgsrc.co.jp (Postfix) with ESMTP id 59ECE1E460E for ; Thu, 31 Jul 2003 22:14:50 +0900 (JST) Date: Thu, 31 Jul 2003 22:14:50 +0900 Message-ID: <7mispisur9.wl@black.imgsrc.co.jp> From: Jun Kuriyama To: freebsd-hubs@freebsd.org In-Reply-To: <1059647755.21509.54.camel@blaz.medinet.si> References: <1059647755.21509.54.camel@blaz.medinet.si> User-Agent: Wanderlust/2.10.0 (Venus) SEMI/1.14.5 (Awara-Onsen) FLIM/1.14.5 (Demachiyanagi) APEL/10.4 Emacs/21.2 (i386--freebsd) MULE/5.0 (SAKAKI) MIME-Version: 1.0 (generated by SEMI 1.14.5 - "Awara-Onsen") Content-Type: text/plain; charset=US-ASCII X-Virus-Scanned: by AMaViS snapshot-20020531 Subject: Re: cvsup from ftp-master.cz.freebsd.org errors X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2003 13:14:54 -0000 At 31 Jul 2003 12:35:56 +0200, Blaz Zupan wrote: > Why is it trying to remove directories when they contain files? Hmm, I don't know why... > I tried removing all of the above directories plus their contents, but > on the next try cvsup brought back all the files and the above errors. Are you using -s option? -- Jun Kuriyama // IMG SRC, Inc. // FreeBSD Project From owner-freebsd-hubs@FreeBSD.ORG Thu Jul 31 09:00:52 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0818437B401 for ; Thu, 31 Jul 2003 09:00:52 -0700 (PDT) Received: from stingray.amis.net (stingray.amis.net [212.18.32.19]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4A4A243F93 for ; Thu, 31 Jul 2003 09:00:51 -0700 (PDT) (envelope-from blaz.zupan@amis.net) Received: from localhost (localhost [127.0.0.1]) by stingray.amis.net (Postfix) with ESMTP id 406123865FA for ; Thu, 31 Jul 2003 18:00:50 +0200 (CEST) Received: from stingray.amis.net ([127.0.0.1]) by localhost (stingray.amis.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id 36752-02-2 for ; Thu, 31 Jul 2003 18:00:49 +0200 (CEST) Received: from titanic.medinet.si (titanic.medinet.si [212.18.42.5]) by stingray.amis.net (Postfix) with ESMTP id BDE933865F6 for ; Thu, 31 Jul 2003 18:00:49 +0200 (CEST) Received: by titanic.medinet.si (Postfix, from userid 1000) id A2A3055540; Thu, 31 Jul 2003 18:00:49 +0200 (CEST) To: freebsd-hubs@freebsd.org Date: Thu, 31 Jul 2003 18:00:49 +0200 Message-Id: <20030731160049.A2A3055540@titanic.medinet.si> From: blaz.zupan@amis.net (Blaz Zupan) X-Virus-Scanned: by Amis Safe Mail Subject: Re: cvsup from ftp-master.cz.freebsd.org errors X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jul 2003 16:00:53 -0000 >> I tried removing all of the above directories plus their contents, but >> on the next try cvsup brought back all the files and the above errors. > > Are you using -s option? No, I'm running the cvsup with "cvsup -L 2 -g". The supfile looks like this: ----------------------- *default host=ftp-master.cz.FreeBSD.org *default base=/home/blaz/mirror *default prefix=/ftp/.1 *default delete use-rel-suffix *default umask=002 FreeBSD-archive release=all preserve ----------------------- Rudolf Cejka is already investigating. From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 05:44:37 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 285DE37B404 for ; Fri, 1 Aug 2003 05:44:37 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1747A43F75 for ; Fri, 1 Aug 2003 05:44:36 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h71CiZbr018956 for ; Fri, 1 Aug 2003 08:44:35 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h71CiZKr018955 for freebsd-hubs@freebsd.org; Fri, 1 Aug 2003 08:44:35 -0400 (EDT) Date: Fri, 1 Aug 2003 08:44:35 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030801124435.GB17790@electra.cse.Buffalo.EDU> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.1i Subject: FYI - ftp7.freebsd.org and ftpX.us.freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 12:44:37 -0000 Just FYI... We had several excellent candidates for ftp7.freebsd.org this time around. Those of you who were not chosen please do not be discouraged. We wanted another non-USA site this time to begin spreading things around a bit. In the end the decision was made based on ping-times from Buffalo, California, and Japan which is certainly not a perfect way to handle it but for now it will do. Thanks again to everyone who made the offer. As of last night the USA based ftpX.freebsd.org sites got copied so you are also ftpX.us.freebsd.org (where, for your site, X will be the same). For those of you who do carry the branches/ stuff, you should notice that it is now going away. It's not completely gone yet (still some stuff in branches/-current) but it should be soon. At this point I don't consider the Mirror Site Requirements discussion settled but I leave for a 1-week vacation tomorrow so that will be on hold for a while. It's not a huge rush - I just consider it part of that first assignment Jun gave me (update the hubs article) so I won't be done with my first task until that gets settled. I need to learn how to update the list of FTP mirrors in sysinstall anyway so I will probably invest some time in improving it. If nothing else I'd like to relax the "/pub/FreeBSD" thing to the point it is "desired" instead of "required". If doing more than just that doesn't seem too difficult maybe we can do something with the suggestion of setting up DNS to help locate the desired architectures. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 06:13:10 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C44BA37B401 for ; Fri, 1 Aug 2003 06:13:10 -0700 (PDT) Received: from mail.tcoip.com.br (erato.tco.net.br [200.220.254.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 517A243FBF for ; Fri, 1 Aug 2003 06:13:08 -0700 (PDT) (envelope-from dcs@tcoip.com.br) Received: from tcoip.com.br ([10.0.2.6]) by mail.tcoip.com.br (8.11.6/8.11.6) with ESMTP id h71DCwj07644; Fri, 1 Aug 2003 10:12:58 -0300 Message-ID: <3F2A6759.8040109@tcoip.com.br> Date: Fri, 01 Aug 2003 10:12:57 -0300 From: "Daniel C. Sobral" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.4) Gecko/20030702 X-Accept-Language: en-us, en, pt-br, ja MIME-Version: 1.0 To: Ken Smith References: <20030801124435.GB17790@electra.cse.Buffalo.EDU> In-Reply-To: <20030801124435.GB17790@electra.cse.Buffalo.EDU> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-hubs@freebsd.org Subject: Re: FYI - ftp7.freebsd.org and ftpX.us.freebsd.org X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 13:13:11 -0000 Ken, let me express my thanks for the great job you are doing. This was sorely needed. Ken Smith wrote: > Just FYI... > > We had several excellent candidates for ftp7.freebsd.org this time > around. Those of you who were not chosen please do not be discouraged. > We wanted another non-USA site this time to begin spreading things > around a bit. In the end the decision was made based on ping-times > from Buffalo, California, and Japan which is certainly not a perfect > way to handle it but for now it will do. Thanks again to everyone > who made the offer. > > As of last night the USA based ftpX.freebsd.org sites got copied so > you are also ftpX.us.freebsd.org (where, for your site, X will be the > same). > > For those of you who do carry the branches/ stuff, you should notice > that it is now going away. It's not completely gone yet (still some > stuff in branches/-current) but it should be soon. > > At this point I don't consider the Mirror Site Requirements discussion > settled but I leave for a 1-week vacation tomorrow so that will be on hold > for a while. It's not a huge rush - I just consider it part of that > first assignment Jun gave me (update the hubs article) so I won't be > done with my first task until that gets settled. I need to learn how > to update the list of FTP mirrors in sysinstall anyway so I will probably > invest some time in improving it. If nothing else I'd like to relax the > "/pub/FreeBSD" thing to the point it is "desired" instead of "required". > If doing more than just that doesn't seem too difficult maybe we can > do something with the suggestion of setting up DNS to help locate the > desired architectures. > -- Daniel C. Sobral (8-DCS) Gerencia de Operacoes Divisao de Comunicacao de Dados Coordenacao de Seguranca VIVO Centro Oeste Norte Fones: 55-61-313-7654/Cel: 55-61-9618-0904 E-mail: Daniel.Capo@tco.net.br Daniel.Sobral@tcoip.com.br dcs@tcoip.com.br Outros: dcs@newsguy.com dcs@freebsd.org capo@notorious.bsdconspiracy.net With every passing hour our solar system comes forty-three thousand miles closer to globular cluster M13 in the constellation Hercules, and still there are some misfits who continue to insist that there is no such thing as progress. -- Ransom K. Ferm From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 06:50:26 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CD0EC37B404 for ; Fri, 1 Aug 2003 06:50:26 -0700 (PDT) Received: from lurza.secnetix.de (mail2.secnetix.de [195.143.231.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0635D43F85 for ; Fri, 1 Aug 2003 06:50:23 -0700 (PDT) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (naxydi@localhost [127.0.0.1]) by lurza.secnetix.de (8.12.8p1/8.12.8) with ESMTP id h71DoJgC008434; Fri, 1 Aug 2003 15:50:19 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.12.8p1/8.12.8/Submit) id h71DoGO5008432; Fri, 1 Aug 2003 15:50:16 +0200 (CEST) From: Oliver Fromme Message-Id: <200308011350.h71DoGO5008432@lurza.secnetix.de> To: dan@langille.org (Dan Langille) Date: Fri, 1 Aug 2003 15:50:16 +0200 (CEST) In-Reply-To: <3F283725.11219.7DFB7A87@localhost> from "Dan Langille" at Jul 30, 2003 09:22:45 PM X-Mailer: ELM [version 2.5 PL3] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org cc: Garrett Wollman Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 13:50:27 -0000 Dan Langille wrote: > On 30 Jul 2003 at 14:19, Garrett Wollman wrote: > > < said: > > > 5) Will be given a "ftpX.CC.freebsd.org" hostname and will be a candidate > > > for becoming a "ftpX.freebsd.org" hostname. > > > > > 3) Will be given a "ftpX.CC.freebsd.org" name. > > > > I think that this would be more helpful if sites were categorized > > along a different axis: architecture. It doesn't make sense to > > require every primary mirror site everywhere in the world to carry > > every architecture. Few people outside of Japan, for example, have > > need of PC98 releases. Other places may want to cut out Alpha or > > sparc64 bits if those distributions are very infrequently downloaded. Sounds very reasonable. > That can be done with additional DNS zones can't it? Categorize them > by what they carry. To be honest, I don't really like the idea of bloating the DNS name space. Maybe I misunderstood the suggestion, but I think that -- for example -- ftp3.fr.i386.freebsd.org is just too complicated. Our DNS structure is already complex enough as it is. And such distinction would not indicate which releases and package sets the site carries. Does it have -current packages? Does it have ISOs, or only the FTP install directories? etc... A few months ago someone mentioned another idea on this list, which I would like to repeat. An automated mechanism could contact every FTP server (say, once per day) and check which collections that server is carrying, i.e. which releases and architectures, whether they have ISOs and the FTP install directories, and which package sets are there. That information would be collected and converted into a "survey" of all FreeBSD mirror sites. This file should be easy to parse. That survey would be put on the master FTP server, and _every_ mirror would be required to sync that particular file often enough (say, once per day). It could be called /pub/FreeBSD/.mirror-info or whatever. That way, every mirror -- no matter whether primary or secondary (or not even an official one) -- would carry a file describing all official mirrors of FreeBSD. Sysinstall could be taught to get that file, once the user has selected a mirror site, and verify that the site really contains what the user needs. If it doesn't, it should warn the user and suggest a list of alternative sites. The survey could also be automatically converted to some HTML table and put on the web site. A "README" file on the FTP servers should point to that URL, so users can find out where to get the ISOs (or whatever) that they want, if they can't get them on the server they're on. All of that might sound complicated, but it really isn't that bad. The collector can be a small shell script using /usr/bin/fetch or automated ncftp. The extension to sysinstall shouldn't be too difficult either. I would be willing to work on the collector thing at least, and maybe also on the sysinstall part (if time permits). The advantage would be that there is no need to change the DNS structure, and mirror maintainers would not have to do anything special, except for syncing that mirror-info file once per day (unless they're syncing everything daily anyway). Once the collector mechanism is in place, no additional maintenance would be necessary. Comments? Regards Oliver -- Oliver Fromme, secnetix GmbH & Co KG, Oettingenstr. 2, 80538 München Any opinions expressed in this message may be personal to the author and may not necessarily reflect the opinions of secnetix in any way. Encrypting transactions on the Internet is the equivalent of arranging an armored car to deliver credit-card information from someone living in a cardboard box to someone living on a park bench. -- Eugene Spafford (computer scientist, Purdue Univ.) From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 07:15:24 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A179637B401 for ; Fri, 1 Aug 2003 07:15:24 -0700 (PDT) Received: from bast.unixathome.org (bast.unixathome.org [66.11.174.150]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0DD2D43FBF for ; Fri, 1 Aug 2003 07:15:24 -0700 (PDT) (envelope-from dan@langille.org) Received: from wocker (wocker.unixathome.org [192.168.0.99]) by bast.unixathome.org (Postfix) with ESMTP id 898463D28; Fri, 1 Aug 2003 10:15:22 -0400 (EDT) From: "Dan Langille" To: Oliver Fromme Date: Fri, 01 Aug 2003 10:15:21 -0400 MIME-Version: 1.0 Message-ID: <3F2A3DB9.24118.85E550E3@localhost> Priority: normal In-reply-to: <200308011350.h71DoGO5008432@lurza.secnetix.de> References: <3F283725.11219.7DFB7A87@localhost> from "Dan Langille" at Jul 30, 2003 09:22:45 PM X-mailer: Pegasus Mail for Windows (v4.02a) Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: 7BIT Content-description: Mail message body cc: freebsd-hubs@freebsd.org Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 14:15:24 -0000 On 1 Aug 2003 at 15:50, Oliver Fromme wrote: > A few months ago someone mentioned another idea on this > list, which I would like to repeat. An automated mechanism > could contact every FTP server (say, once per day) and > check which collections that server is carrying, i.e. which > releases and architectures, whether they have ISOs and the > FTP install directories, and which package sets are there. > > That information would be collected and converted into a > "survey" of all FreeBSD mirror sites. This file should > be easy to parse. That survey would be put on the master > FTP server, and _every_ mirror would be required to sync > that particular file often enough (say, once per day). > It could be called /pub/FreeBSD/.mirror-info or whatever. You should see http://www.freebsdmirrors.org/ -- Dan Langille : http://www.langille.org/ From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 07:37:03 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4440037B404 for ; Fri, 1 Aug 2003 07:37:03 -0700 (PDT) Received: from mail.tcoip.com.br (erato.tco.net.br [200.220.254.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 17C0543F3F for ; Fri, 1 Aug 2003 07:37:01 -0700 (PDT) (envelope-from dcs@tcoip.com.br) Received: from tcoip.com.br ([10.0.2.6]) by mail.tcoip.com.br (8.11.6/8.11.6) with ESMTP id h71Eaaj10033; Fri, 1 Aug 2003 11:36:37 -0300 Message-ID: <3F2A7AF1.901@tcoip.com.br> Date: Fri, 01 Aug 2003 11:36:33 -0300 From: "Daniel C. Sobral" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.4) Gecko/20030702 X-Accept-Language: en-us, en, pt-br, ja MIME-Version: 1.0 To: Dan Langille References: <3F283725.11219.7DFB7A87@localhost> from "Dan Langille" at Jul 30, 2003 09:22:45 PM <3F2A3DB9.24118.85E550E3@localhost> In-Reply-To: <3F2A3DB9.24118.85E550E3@localhost> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-hubs@freebsd.org cc: Oliver Fromme Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 14:37:03 -0000 Dan Langille wrote: > On 1 Aug 2003 at 15:50, Oliver Fromme wrote: > > >>A few months ago someone mentioned another idea on this >>list, which I would like to repeat. An automated mechanism >>could contact every FTP server (say, once per day) and >>check which collections that server is carrying, i.e. which >>releases and architectures, whether they have ISOs and the >>FTP install directories, and which package sets are there. >> >>That information would be collected and converted into a >>"survey" of all FreeBSD mirror sites. This file should >>be easy to parse. That survey would be put on the master >>FTP server, and _every_ mirror would be required to sync >>that particular file often enough (say, once per day). >>It could be called /pub/FreeBSD/.mirror-info or whatever. > > > You should see http://www.freebsdmirrors.org/ It seems my country was somehow displaced. :-) -- Daniel C. Sobral (8-DCS) Gerencia de Operacoes Divisao de Comunicacao de Dados Coordenacao de Seguranca VIVO Centro Oeste Norte Fones: 55-61-313-7654/Cel: 55-61-9618-0904 E-mail: Daniel.Capo@tco.net.br Daniel.Sobral@tcoip.com.br dcs@tcoip.com.br Outros: dcs@newsguy.com dcs@freebsd.org capo@notorious.bsdconspiracy.net "If you've done six impossible things before breakfast, why not round it off with dinner at Milliway's, the restaurant at the end of the universe?" From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 07:44:31 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 98F7B37B401 for ; Fri, 1 Aug 2003 07:44:31 -0700 (PDT) Received: from electra.cse.Buffalo.EDU (electra.cse.Buffalo.EDU [128.205.32.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id D64EE43FBF for ; Fri, 1 Aug 2003 07:44:30 -0700 (PDT) (envelope-from kensmith@cse.Buffalo.EDU) Received: from electra.cse.Buffalo.EDU (kensmith@localhost [127.0.0.1]) h71EiUbr021701 for ; Fri, 1 Aug 2003 10:44:30 -0400 (EDT) Received: (from kensmith@localhost) by electra.cse.Buffalo.EDU (8.12.9/8.12.9/Submit) id h71EiU4p021700 for freebsd-hubs@freebsd.org; Fri, 1 Aug 2003 10:44:30 -0400 (EDT) Date: Fri, 1 Aug 2003 10:44:30 -0400 From: Ken Smith To: freebsd-hubs@freebsd.org Message-ID: <20030801144430.GM19180@electra.cse.Buffalo.EDU> References: <3F283725.11219.7DFB7A87@localhost> <3F2A3DB9.24118.85E550E3@localhost> <3F2A7AF1.901@tcoip.com.br> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F2A7AF1.901@tcoip.com.br> User-Agent: Mutt/1.4.1i Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 14:44:31 -0000 On Fri, Aug 01, 2003 at 11:36:33AM -0300, Daniel C. Sobral wrote: > Dan Langille wrote: > >You should see http://www.freebsdmirrors.org/ > > It seems my country was somehow displaced. :-) Just FYI, I started talking to the person who runs the site a couple of weeks ago. He is interested in working with us to update the tool a bit, he just needs to find the time. In a nutshell the current one relies on being able to do Zone Transfers (many Zone Admins are turning that off because it is among the current DNS security related recommendations) and searching for NS records (this isn't the case for you, but several of the zones are now non-delegated so they don't have NS records). He said he'll try to implement a new searching algorithm and expand the architectures it tracks. -- Ken Smith - From there to here, from here to | kensmith@cse.buffalo.edu there, funny things are everywhere. | - Theodore Geisel | From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 07:45:30 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 64FDE37B401 for ; Fri, 1 Aug 2003 07:45:30 -0700 (PDT) Received: from lurza.secnetix.de (mail2.secnetix.de [195.143.231.20]) by mx1.FreeBSD.org (Postfix) with ESMTP id 29A2643F93 for ; Fri, 1 Aug 2003 07:45:29 -0700 (PDT) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (hwnsps@localhost [127.0.0.1]) by lurza.secnetix.de (8.12.8p1/8.12.8) with ESMTP id h71EjRgC010583; Fri, 1 Aug 2003 16:45:27 +0200 (CEST) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.12.8p1/8.12.8/Submit) id h71EjQNq010582; Fri, 1 Aug 2003 16:45:26 +0200 (CEST) From: Oliver Fromme Message-Id: <200308011445.h71EjQNq010582@lurza.secnetix.de> To: dan@langille.org (Dan Langille) Date: Fri, 1 Aug 2003 16:45:26 +0200 (CEST) In-Reply-To: <3F2A3DB9.24118.85E550E3@localhost> from "Dan Langille" at Aug 01, 2003 10:15:21 AM X-Mailer: ELM [version 2.5 PL3] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 14:45:30 -0000 Dan Langille wrote: > On 1 Aug 2003 at 15:50, Oliver Fromme wrote: > > A few months ago someone mentioned another idea on this > > list, which I would like to repeat. An automated mechanism > > could contact every FTP server (say, once per day) and > > check which collections that server is carrying, i.e. which > > releases and architectures, whether they have ISOs and the > > FTP install directories, and which package sets are there. > > > > That information would be collected and converted into a > > "survey" of all FreeBSD mirror sites. This file should > > be easy to parse. That survey would be put on the master > > FTP server, and _every_ mirror would be required to sync > > that particular file often enough (say, once per day). > > It could be called /pub/FreeBSD/.mirror-info or whatever. > > You should see http://www.freebsdmirrors.org/ I know that one. It has some similarities to my suggestion, but it's not exactly the same. Regards Oliver -- Oliver Fromme, secnetix GmbH & Co KG, Oettingenstr. 2, 80538 München Any opinions expressed in this message may be personal to the author and may not necessarily reflect the opinions of secnetix in any way. Passwords are like underwear. You don't share them, you don't hang them on your monitor or under your keyboard, you don't email them, or put them on a web site, and you must change them very often. From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 09:30:09 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BF5AA37B401 for ; Fri, 1 Aug 2003 09:30:09 -0700 (PDT) Received: from coe.ufrj.br (roma.coe.ufrj.br [146.164.53.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id 752B543FDD for ; Fri, 1 Aug 2003 09:30:08 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from jonny.eng.br (RJ176082.user.veloxzone.com.br [200.149.176.82]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by coe.ufrj.br (Postfix) with ESMTP id 541DC57D832; Fri, 1 Aug 2003 13:29:59 -0300 (BRT) Message-ID: <3F2A9595.5010302@jonny.eng.br> Date: Fri, 01 Aug 2003 13:30:13 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Oliver Fromme References: <200308011350.h71DoGO5008432@lurza.secnetix.de> In-Reply-To: <200308011350.h71DoGO5008432@lurza.secnetix.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org cc: Garrett Wollman Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 16:30:10 -0000 Oliver Fromme wrote: > To be honest, I don't really like the idea of bloating the > DNS name space. Maybe I misunderstood the suggestion, but Agreed! > That way, every mirror -- no matter whether primary or > secondary (or not even an official one) -- would carry > a file describing all official mirrors of FreeBSD. ... > The survey could also be automatically converted to some > HTML table and put on the web site. A "README" file on > the FTP servers should point to that URL, so users can > find out where to get the ISOs (or whatever) that they > want, if they can't get them on the server they're on. I like this!!! > All of that might sound complicated, but it really isn't > that bad. The collector can be a small shell script using > /usr/bin/fetch or automated ncftp. The extension to > sysinstall shouldn't be too difficult either. I would be > willing to work on the collector thing at least, and maybe > also on the sysinstall part (if time permits). You should not need to get the files, only list them. Wouldn't this be much easier in perl? > The advantage would be that there is no need to change the > DNS structure, and mirror maintainers would not have to do > anything special, except for syncing that mirror-info file > once per day (unless they're syncing everything daily > anyway). Once the collector mechanism is in place, no > additional maintenance would be necessary. And this would allow the "tier 3" mirrors... Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington From owner-freebsd-hubs@FreeBSD.ORG Fri Aug 1 09:41:31 2003 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 152FD37B401 for ; Fri, 1 Aug 2003 09:41:31 -0700 (PDT) Received: from coe.ufrj.br (roma.coe.ufrj.br [146.164.53.65]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4BB7943F3F for ; Fri, 1 Aug 2003 09:41:30 -0700 (PDT) (envelope-from jonny@jonny.eng.br) Received: from jonny.eng.br (RJ176082.user.veloxzone.com.br [200.149.176.82]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by coe.ufrj.br (Postfix) with ESMTP id 6FABE57D832; Fri, 1 Aug 2003 13:41:27 -0300 (BRT) Message-ID: <3F2A9847.8090804@jonny.eng.br> Date: Fri, 01 Aug 2003 13:41:43 -0300 From: =?ISO-8859-1?Q?Jo=E3o_Carlos_Mendes_Lu=EDs?= User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: pt-br, en-us, en, pt MIME-Version: 1.0 To: Oliver Fromme References: <200308011445.h71EjQNq010582@lurza.secnetix.de> In-Reply-To: <200308011445.h71EjQNq010582@lurza.secnetix.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit cc: freebsd-hubs@freebsd.org Subject: Re: Requirements Final Draft Attempt #2 :-/ X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Aug 2003 16:41:31 -0000 Oliver Fromme wrote: > Dan Langille wrote: > > On 1 Aug 2003 at 15:50, Oliver Fromme wrote: > > > A few months ago someone mentioned another idea on this > > > list, which I would like to repeat. An automated mechanism > > > could contact every FTP server (say, once per day) and > > > check which collections that server is carrying, i.e. which > > > releases and architectures, whether they have ISOs and the > > > FTP install directories, and which package sets are there. > > > > > > That information would be collected and converted into a > > > "survey" of all FreeBSD mirror sites. This file should > > > be easy to parse. That survey would be put on the master > > > FTP server, and _every_ mirror would be required to sync > > > that particular file often enough (say, once per day). > > > It could be called /pub/FreeBSD/.mirror-info or whatever. > > > > You should see http://www.freebsdmirrors.org/ > > I know that one. It has some similarities to my suggestion, > but it's not exactly the same. 1) Does not allow for sites off-DNS, currently 2) It's outside FreeBSD.org control. We could use help or ideas from him, but not implement the same way. I prefer Oliver's. It's more powerful, distributed, reliable and automated. Jonny -- João Carlos Mendes Luís - Networking Engineer - jonny@jonny.eng.br -- "the West won the world not by the superiority of its ideas or values or religion but rather by its superiority in applying organized violence. Westerners often forget this fact, non-Westerners never do." -- Samuel P. Huntington