From owner-freebsd-hubs@FreeBSD.ORG Tue Feb 21 15:29:59 2012 Return-Path: Delivered-To: hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2B31F106566B; Tue, 21 Feb 2012 15:29:59 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [IPv6:2a01:170:102f::2]) by mx1.freebsd.org (Postfix) with ESMTP id 68B358FC15; Tue, 21 Feb 2012 15:29:58 +0000 (UTC) Received: from lurza.secnetix.de (localhost [127.0.0.1]) by lurza.secnetix.de (8.14.3/8.14.3) with ESMTP id q1LFTeMg033737; Tue, 21 Feb 2012 16:29:55 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.14.3/8.14.3/Submit) id q1LFTeSd033735; Tue, 21 Feb 2012 16:29:40 +0100 (CET) (envelope-from olli) From: Oliver Fromme Message-Id: <201202211529.q1LFTeSd033735@lurza.secnetix.de> To: pfmeec@rit.edu (Paul Mezzanini) Date: Tue, 21 Feb 2012 16:29:40 +0100 (CET) In-Reply-To: X-Mailer: ELM [version 2.5 PL8] MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.3.9 (lurza.secnetix.de [127.0.0.1]); Tue, 21 Feb 2012 16:29:56 +0100 (CET) Cc: "hubs@FreeBSD.org" Subject: Re: Query about the usage of FreeBSD mirror sites for other projects X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Feb 2012 15:29:59 -0000 Paul Mezzanini wrote: > The real issue is what if FreeBSD relies on a package that Gentoo has in > the mirror structure and then Gentoo prunes it out. (Examples only, feel > free to change the project names to any that fit your mental model) > > I wonder how useful a setup would be that is just a giant bucket for all > project to pull from. It has the potential to be great but also horrible. Ultimately, it would be cool to have a more flexible and dynamic system for distfiles. Clients wouldn't download directly from certain FTP mirrors anymore, but they would contact an "index server". The index servers maintain a list of locations where each distfile can be found, similar to a very specialized search engine. These locations can be FreeBSD mirrors or mirrors of other projects (Debian, Gentoo, whatever) or just random sites anywhere on the internet. The "MASTER_SITES" information currently contained in the ports' Makefiles will be moved to the index servers. Either the index server returns a list of locations back to the client (just like a search engine), so the client can choose to download from one of them. Or, alternatively, the index server also acts as a proxy, so it fetches the distfile from one of the known locations and hands it to the client. In this case it might also make sense to cache the distfiles on the index server for a limited time (depending on how often this file is requested, or its size). I'm aware that such a system would require quite some work. It's just an idea that came to my mind, but maybe it's worth further investigation. Maybe it should get an entry on FreeBSD's "project ideas" page. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "The ITU has offered the IETF formal alignment with its corresponding technology, Penguins, but that won't fly." -- RFC 2549