From owner-freebsd-ports Fri Jun 1 4:46:22 2001 Delivered-To: freebsd-ports@freebsd.org Received: from heinz.jollem.com (c104187.upc-c.chello.nl [212.187.104.187]) by hub.freebsd.org (Postfix) with ESMTP id 2572A37B423; Fri, 1 Jun 2001 04:46:18 -0700 (PDT) (envelope-from ernst@heinz.jollem.com) Received: (from ernst@localhost) by heinz.jollem.com (8.11.3/8.11.3) id f51Biag21277; Fri, 1 Jun 2001 13:44:36 +0200 (CEST) (envelope-from ernst) Date: Fri, 1 Jun 2001 13:44:36 +0200 From: Ernst de Haan To: George Reid Cc: ports@FreeBSD.org Subject: Re: Supporting pkg-plist.gz ? Message-ID: <20010601134436.C15784@c187104187.telekabel.chello.nl> References: <20010601131703.B15784@c187104187.telekabel.chello.nl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: ; from greid@FreeBSD.org on Fri, Jun 01, 2001 at 12:32:49PM +0100 Sender: owner-freebsd-ports@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Hi George, > > Then perhaps we can separate the distribution and the local storage format? > > That's a possibility. However, if the local storage format and the > distribution format differ, there must exist some method of converting > between one and the other. CVSup could learn how to support > locally-compressed files, or a script could be run before CVSup to > decompress all plist files and then recompress them afterwards. I'm not > sure this idea would work very well, but I'm open to suggestions/comments. Decompressing all pkg-plist files on forehand doesn't sound like a good idea, since the other approach supports a multi-threaded/processing approach. The performance will in my expectation be much higher, since downloading is typically much slower than (de)compressing for the size of files we are talking about (between 1K and 1M). If CVSup would support locally compressed files, then supporting gzipped pkg-* files would be a trivial change. =) Perhaps I/we should talk to the CVSup developers and ask their opinion. > The other possibility of supporting compressed plist files (apart from > gzip) is some sort of custom ASCII tokenisation (i.e. replace all > instances of "share/doc/foo/bar/" with "A" and list this substitution > at the top of the plist). This method would enable the size of plist files > to be reduced without worrying about repository bloat. Comments? This sounds like a fairly good idea. If we could use `standard' tools for this then that would be the best solution, IMO. /Ernst -- Ernst de Haan Java Architect Jollem Information Technology "Come to me all who are weary and burdened and I will give you rest" -- Jesus Christ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-ports" in the body of the message