From owner-freebsd-ports@FreeBSD.ORG Thu Apr 12 15:46:54 2007 Return-Path: X-Original-To: ports@freebsd.org Delivered-To: freebsd-ports@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9DCE316A407 for ; Thu, 12 Apr 2007 15:46:54 +0000 (UTC) (envelope-from rnoland@2hip.net) Received: from gizmo.2hip.net (gizmo.2hip.net [64.74.207.195]) by mx1.freebsd.org (Postfix) with ESMTP id 67FFC13C489 for ; Thu, 12 Apr 2007 15:46:54 +0000 (UTC) (envelope-from rnoland@2hip.net) Received: from [63.251.67.21] (rnoland-ibm.acs.internap.com [63.251.67.21]) (authenticated bits=0) by gizmo.2hip.net (8.13.8/8.13.8) with ESMTP id l3CFWZki046269 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO); Thu, 12 Apr 2007 11:32:35 -0400 (EDT) (envelope-from rnoland@2hip.net) From: Robert Noland To: Benjamin Lutz In-Reply-To: <200704120543.53063.mail@maxlor.com> References: <200704100452.40574.mail@maxlor.com> <1176227087.27233.8.camel@ikaros.oook.cz> <200704120543.53063.mail@maxlor.com> Content-Type: text/plain; charset=iso-8859-2 Date: Thu, 12 Apr 2007 11:32:30 -0400 Message-Id: <1176391950.1820.3.camel@rnoland-ibm.acs.internap.com> Mime-Version: 1.0 X-Mailer: Evolution 2.10.0 FreeBSD GNOME Team Port Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.9 required=5.0 tests=AWL,BAYES_00,INFO_TLD autolearn=no version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on gizmo.2hip.net Cc: ports@freebsd.org, pav@freebsd.org Subject: Re: parallel builds revisited X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Apr 2007 15:46:54 -0000 On Thu, 2007-04-12 at 05:43 +0200, Benjamin Lutz wrote: > Hello Pav, > > On Tuesday 10 April 2007 19:44, Pav Lucistnik wrote: > > Benjamin Lutz píše v út 10. 04. 2007 v 04:52 +0200: > > > Some time ago, after buying a Core 2 Duo system, I've become > > > interested in doing something about the inherent > > > single-threadedness of the ports. Even though I have a dualcore > > > machine, ports builds only ever use one core. I started thinking > > > about various approaches to introduce parallelism to ports builds > > > and wrote down my thoughts here: > > > http://marc.info/?l=freebsd-ports&m=116124997126657&w=2 > > > > I have same thoughts, and I wrote about it on Project Ideas page. > > That text materialized into a Summer of Code proposal, which is most > > probably going to get funded. So stay tuned. However, the proposal > > concentrates mainly on allowing several ports to build in parallel. Have any of you looked at sysutils/bsdadminscripts, it's buildflags options allow for parallel builds as well as ccache / distcc use. I have a reasonable list of ports that must have some or all of these options disabled as well. robert. > Is there any detailed information available on what's planned here that > isn't in your description on SoC page? > > > Yes, a whitelist approach looks best. > > > > > 3) Save this to /usr/local/etc/parallel_builds.conf: > > > http://www.maxlor.com/temp/parallel_builds.conf . > > > This is a list of ports as stored in PKGORIGIN, or as > > > pkg_info -o reports them. > > > > I was thinking about having it embedded in every port's Makefile > > directly, instead. Something like > > > > USE_MAKE_JOBS= 2 > > Yes, that's what I had in mind as a final goal too. Having a single file > whitelist is useful though, since you don't have to patch hundreds of > makefiles while the whole thing is being tested and developed. > > > I have great interest in this development. This is a highly desirable > > feature to have. > > Me too. Could you keep me in the loop on how the SoC project progresses? > Seeing how that's concentrating on inter-port-parallelism, I think I'll > continue to work on intra-port-parallelism for a bit. > > Cheers > Benjamin