From owner-freebsd-ports@FreeBSD.ORG Tue Apr 10 17:44:58 2007 Return-Path: X-Original-To: ports@FreeBSD.org Delivered-To: freebsd-ports@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B0EFE16A402 for ; Tue, 10 Apr 2007 17:44:58 +0000 (UTC) (envelope-from pav@FreeBSD.org) Received: from raven.customer.vol.cz (raven.customer.vol.cz [195.250.144.108]) by mx1.freebsd.org (Postfix) with ESMTP id 2484C13C459 for ; Tue, 10 Apr 2007 17:44:57 +0000 (UTC) (envelope-from pav@FreeBSD.org) Received: from [192.168.0.23] (r3b159.net.upc.cz [213.220.193.159]) (authenticated bits=0) by raven.customer.vol.cz (8.13.6/8.13.6) with ESMTP id l3AHimgQ040241 (version=TLSv1/SSLv3 cipher=RC4-MD5 bits=128 verify=NO); Tue, 10 Apr 2007 19:44:49 +0200 (CEST) (envelope-from pav@FreeBSD.org) From: Pav Lucistnik To: Benjamin Lutz In-Reply-To: <200704100452.40574.mail@maxlor.com> References: <200704100452.40574.mail@maxlor.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-eNngAbpp4A7dbewPFXHm" Date: Tue, 10 Apr 2007 19:44:47 +0200 Message-Id: <1176227087.27233.8.camel@ikaros.oook.cz> Mime-Version: 1.0 X-Mailer: Evolution 2.10.0 FreeBSD GNOME Team Port X-Spam-Score: -1.688 () AWL,BAYES_00,INFO_TLD X-Scanned-By: MIMEDefang 2.61 on 195.250.144.108 X-Milter: Spamilter (Reciever: raven.customer.vol.cz; Sender-ip: 213.220.193.159; Sender-helo: [192.168.0.23]; ) Cc: ports@FreeBSD.org Subject: Re: parallel builds revisited X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pav@FreeBSD.org List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Apr 2007 17:44:58 -0000 --=-eNngAbpp4A7dbewPFXHm Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: quoted-printable Benjamin Lutz p=ED=B9e v =FAt 10. 04. 2007 v 04:52 +0200: > Some time ago, after buying a Core 2 Duo system, I've become interested=20 > in doing something about the inherent single-threadedness of the ports.=20 > Even though I have a dualcore machine, ports builds only ever use one=20 > core. I started thinking about various approaches to introduce=20 > parallelism to ports builds and wrote down my thoughts here: > http://marc.info/?l=3Dfreebsd-ports&m=3D116124997126657&w=3D2 I have same thoughts, and I wrote about it on Project Ideas page. That text materialized into a Summer of Code proposal, which is most probably going to get funded. So stay tuned. However, the proposal concentrates mainly on allowing several ports to build in parallel. > Well, since then I've tinkered with various approaches. I concentrated=20 > on using make's -j feature. After adding the flag to the gmake=20 > invocation in bsd.port.mk, I quickly noticed that some ports can take=20 > advantage of the flag and thus build much more quickly (eg, all the KDE=20 > ports),=20 Because they use gmake > others are still single-threaded (X.org),=20 Because they use imake > but of course there are also ports that fail to build (Openoffice.org).=20 Now that means nothing :) > This means that a per-port switch is required. Yes, a whitelist approach looks best. > 3) Save this to /usr/local/etc/parallel_builds.conf: > http://www.maxlor.com/temp/parallel_builds.conf . > This is a list of ports as stored in PKGORIGIN, or as > pkg_info -o reports them. I was thinking about having it embedded in every port's Makefile directly, instead. Something like USE_MAKE_JOBS=3D 2 > So now I would like to invite you test, comment, or simply philosophize=20 > on these changes. I have great interest in this development. This is a highly desirable feature to have. --=20 Pav Lucistnik Linux is a happy free-for-all chaos. --=-eNngAbpp4A7dbewPFXHm Content-Type: application/pgp-signature; name=signature.asc Content-Description: Toto je =?UTF-8?Q?digit=C3=A1ln=C4=9B?= =?ISO-8859-1?Q?_podepsan=E1?= =?UTF-8?Q?_=C4=8D=C3=A1st?= =?ISO-8859-1?Q?_zpr=E1vy?= -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQBGG80MntdYP8FOsoIRAk7+AJ4z6Vqpo1Pqgi4dqW0O2CjjjfGRoACgtLFd CxX7r6UX4+D5LMbuOk6z1SA= =RO4p -----END PGP SIGNATURE----- --=-eNngAbpp4A7dbewPFXHm--