From owner-freebsd-ports@freebsd.org Wed Dec 23 01:40:07 2020 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 20B774CEF25 for ; Wed, 23 Dec 2020 01:40:07 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Received: from phouka1.phouka.net (phouka1.phouka.net [107.170.196.116]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "phouka.net", Issuer "Go Daddy Secure Certificate Authority - G2" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4D0wr62N7kz3QTc for ; Wed, 23 Dec 2020 01:40:06 +0000 (UTC) (envelope-from warlock@phouka1.phouka.net) Received: from phouka1.phouka.net (localhost [127.0.0.1]) by phouka1.phouka.net (8.16.1/8.16.1) with ESMTPS id 0BN1cgdh043216 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 22 Dec 2020 17:38:42 -0800 (PST) (envelope-from warlock@phouka1.phouka.net) Received: (from warlock@localhost) by phouka1.phouka.net (8.16.1/8.16.1/Submit) id 0BN1cfDW043215; Tue, 22 Dec 2020 17:38:41 -0800 (PST) (envelope-from warlock) Date: Tue, 22 Dec 2020 17:38:41 -0800 From: John Kennedy To: Christian Ullrich Cc: FreeBSD Subject: Re: Build errors in Python packages with compiled extensions Message-ID: References: <992979af-a6e1-20b5-cfe1-c4538728036b@chrullrich.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4D0wr62N7kz3QTc X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of warlock@phouka1.phouka.net has no SPF policy when checking 107.170.196.116) smtp.mailfrom=warlock@phouka1.phouka.net X-Spamd-Result: default: False [-1.80 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[107.170.196.116:from]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[phouka.net]; AUTH_NA(1.00)[]; SPAMHAUS_ZRD(0.00)[107.170.196.116:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[warlock@phouka.net,warlock@phouka1.phouka.net]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:14061, ipnet:107.170.192.0/18, country:US]; FROM_NEQ_ENVFROM(0.00)[warlock@phouka.net,warlock@phouka1.phouka.net]; MAILMAN_DEST(0.00)[freebsd-ports]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Dec 2020 01:40:07 -0000 On Tue, Dec 22, 2020 at 05:25:41PM -0800, John Kennedy wrote: > On Tue, Dec 22, 2020 at 08:47:35PM +0100, Christian Ullrich wrote: > > Hello, > > > > I have started to notice poudriere builds of Python ports with compiled extensions failing: > > > > [00:00:11] /usr/bin/strip /wrkdirs/usr/ports/devel/py-cffi/work-py38/stage/usr/local/lib/python3.8/site-packages/_cffi_backend.so > > [00:00:11] strip: open /wrkdirs/usr/ports/devel/py-cffi/work-py38/stage/usr/local/lib/python3.8/site-packages/_cffi_backend.so failed: No such file or directory > > > > The reason is that setuptools puts a version tag (aka cache tag) into the .so's name; in this case it is actually _cffi_backend.cpython-38.so . The strip command, on the other hand, is in the port Makefile's post-install target and has the file name as above, without the version. > > > > This tag is to be available in Uses/python.mk as $PYMAGICTAG, e.g. "cpython-38". > > > > I'm not sure whether I'm not doing something wrong that causes the tag to end up in the .so file names. The last update to devel/py-setuptools was a while ago (to 44.0 in January 2020), and someone would probably have noticed since. On the other hand, this _is_ poudriere, so the build environments are pretty well isolated. > > > > Anyone know what is going on? > > Not just you. As soon as I upgraded python38 from 3.8.6_1 -> 3.8.7, I ran > into the same kind of problems... my local poudriere build failed 7 python > packages and skipped another 96. I don't have the exact same setup, but it > happened on both -CURRENT and releng/12.2. > > So, ports rev 558913 ~Tue Dec 22 14:58:05 2020 +0000. > > I opened up bug 252057. As a follow-up to myself, it looks like I did a upgrade pass ~11:08 (my TZ, PST8PDT) which was fine and then a pass ~14:42 where pkg (1.16.0) and python38 got upgraded. Now, packages that get upgraded seem to be a subset of what got built, so it's possible that something else in the same pass might be at fault. Just looking at the dates in my poudriere package stash might help someone way more python-savvy than I: 8585 -rw-r--r-- 1 nobody wheel 8713736 Dec 22 14:33 pkg-1.16.0.txz 17553 -rw-r--r-- 1 nobody wheel 17841384 Dec 22 14:35 python38-3.8.7.txz 649 -rw-r--r-- 1 nobody wheel 527536 Dec 22 14:35 py38-setuptools-44.0.0.txz 265 -rw-r--r-- 1 nobody wheel 168752 Dec 22 14:35 py38-pycparser-2.20.txz 21 -rw-r--r-- 1 nobody wheel 19664 Dec 22 14:35 py38-six-1.15.0.txz 101 -rw-r--r-- 1 nobody wheel 100440 Dec 22 14:35 ninja-1.10.2,2.txz 265 -rw-r--r-- 1 nobody wheel 141576 Dec 22 14:35 py38-certifi-2020.12.5.txz 25 -rw-r--r-- 1 nobody wheel 24492 Dec 22 14:35 py38-pysocks-1.7.1.txz 69 -rw-r--r-- 1 nobody wheel 65712 Dec 22 14:36 py38-idna-2.10.txz 265 -rw-r--r-- 1 nobody wheel 161056 Dec 22 14:36 py38-pytz-2020.1,1.txz 5001 -rw-r--r-- 1 nobody wheel 4988776 Dec 22 14:36 git-2.29.2.txz 113 -rw-r--r-- 1 nobody wheel 111728 Dec 22 14:36 py38-pyparsing-2.4.7.txz 1161 -rw-r--r-- 1 nobody wheel 1059760 Dec 22 14:36 meson-0.56.0.txz 265 -rw-r--r-- 1 nobody wheel 155488 Dec 22 14:36 py38-chardet-3.0.4_3.txz 9 -rw-r--r-- 1 nobody wheel 6212 Dec 22 14:36 py38-imagesize-1.1.0.txz 5129 -rw-r--r-- 1 nobody wheel 5224196 Dec 22 14:36 py38-Babel-2.8.0.txz 21 -rw-r--r-- 1 nobody wheel 19760 Dec 22 14:36 py38-sphinxcontrib-qthelp-1.0.3.txz 57 -rw-r--r-- 1 nobody wheel 54436 Dec 22 14:36 py38-packaging-20.8.txz 25 -rw-r--r-- 1 nobody wheel 22616 Dec 22 14:36 py38-sphinxcontrib-htmlhelp-1.0.3.txz 17 -rw-r--r-- 1 nobody wheel 15900 Dec 22 14:36 py38-sphinxcontrib-devhelp-1.0.2.txz 21 -rw-r--r-- 1 nobody wheel 17508 Dec 22 14:36 py38-sphinxcontrib-serializinghtml-1.1.4.txz 1929 -rw-r--r-- 1 nobody wheel 1935412 Dec 22 14:37 py38-cython-0.29.21.txz 7561 -rw-r--r-- 1 nobody wheel 7645180 Dec 22 14:37 vim-8.2.2072.txz 1289 -rw-r--r-- 1 nobody wheel 1289680 Dec 22 14:37 py38-pygments-2.7.2.txz 9 -rw-r--r-- 1 nobody wheel 6088 Dec 22 14:37 py38-sphinxcontrib-jsmath-1.0.1.txz 25 -rw-r--r-- 1 nobody wheel 21364 Dec 22 14:37 py38-sphinxcontrib-applehelp-1.0.2.txz 17 -rw-r--r-- 1 nobody wheel 15764 Dec 22 14:37 py38-alabaster-0.7.6.txz 649 -rw-r--r-- 1 nobody wheel 650632 Dec 22 14:37 py38-future-0.18.2.txz 85 -rw-r--r-- 1 nobody wheel 82784 Dec 22 14:37 py38-beaker-1.11.0.txz 85 -rw-r--r-- 1 nobody wheel 84420 Dec 22 14:37 py38-CommonMark-0.9.1.txz 65 -rw-r--r-- 1 nobody wheel 63344 Dec 22 14:37 py38-pyudev-0.22.0.txz 49 -rw-r--r-- 1 nobody wheel 47528 Dec 22 14:37 py38-evdev-1.3.0.txz 129 -rw-r--r-- 1 nobody wheel 131064 Dec 22 14:37 py38-ply-3.11.txz 777 -rw-r--r-- 1 nobody wheel 672816 Dec 22 14:38 py38-docutils-0.15.2.txz 3337 -rw-r--r-- 1 nobody wheel 3324728 Dec 22 14:38 glib-2.66.4,1.txz 265 -rw-r--r-- 1 nobody wheel 168040 Dec 22 14:38 dbus-glib-0.110.txz 1801 -rw-r--r-- 1 nobody wheel 1824280 Dec 22 14:39 vala-0.48.10,1.txz 1161 -rw-r--r-- 1 nobody wheel 1133744 Dec 22 14:40 cairo-1.16.0_1,3.txz 21 -rw-r--r-- 1 nobody wheel 20464 Dec 22 14:40 wpebackend-fdo-1.4.1.txz 49 -rw-r--r-- 1 nobody wheel 45580 Dec 22 14:40 desktop-file-utils-0.26.txz 2441 -rw-r--r-- 1 nobody wheel 2472920 Dec 22 14:40 qt5-core-5.15.2.txz 57 -rw-r--r-- 1 nobody wheel 55668 Dec 22 14:40 enchant2-2.2.3_4.txz 1161 -rw-r--r-- 1 nobody wheel 1091032 Dec 22 14:41 poppler-20.12.1.txz 521 -rw-r--r-- 1 nobody wheel 395792 Dec 22 14:41 frei0r-1.6.1.txz 45 -rw-r--r-- 1 nobody wheel 43052 Dec 22 14:42 liblqr-1-0.4.2.txz 649 -rw-r--r-- 1 nobody wheel 558280 Dec 22 14:42 qt5-network-5.15.2_1.txz 393 -rw-r--r-- 1 nobody wheel 298024 Dec 22 14:42 qt5-dbus-5.15.2_1.txz