From owner-freebsd-arm@freebsd.org Sat Dec 22 20:55:15 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 15C06133B53C for ; Sat, 22 Dec 2018 20:55:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic302-4.consmr.mail.bf2.yahoo.com (sonic302-4.consmr.mail.bf2.yahoo.com [74.6.135.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B050A70EE3 for ; Sat, 22 Dec 2018 20:55:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: mjQfKEYVM1lsrsdyiMPPDCkli3aEH.Yuf7qioAg3skUY.gCb2Nm1DVGEWO56t7c iGeEt8l0DfoYmqIpUfwn4OEN7I60FOQ8yqqIIqdhKBG3zXtbp71ofmJtc0P9GBTsvxgliAzPQq.p e87cWjEhif1hrQ8hqII1oVQLCR2Y_MZfDqmpCdNI8oeGbidGVCj1ha0SHBFhPDN5v.6V1egfJVi6 8xhB.1UZQCeU9N4w.dmSBAKjmJuZ5p1tUaUDTEENll8bHjdj3N9DCsHg6UdBFiOKHs80XXDuZhGQ 2uPooOdlI3HcUoz9O1SfylyS_X2Yj5NfShYCmx9vYRxQN0clEdifgIqKj30X5b47xCrLs6inrWaA pMc_GSqnYkSzGI9el5xB1DuH0YUlLB2zAj7WHb4Q6Wot7cw3DMl0cMS3m.I4s9bbaqNBhfE76guh bg9VqbkZueo4.VEnA5i55RBkl1UtlCsyerqEmcIpjLI.6PgtldGwC0KxAvOhieXCn_Xe11jE31n0 uvu0KAxzwAeFAWiyP4I9lEA6aVIE30Ej8W8PFApp4ui_DjoS.7JdJrHqYNDiVPodPxRX2rNW1Fon y15X1jSCYBKoHMMNClnSugJ8vIzKaQSKM2czmNjbITfcO4a3w5owQSW3swVOSdHtV4OoHfsVJNiE O13k7unOMHBsVKvexX92o9LWV4VrhVX5BohQAvYLODpz3VRfQGTxeWb364sI5ArOx9q9Yt3POnWJ bOV5GNUVfGhfPUf53xTtMh393UxQdGHALw8UwmlMRKBN7q6.y6r.Xh14VWSUPp3uKWKRrAkN.Kf4 q5rx4_SLYgqC.6mi4Z4KFBO8DnDdGJovMvlItS1b0QsAXO042PwcaAGHL3TxVz9tQhpG6_nwwaJo qLNxPDwKRVBiu3Eg.sLo7x8ZpE48HfeeofUafDF8EEFeGxy5KqEAKbvKYh5bYQXeajpLACOxClTK QZS.2vYR0c0PFBhEH3orZe9gJRYu4Z2aHm1EUGWIPsACLnRuqsnp0ZS.x3hv2jG.3QFGcIpyDQGJ jyTD0sCq6xeaIdeITDaemPC_5w1_HNTso4OgkkrAYpSq9hm9fn.ivRJiHVsNtaKPdlqSXTgl80RC cOmRjvQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic302.consmr.mail.bf2.yahoo.com with HTTP; Sat, 22 Dec 2018 20:55:12 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp410.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID e33a5e5a027923209050fbcb65b80ac5; Sat, 22 Dec 2018 20:55:10 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> Date: Sat, 22 Dec 2018 12:55:07 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: B050A70EE3 X-Spamd-Bar: / X-Spamd-Result: default: False [0.69 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.35)[-0.347,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.69)[0.686,0]; NEURAL_HAM_LONG(-0.71)[-0.706,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.57)[ip: (5.00), ipnet: 74.6.128.0/21(1.62), asn: 26101(1.30), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[43.135.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2018 20:55:15 -0000 [I found my E-mail records reporting successful builds using qemu-user-static from ports head -r484783 under FreeBSD head -r340287.] On 2018-Dec-22, at 00:10, Mark Millard wrote: > [I messed up the freebsd-emulation email address the first time I sent > this. I also forgot to indicate the qemu-user-static vintage = relationship.] >=20 > I had been reporting intermittent hang-ups for my = amd64->{aarch64,armv7} port cross > builds in another message sequence. But it turns out that one thing I = ran into > has hung-up every time, the same way, for amd64->armv7 cross builds: > multimedia/gstreamer1-qt@qt5 . So I extract the material here into a = separate report > with some updated notes. >=20 > A little context: I had built from ports head -r484783 before under = FreeBSD head > -r340287 (as I remember the version). Back then it did not have this = problem that it > now has under FreeBSD head -r341836 . One ports-specific change was to = force perl5.28 > as the default instead of perl5.26 originally. In fact this is what = drives what is > being rebuilt for my experiment that caught this. But I doubt the perl = version is > important to the problem. The context has a Ryzen Threadripper 1950X = and has been > tested both for FreeBSD under Hyper-V and for the same media = native-booted. Both > hang-up at the same point as seen via ps or top. The native tools for = cross-build > speedup were in use. Cross-builds targeting aarch64 did not get this = problem but > targeting armv7 did. 121 of 129 armv7 ports built before the hang-up = for the first > armv7 try. >=20 > ADDED: The qemu-user-static back with head -r340287 before installing = the > updated ports would likely be different than the -r484783 vintage. So = both > FreeBSD and qemu-user-static may have changed over the comparison. CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful = cross-builds based on qemu-user-static from ports head -484783 --all built under = FreeBSD head -r340287 . So the use of the perl5.28 as the forced-default and the newer FreeBSD head version -r341836 as the context are the differences = here. > The hang-up: >=20 > In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 = hung-up and timed > out. Looking during the wait in later tries shows something much like = (from one of the > examples): >=20 > root 33719 0.0 0.0 12920 3528 0 I 11:40 0:00.03 = | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) > root 41551 0.0 0.0 12920 3520 0 I 11:43 0:00.00 = | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) > root 41552 0.0 0.0 10340 1744 0 IJ 11:43 0:00.01 = | | `-- /usr/bin/make -C = /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 build > root 41566 0.0 0.0 10236 1796 0 IJ 11:43 0:00.00 = | | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE > root 41567 0.0 0.0 89976 12896 0 IJ 11:43 0:00.07 = | | `-- /usr/local/bin/qemu-arm-static ninja -j28 -v = all > root 41585 0.0 0.0 102848 25056 0 IJ 11:43 0:00.10 = | | |-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g > root 41586 0.0 0.0 102852 25072 0 IJ 11:43 0:00.11 = | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >=20 > or as top showed it: >=20 > 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 = 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 = build > 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 = 0.00% /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELECT=3Dqt5 QMAKEMODULES > 41567 root 2 52 0 88M 13M 0 select 4 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all > 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. > 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >=20 > So: waiting in kqread trying to run cmake. >=20 > Unlike some intermittent hang-ups, attaching-then-detaching via gdb = does not > resume the hung-up processes. Kills of the processes waiting on kqread = stop > the build. >=20 > Given the prior ports have been built already, building just > multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same point. >=20 > Building anything that requires multimedia/gstreamer1-qt@qt5 seems to = be > solidly blocked in my environment. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)