From owner-freebsd-toolchain@freebsd.org Sun Dec 23 10:32:51 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C80AD1355AA5 for ; Sun, 23 Dec 2018 10:32:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6093F6D530 for ; Sun, 23 Dec 2018 10:32:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 1E30A1355AA4; Sun, 23 Dec 2018 10:32:51 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0CAD21355AA3 for ; Sun, 23 Dec 2018 10:32:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9F6CA6D52F for ; Sun, 23 Dec 2018 10:32:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E1A50D610 for ; Sun, 23 Dec 2018 10:32:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBNAWnB4094491 for ; Sun, 23 Dec 2018 10:32:49 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBNAWn3X094490 for toolchain@FreeBSD.org; Sun, 23 Dec 2018 10:32:49 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234291] LLVM does not support CPU feature detection on non-x86 platforms Date: Sun, 23 Dec 2018 10:32:50 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: greg@unrelenting.technology X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2018 10:32:51 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234291 Greg V changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |toolchain@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-toolchain@freebsd.org Sun Dec 23 20:57:31 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7A2BB13477F4 for ; Sun, 23 Dec 2018 20:57:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 104788DA00 for ; Sun, 23 Dec 2018 20:57:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id C881813477EC; Sun, 23 Dec 2018 20:57:30 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6E4F13477E6 for ; Sun, 23 Dec 2018 20:57:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 552BF8D9FA for ; Sun, 23 Dec 2018 20:57:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 91F43130F8 for ; Sun, 23 Dec 2018 20:57:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBNKvTj7011878 for ; Sun, 23 Dec 2018 20:57:29 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBNKvTeS011877 for toolchain@FreeBSD.org; Sun, 23 Dec 2018 20:57:29 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234291] LLVM does not support CPU feature detection on non-x86 platforms Date: Sun, 23 Dec 2018 20:57:29 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Dec 2018 20:57:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234291 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |toolchain@FreeBSD.org CC|toolchain@FreeBSD.org |brooks@FreeBSD.org, | |dim@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-toolchain@freebsd.org Mon Dec 24 07:28:16 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CD660135995C for ; Mon, 24 Dec 2018 07:28:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-20.consmr.mail.ne1.yahoo.com (sonic303-20.consmr.mail.ne1.yahoo.com [66.163.188.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7F95C73266 for ; Mon, 24 Dec 2018 07:28:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: USfH7uwVM1mN_Vom2xbVmt1a8ZuJMmK5wDkUqu5hPZCed.rUt2Qaz4umdHTYy7C Dd8e_FBRO4PNJTxMx_6t_l.g8j2Kk6VrQfdmTNlISv8eEIZqT4eFgbfDdBLMI3_y6hhpBqtfyPZQ nIxb8IJVE20S33uIMF_RFKAW9TM.LSIkZfOxD0_3zqVgFh9HOv7REpH4JuGMSvSBlK9xFIH_cPBj FpdgT4._gjabkLhVi9fyVpmDoR4Z1gZioe7J2PN2pkyGZvMOc8WDoKy1h9C9Kvxwi66vA33HeVEI 0kFM.JYThO3q7EOfJ04lnGHyjEKUckpstH0LH2..h8ZHm6T81GOUCBjZTElJw8r8aMuXc0bwZmbk iJSZnjcIjrsVsKGul3nlroQOGkuF0n47hanlENF_cXWl1JfO.1x2iaVUcP3eQr1bxHcDJm0bg5LD EZSrQxigTv7PCWd9rdZQiasK4MvJyazvyfWZRNna97D1TSMs26zHu5L5ujudGF6Toj71qh80U.zD tyH9k4NJ07FFdSrrCQzLEOB5.57idmo3qFwycNnGbWc0l13HnNM88_AS.9iOGjody_c1RFw58Bo4 Im.I72NQFyRq0l1Cbgb9DoaNsQSWYyyIu5MWbbjqMRL4bsvx6EQ7eS6Tk3nQU9nzVZyrfBhVgv1c 5Zmtl5VtxTHuBdhqRhmcvT_jqyJD9NwZqa51b8g3fMyyoW683JEQNfd1RF2249hdEQNX7MN3T7Pb tkzeYVu81xsE9UppwiwIgiqBWWc0GnMX5xwOfYLmII2NBPdyBpBXxATwYFqyhnlkiIbtMIiYyTh3 dTuB1WUodjck_FLuOWv2E0JdO4NcsQS3Qy4Bqn5myO9PfwpAG2I1yFyh8nhVPwlQuRteggDGr4xT AmZudsABZmMDmJBm6IwuJVWmvBo16VVWT4hUkUp_w2hatHEctCCNnxJ_KGYGc1YW5kLeQ0tQHxDW BhVLLqZcGAETpJcUW0DrI9etkBFB45qrZLHOgf3BtYv5YUP5WUEBjIziyHyCbMdJKkzcsNnp4QMR gCqqcxmUWXPJ5ECjt4OtrwKeiXDD3.mERDWVyKL1XdRPOdwMkapjw3V93P9YWVS6VFVK2nd9c_jc pExodOY8- Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.ne1.yahoo.com with HTTP; Mon, 24 Dec 2018 07:28:07 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp427.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID bca93c63249a32ac899d0ee694652ba8; Mon, 24 Dec 2018 07:28:05 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> Date: Sun, 23 Dec 2018 23:28:04 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 7F95C73266 X-Spamd-Bar: / X-Spamd-Result: default: False [-0.95 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.952,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.908,0]; NEURAL_HAM_LONG(-0.98)[-0.985,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.59)[ip: (0.88), ipnet: 66.163.184.0/21(1.20), asn: 36646(0.96), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[146.188.163.66.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[146.188.163.66.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2018 07:28:17 -0000 [I built a FreeBSD head -r340288 context and tried ports head -r484783 and the problem repeated.] On 2018-Dec-22, at 12:55, Mark Millard wrote: > [I found my E-mail records reporting successful builds using > qemu-user-static from ports head -r484783 under FreeBSD > head -r340287.] >=20 > On 2018-Dec-22, at 00:10, Mark Millard wrote: >=20 >> [I messed up the freebsd-emulation email address the first time I = sent >> this. I also forgot to indicate the qemu-user-static vintage = relationship.] >>=20 >> I had been reporting intermittent hang-ups for my = amd64->{aarch64,armv7} port cross >> builds in another message sequence. But it turns out that one thing I = ran into >> has hung-up every time, the same way, for amd64->armv7 cross builds: >> multimedia/gstreamer1-qt@qt5 . So I extract the material here into a = separate report >> with some updated notes. >>=20 >> A little context: I had built from ports head -r484783 before under = FreeBSD head >> -r340287 (as I remember the version). Back then it did not have this = problem that it >> now has under FreeBSD head -r341836 . One ports-specific change was = to force perl5.28 >> as the default instead of perl5.26 originally. In fact this is what = drives what is >> being rebuilt for my experiment that caught this. But I doubt the = perl version is >> important to the problem. The context has a Ryzen Threadripper 1950X = and has been >> tested both for FreeBSD under Hyper-V and for the same media = native-booted. Both >> hang-up at the same point as seen via ps or top. The native tools for = cross-build >> speedup were in use. Cross-builds targeting aarch64 did not get this = problem but >> targeting armv7 did. 121 of 129 armv7 ports built before the hang-up = for the first >> armv7 try. >>=20 >> ADDED: The qemu-user-static back with head -r340287 before installing = the >> updated ports would likely be different than the -r484783 vintage. So = both >> FreeBSD and qemu-user-static may have changed over the comparison. >=20 > CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful = cross-builds > based on qemu-user-static from ports head -484783 --all built under = FreeBSD > head -r340287 . So the use of the perl5.28 as the forced-default and = the > newer FreeBSD head version -r341836 as the context are the differences = here. >=20 >> The hang-up: >>=20 >> In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 = hung-up and timed >> out. Looking during the wait in later tries shows something much like = (from one of the >> examples): >>=20 >> root 33719 0.0 0.0 12920 3528 0 I 11:40 = 0:00.03 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >> root 41551 0.0 0.0 12920 3520 0 I 11:43 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg = (gstreamer1-qt5-1.2.0_14) (sh) >> root 41552 0.0 0.0 10340 1744 0 IJ 11:43 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 build >> root 41566 0.0 0.0 10236 1796 0 IJ 11:43 = 0:00.00 | | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE >> root 41567 0.0 0.0 89976 12896 0 IJ 11:43 = 0:00.07 | | `-- /usr/local/bin/qemu-arm-static ninja = -j28 -v all >> root 41585 0.0 0.0 102848 25056 0 IJ 11:43 = 0:00.10 | | |-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >> root 41586 0.0 0.0 102852 25072 0 IJ 11:43 = 0:00.11 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>=20 >> or as top showed it: >>=20 >> 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 = 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 = build >> 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 = 0.00% /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELECT=3Dqt5 QMAKEMODULES >> 41567 root 2 52 0 88M 13M 0 select 4 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all >> 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >> 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>=20 >> So: waiting in kqread trying to run cmake. >>=20 >> Unlike some intermittent hang-ups, attaching-then-detaching via gdb = does not >> resume the hung-up processes. Kills of the processes waiting on = kqread stop >> the build. >>=20 >> Given the prior ports have been built already, building just >> multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same = point. >>=20 >> Building anything that requires multimedia/gstreamer1-qt@qt5 seems to = be >> solidly blocked in my environment. I built a FreeBSD head -r340288 context and tried cross-buiding an amd64->armv7 ports head -r484783 of my usual ports and the problem repeated. I also found evidence that originally in the old time frame I'd disabled part of my originally-intended port builds because of other problems so multimedia/gstreamer1-qt 's build was not being tried. So the qemu-user-static vintage or content may be what to vary to narrow down the problem instead of bisecting FreeBSD kernel or world vintages. clang7 building qemu-user-static or the kernel/world has been eliminated. (I used -r340288 to match a artifact.ci.freebsd.org build, incorrectly expecting to bisect via kernel substitutions.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Mon Dec 24 12:05:20 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F14E813424A7 for ; Mon, 24 Dec 2018 12:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8720B8418C for ; Mon, 24 Dec 2018 12:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 4789E13424A5; Mon, 24 Dec 2018 12:05:19 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 35E5813424A4 for ; Mon, 24 Dec 2018 12:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C95D584189 for ; Mon, 24 Dec 2018 12:05:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 1C9461B647 for ; Mon, 24 Dec 2018 12:05:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBOC5H2K096403 for ; Mon, 24 Dec 2018 12:05:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBOC5HeY096396 for toolchain@FreeBSD.org; Mon, 24 Dec 2018 12:05:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234291] LLVM does not support CPU feature detection on non-x86 platforms Date: Mon, 24 Dec 2018 12:05:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2018 12:05:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234291 --- Comment #1 from Dimitry Andric --- If we implement anything for this, it should be reviewed upstream first. T= hat said, I know next to nothing about ARM CPU features... :) --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Mon Dec 24 23:22:04 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 61F6B13520C4 for ; Mon, 24 Dec 2018 23:22:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-9.consmr.mail.gq1.yahoo.com (sonic316-9.consmr.mail.gq1.yahoo.com [98.137.69.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2F86A7057E for ; Mon, 24 Dec 2018 23:22:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: jc9vBN0VM1kakff0WoBrDD4DIc.ekchzD54fAUII3y4VkVTxL.MJLdXbDNrgg1y QAo.Qv5U8JH.k8Oot96.To52UGsYIfkKBiZt5UOgdVkr5nhPH20LKsNhx_AGMwbUP.d.JQNsoPCq NS3FlpcGKbphHTUDioV9Gpa4DC0JVQEFXEZEg47vy3TRQgCbA9Kct.es3lf0HJewX4DoetTkt9wA Fuyk2xX1MHCd_U3fxxucxZSCF5zJKvyozFx2P2r6VZkXHiaNREzEOqqyGqIzf0zxS2Z3Cs8djt8. .XJ4z.KzURMeWCKp7DDa5UG4X_5AKMhGSIK9bnFOx5syRbniIj6uyfikxh0LEZ6U86AGxVH9kYTt BfUdUsh2O_twG6xgLG8zgiAhHjTaXLBAR_fmja72_XbSPV_7ld84o7rWgiM0y7EiNsyBZgsRZdNn SuOt3tO2VbH30.TEH_4oihnHYyH8EpS6CMKMe3u6wGqOTnHrMxttUgCwT74ObwMCXl5zs9s2t5O7 p4SdCvH8a6zYfLKMT8rQHA9zwK18asmdVDhHdYN5PFqJ6247h4iudy1EbOYzafkbiQ.x7p2pFNbF HUnmMgsLNHp4R0WC5.zpwzHWgU6w7TIySlQMafItvEodFJxbSu0Sc8ZpcEdLvLsOLsI_BR91K0in xKEF.yC2M_5Mw3m__myYuyFWxCVzG5OWSr7AbQJjC.Q.atO2QQBzQOj4Kqtnfa8FHNgkPEnYpjsn eug27zrYfCHNv28fZGq3H81qxThFo2enaNBeqfvRa2PvmprtjEx.c8Uta7Z0xGSPwBKEsrmghnFV FcE4zZIW9wLjJEm2QP4XvCgHJ18Jb.TiKvlGubDru5fga5lh9pSgoV0qdeewpYleYXhySKEHu3iN U31PDlDKhEf674o_Sg7gPc7Y10wqyUcTUMZFWhzl0zDQAXdGXKkPEt_D1SUdDdjuQNdS7u1r.7Gx cWkd7HHtdrzqTIIgnz36TDZeo0RZBCbjITfxAD1fhpSGcu0fuAss1EbX5UcWg0p71HEAYfW5jBI2 sIzJdNTpJlKfNHWU63NDreDAjmkzVW5jSAzeYG63NKcD9CFaynFONQxCyiThCfys_mtwJn04tBpK FeT9YiuQ- Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Mon, 24 Dec 2018 23:21:55 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp428.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID d4e2bcc862475bbb020a8fed632a7afe; Mon, 24 Dec 2018 23:21:50 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> Date: Mon, 24 Dec 2018 15:21:50 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <5C3F09FE-EA50-452D-98EE-364B7BF3ECD0@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 2F86A7057E X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.74 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.30)[-0.305,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.07)[ip: (-0.70), ipnet: 98.137.64.0/21(0.63), asn: 36647(0.50), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[33.69.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2018 23:22:04 -0000 [A native poudreire-devel based build of multimedia/gstreamer1-qt@qt5 did not hang-up and worked fine. Official package build history also provides some evidence.] On 2018-Dec-22, at 12:55, Mark Millard wrote: > [I found my E-mail records reporting successful builds using > qemu-user-static from ports head -r484783 under FreeBSD > head -r340287.] >=20 > On 2018-Dec-22, at 00:10, Mark Millard wrote: >=20 >> [I messed up the freebsd-emulation email address the first time I = sent >> this. I also forgot to indicate the qemu-user-static vintage = relationship.] >>=20 >> I had been reporting intermittent hang-ups for my = amd64->{aarch64,armv7} port cross >> builds in another message sequence. But it turns out that one thing I = ran into >> has hung-up every time, the same way, for amd64->armv7 cross builds: >> multimedia/gstreamer1-qt@qt5 . So I extract the material here into a = separate report >> with some updated notes. >>=20 >> A little context: I had built from ports head -r484783 before under = FreeBSD head >> -r340287 (as I remember the version). Back then it did not have this = problem that it >> now has under FreeBSD head -r341836 . One ports-specific change was = to force perl5.28 >> as the default instead of perl5.26 originally. In fact this is what = drives what is >> being rebuilt for my experiment that caught this. But I doubt the = perl version is >> important to the problem. The context has a Ryzen Threadripper 1950X = and has been >> tested both for FreeBSD under Hyper-V and for the same media = native-booted. Both >> hang-up at the same point as seen via ps or top. The native tools for = cross-build >> speedup were in use. Cross-builds targeting aarch64 did not get this = problem but >> targeting armv7 did. 121 of 129 armv7 ports built before the hang-up = for the first >> armv7 try. >>=20 >> ADDED: The qemu-user-static back with head -r340287 before installing = the >> updated ports would likely be different than the -r484783 vintage. So = both >> FreeBSD and qemu-user-static may have changed over the comparison. >=20 > CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful = cross-builds > based on qemu-user-static from ports head -484783 --all built under = FreeBSD > head -r340287 . So the use of the perl5.28 as the forced-default and = the > newer FreeBSD head version -r341836 as the context are the differences = here. >=20 >> The hang-up: >>=20 >> In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 = hung-up and timed >> out. Looking during the wait in later tries shows something much like = (from one of the >> examples): >>=20 >> root 33719 0.0 0.0 12920 3528 0 I 11:40 = 0:00.03 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >> root 41551 0.0 0.0 12920 3520 0 I 11:43 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg = (gstreamer1-qt5-1.2.0_14) (sh) >> root 41552 0.0 0.0 10340 1744 0 IJ 11:43 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 build >> root 41566 0.0 0.0 10236 1796 0 IJ 11:43 = 0:00.00 | | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE >> root 41567 0.0 0.0 89976 12896 0 IJ 11:43 = 0:00.07 | | `-- /usr/local/bin/qemu-arm-static ninja = -j28 -v all >> root 41585 0.0 0.0 102848 25056 0 IJ 11:43 = 0:00.10 | | |-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >> root 41586 0.0 0.0 102852 25072 0 IJ 11:43 = 0:00.11 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>=20 >> or as top showed it: >>=20 >> 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 = 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 = build >> 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 = 0.00% /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELECT=3Dqt5 QMAKEMODULES >> 41567 root 2 52 0 88M 13M 0 select 4 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all >> 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >> 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>=20 >> So: waiting in kqread trying to run cmake. >>=20 >> Unlike some intermittent hang-ups, attaching-then-detaching via gdb = does not >> resume the hung-up processes. Kills of the processes waiting on = kqread stop >> the build. >>=20 >> Given the prior ports have been built already, building just >> multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same = point. >>=20 >> Building anything that requires multimedia/gstreamer1-qt@qt5 seems to = be >> solidly blocked in my environment. I tried building multimedia/gstreamer1-qt@qt5 on a Orange Pi 2 2nd Edition and the build did not hang-up. This was also based on FreeBSD head -r341836 and ports head -r484783 . This test was set up in part by copying over the /usr/local/poudriere/data/packages/ material from what that did cross build. So, for example, the cmake used should be a binary exact match. The FreeBSD head -r341836 was installed from the same buildworld buildkernel tree that the cross-build's installworld was based on. The problem is somehow specific to cross-builds (and so qemu-user-static being involved). Other evidence (official package build attempts): I looked at beefy16.nyi.freebsd.org 's head-armv7-default and beefy8.nyi.freebsd.org 's head-armv6-default histories and the problem does not exist for the: FreeBSD -r332419 ports -r467121 combination but exists for the later ones, starting with: FreeBSD -r332632 ports -r467547 Interestingly qemu-sbruno (the master port for qemu-user-static) was not updated in that ports range, being from -r463452 . There was a cmake change at -r467437 but the more modern native result suggests cmake is not currently contributing (and, so, likely was not the issue back then). That possibly leaves qemu-user-static for targeting armv7 (and v6) misinterpreting something different from the different FreeBSD versions. For example, there was a change to return EAGAIN instead of EIO for certain conditions, between -r332419 and -r332632 : at -r332631 . (I do not know that it is involved.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Fri Dec 28 08:16:54 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9B77E143085F for ; Fri, 28 Dec 2018 08:16:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C16D477651 for ; Fri, 28 Dec 2018 08:16:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: y6hfxTIVM1m.UxJCWvaYFp.vJKhuoLDTG_f_sirbOSO1O5EmN7wxLtXZg3PD7u5 IUMsJkJqN6D_bsApJEsaBJ6V0l_ODYd.RS2ZF9KtLSwHqVOQHhCtPNxrovKLhXBypoW8uO2tU1Ct Ge9XCCXnRHzbBs3UfhBOa1PfljZGeWT61nnu3Swe9lvuAyPR51kSxqrTcAwxafFM_aoLD.yQFTkM i1Q.7Cb.KDkgZZZAr30w4Rd2J226rzB3pkojIzxHA6SGT1Acqp90X2GiSA4ODBN7D8g2QQLAUK8t 1kMvbBdMegsL6ToHHxM6sYj9TuJ37xM9Ob2pbhzc5OftI516KbTgZy9CKt2w92Bh1nbPfVNfneZj akbN96c.KD5XLhpJaHaFr1K9_jri2dCxEc_mwUCngJ2HH29Ql1u2wWgcsV5VtyyJSswkYWcQVr6f LvANHL4.RrGX6E5r7_JRdsjeHBQhn79KNHuCu6HNxvdAcZMMoeFdVdU0PlsuhWRorgU7kso2M294 T6JzaKLfYosROjFpVxnd4mVpS8zGG48KaYin7M_PtT7zfmofpaqI7dHFIELoie9nrkij_j6yAuMn TsQdFS5ZUw16cHHtks3zek8ArfZlDQedPjqz1kHnJQofZVJVZxiZ6pUt_kc9zK_LTCIx6zPXLonD RUgp.zXw4hMN8.Gg1uDqaOCWudORkvu2nvwMl6cwzaANKKiTmgLwMnfgng69H8CDUxZbDfx1aui0 ojG1uxneuYppp.i9LRH9vFdUOJiOVnAfI_1C_wCCa6cYE8_pUKt4zLSc5n2xDFOW0eZNXz1l1BQQ 0qOKLd1rS7HcjQXyHUl_lQB2aBkjXGdMF_sbVD3HRx7aQQQARxBijmeidocneyY6lA1wwAb5KyPE GxsaVM5rivSiDPCTCO_ZwWdD3kcLUkuQUQS6g44ksfKqPKEoeVyDFOn4bKM6yMK5ZPGW1MPHdWdW U4G8AFmn4.WlBMFgmyMqsUceZ238hKSJJ.62oZK6fsKVjAA.5lrv1IJ5vlTh4c7Fj9NG18nEsAGK 9YchCBSoC4tS2WRUAbyq5P1LgIazbiV73WNWdHJOEsMAx0ue80hrTCNpt04.F1vGNVRZXyWT6IhZ MMA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Fri, 28 Dec 2018 08:16:51 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp423.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 8f402acdf959e803df861ac1ea528308; Fri, 28 Dec 2018 08:16:49 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <5C3F09FE-EA50-452D-98EE-364B7BF3ECD0@yahoo.com> Date: Fri, 28 Dec 2018 00:16:48 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <3946C94A-FCA6-49FE-ADDB-B042BBE50913@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <5C3F09FE-EA50-452D-98EE-364B7BF3ECD0@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: C16D477651 X-Spamd-Bar: / X-Spamd-Result: default: False [0.01 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.41)[-0.406,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.88)[0.875,0]; NEURAL_HAM_LONG(-0.84)[-0.837,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.89)[ip: (3.41), ipnet: 98.137.64.0/21(0.62), asn: 36647(0.49), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[82.64.137.98.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[82.64.137.98.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 08:16:54 -0000 [The historical notes are removed and replaced by partial trace information from example hang-ups, not that I've figured out what contributes yet.] I ran into the following while trying to get evidence about the hang-up for an amd64->armv7 cross-build of multimedia/gstreamer1-qt@qt5 . The following from trying to get evidence for the hang-up via a manual run of "make multimedia/gstreamer1-qt FLAVOR=3Dqt5=E2=80=9D in a poudriere bulk -i=E2=80=99s interactive mode for the context that has the hang-up in normal poudriere-devel runs. =46rom top after the hang-up (to identify some context): 14528 root 2 52 0 100M 24M 0 kqread 11 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. 14527 root 2 52 0 88M 13M 0 select 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j1 -v all from ps -auxd as well (to identify more context): root 10114 0.0 0.0 10328 1756 1 I+J 13:47 0:00.01 | = `-- make FLAVOR=3Dqt5 root 14526 0.0 0.0 10204 1792 1 I+J 13:50 0:00.00 | = `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE root 14527 0.0 0.0 90304 13084 1 I+J 13:50 0:00.09 | = `-- /usr/local/bin/qemu-arm-static ninja -j1 -v all root 14528 0.0 0.0 102876 25060 1 IJ 13:50 0:00.12 | = `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g I had made a qemu-user-static that enabled do_strace when it is used to run cmake or ninja. The only do_strace lines from qemu-arm-static running cmake or ninja mentioning process 14528 are included in the sequence: (Before the below was a long list of "14527 fstatat=E2=80=9D lines. I=E2=80=99ll note that "'Unknown syscall 545=E2=80=9D is from ppoll = use.) 82400 sigprocmask(1,-1610620016,-191968524,-186261416,0,24) =3D 0 82400 sigaction(2,-1610620040,-191968596,-186261584,210460,0) =3D 0 82400 sigaction(15,-1610620040,-191968572,-186261584,210460,0) =3D 0 82400 sigaction(1,-1610620040,-191968548,-186261584,210460,0) =3D 0 82400 gettimeofday(-1610619984,0,4,-186261584,-1610619440,-1610619528) =3D= 0 82400 gettimeofday(-1610619984,0,4,359949,1545969996,0) =3D 0 82400 gettimeofday(-1610620120,0,4,2,-184666112,-1610619520) =3D 0 82400 fstatat(-100,"elements/gstqtvideosink/CMakeFiles", 0x9fffe200, 0) = =3D 0 82400 fstatat(-100,"elements/gstqtvideosink/gstqt5videosink_autogen", = 0x9fffe200, 0) =3D 0 82400 pipe2(-1610620176,0,-1610620108,0,-1610620120,167084) =3D 0 82400 fcntl(5,1,-1610620108,-185863932,-192200556,-1610620228) =3D 0 82400 fcntl(5,2,1,-185863932,-192200556,-1610620228) =3D 0 82400 vfork(0,66450,-186876196,-1610620184,-1610620240,0) =3D 82401 82400 close(6) =3D 0 =3D 0 82400 Unknown syscall 545 82401 setpgid(0,0,-186876196,-1610620184,-1610620240,0) =3D 0 82401 sigprocmask(3,-191586912,0,-1610620184,-1610620240,0) =3D 0 82401 close(5) =3D 0 82401 open("/dev/null",0,0) =3D 5 82401 dup2(5,0,0,-1610620184,-1610620240,0) =3D 0 82401 close(5) =3D 0 82401 fcntl(0,2,0,-1610620184,-1610620240,0) =3D 0 82401 dup2(6,1,0,-1610620184,-1610620240,0) =3D 1 82401 fcntl(1,2,0,-1610620184,-1610620240,0) =3D 0 82401 dup2(6,2,0,-1610620184,-1610620240,0)82400 = sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 The vfork then close(6) sequence for 82400 vs. the later use of 6 in dup2 in 82401 may be rather odd. But it looks like qemu-*-static uses do_freebsd_fork to implement do_freebsd_vfork, despite reporting vfork before calling do_freebsd_vfork. (Does the close(6) appear to indicate a race for native operation of ninja for the period when the address space is shared?) Ninja has Subprocess::Start code that has: #ifdef POSIX_SPAWN_USEVFORK flags |=3D POSIX_SPAWN_USEVFORK; #endif if (posix_spawnattr_setflags(&attr, flags) !=3D 0) Fatal("posix_spawnattr_setflags: %s", strerror(errno)); const char* spawned_args[] =3D { "/bin/sh", "-c", command.c_str(), = NULL }; if (posix_spawn(&pid_, "/bin/sh", &action, &attr, const_cast(spawned_args), environ) !=3D 0) Fatal("posix_spawn: %s", strerror(errno)); that is in use here. I think that this explains the vfork use. It turns out that putting the hung-up build in the background and then killing 82401 with the likes of kill -6 leads to more output that had apparently been buffered. It shows the use of the (amd64 native) /bin/sh that in turn leads to /usr/local/bin/cmake via qemu-arm-static. /bin/sh, being native, gets no do_strace output from qemu-arm-static. 82400 sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 82400 read(5,0x9fffd368,4096) =3D 58 82400 Unknown syscall 545 82400 sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 82400 read(5,0x9fffd368,4096) =3D 0 82400 close(5) =3D 0 82400 wait4(82401,-1610620004,0,0,-191968640,0) =3D 82401 82400 mmap(0,86016,3,201330690,-1,-1610620169) =3D 0xf4777000 82400 gettimeofday(-1610620224,0,4,-1610619944,31,16777216) =3D 0 82400 write(1,0xf4950000,283)[1/129] cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake Debug =3D 283 82400 write(1,0xf4950000,137)FAILED: = elements/gstqtvideosink/CMakeFiles/gstqt5videosink_autogen = elements/gstqtvideosink/gstqt5videosink_autogen/mocs_compilation.cpp=20 =3D 137 82400 write(1,0xf4950000,275)cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake Debug =3D 275 82400 write(1,0xf4950000,5) =3D 2 =3D 5 (Note that some 82400 writes are reporting 82401 information:) 82400 write(1,0xf4950000,49)82401 fcntl(2,2,0,-1610620184,-1610620240,0) = =3D 0 =3D 49 82400 write(1,0xf4950000,19)82401 close(6) =3D 0 =3D 19 82400 write(1,0xf4950000,401)82401 execve("/bin/sh",{"/bin/sh","-c","cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake = Debug",NULL})82401 __sysctl({ 0 3 }, 2, 0x9fffda80, 0x9fffdf64, = 0xf5002097, 0x0000000c) =3D 0 =3D 401 (The /bin/sh activity is not logged: /bin/sh is native amd64 code here. = The below is from the later /usr/local/bin/cmake via qemu-arm-static. . . . (much omitted) . . . 82400 write(1,0xf4950000,60)82401 = mmap(0,28672,3,201330690,-1,-1610621989) =3D 0xf41a0000 =3D 60 82400 write(1,0xf4950000,74)82401 = clock_gettime(4,-1610621832,4,-199622492,-199622492,-199622656) =3D 0 =3D 74 82400 write(1,0xf4950000,62)82401 = kqueue(-199622656,0,53102,0,-199622656,-1610621444) =3D 3 =3D 62 82400 write(1,0xf4950000,81)82401 ioctl(3, 0x20006601 { IO GRP:0x66('f') = CMD:1 LEN:0 }, 0x0000cf6e, ...) =3D 0 =3D 81 . . . (some omitted) . . . (Then there is a fairly long sequence of access's and then a sequence of fstatat's just before:) 82400 write(1,0xf4950000,32)82401 write(9,0xf4e1a945,1) =3D 1 =3D 32 82400 write(1,0xf4950000,61)82401 = clock_gettime(4,-1610622624,4,100863,1,-199483392) =3D 0 =3D 61 82400 write(1,0xf4950000,106)82401 = kevent(3,-1610688200,2,-1610688200,1024,0)qemu: uncaught target signal 6 = (Abort trap) - core dumped =3D 106 82400 write(1,0xf4950000,41)ninja: build stopped: subcommand failed. =3D 41 So it was hung at the kevent until the kill -6 . Via another experiment ninja was at the time waiting in ppoll: Reading symbols from ninja...done. [New LWP 73023] Core was generated by `ninja'. Program terminated with signal SIGABRT, Aborted. #0 0xf4e5e0dc in _ppoll () from /lib/libc.so.7 (gdb) bt #0 0xf4e5e0dc in _ppoll () from /lib/libc.so.7 #1 0x00033bf0 in SubprocessSet::DoWork (this=3D) at = src/subprocess-posix.cc:237 Backtrace stopped: previous frame inner to this frame (corrupt stack?) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Fri Dec 28 13:13:28 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2738314385F1; Fri, 28 Dec 2018 13:13:28 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: from mail-wm1-x343.google.com (mail-wm1-x343.google.com [IPv6:2a00:1450:4864:20::343]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 188EA8A45C; Fri, 28 Dec 2018 13:13:27 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: by mail-wm1-x343.google.com with SMTP id t200so7734110wmt.0; Fri, 28 Dec 2018 05:13:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:reply-to:subject:to:cc:references:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=JdfPZqVXFSTDaypPNx9VwESn1tLKAY4b6HjsrDtJslo=; b=bu9+24h1dO+/JxYYnWaPP2s3+R+cADexDDheDvowoosSR7dkrdH0uWs8hYSGXcLX3d f3TzO3B8Chq7VxLQXTHwVUCDqfrdkXQblWufbzH97QrVrRqzYQqyOGn1fb+/0Ey621/8 8iq4hIC2o5omM5/DmANFR/84UKBIrba2MQYJS9+A+994NZr5FO4vuz3Jxs+mMq6iET9s hhagzZop6Dfrlzin9A1RZrBgiKKARYxWoZVVtBC0Ra6QO5IGbgdBJoFYW6MWiCUH2zsR 3SCd5UhrUSYGQ1mb2ucIIG2C/z7i2SsHlte0Hc4OH57kzEz6+/N+XzmvZwAh2k+qYD38 aXgQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:reply-to:subject:to:cc:references:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=JdfPZqVXFSTDaypPNx9VwESn1tLKAY4b6HjsrDtJslo=; b=a5Uv5++JU1JdxuveF+OU7Df6WSK+a8o/XeaasACZLkbwAycdhzPo7rv6QPVm4GxPpw 7F3RMdwFgaIR3x5NwFwzpW8es2lqOWazYA+LWu83TSW0fD0mY37H6d3ofs06p4AMo8Mr yuUjjE6KM0c1TIt2b6tI/mO+799Ij0ZGjXk+qMklD38tfJg9pGh5aVESIh7ZyFG7eZyN 8CWLSLiO7HNgFiJzc7fzc2Jzv3mmLN38V9wgYIjww9n9HCZAWyA/7xVklgrTIaLwdnXs O9rn3633PAiY6abx8vJbScLNqnHGxjxmZ08QZs/IprKF0rO6KSHbhN3VmMyJjNtnqJsk jgkA== X-Gm-Message-State: AA+aEWbgAtq/b0PKDoYDeg5lyrfc9Mv6+BQQ0PL6ftuV/j0Nu4enfqch 9X1hkYUX6b3qwN9BNloZOziFrJUQGys= X-Google-Smtp-Source: ALg8bN6qPuX61IRuZjgq1M3f14uv4qIJOj00Y1i5Amq4Jp30ha/r3H0Wg0DIUqAJrjOy7AsXWV77Lg== X-Received: by 2002:a1c:9a0d:: with SMTP id c13mr24826750wme.41.1546002805646; Fri, 28 Dec 2018 05:13:25 -0800 (PST) Received: from [88.208.79.100] (halouny.humusoft.cz. [88.208.79.100]) by smtp.gmail.com with ESMTPSA id k7sm27601306wrl.51.2018.12.28.05.13.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 28 Dec 2018 05:13:24 -0800 (PST) From: Michal Meloun X-Google-Original-From: Michal Meloun Reply-To: mmel@freebsd.org Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) To: Mark Millard , freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd Cc: freebsd-arm , FreeBSD Toolchain References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> Openpgp: preference=signencrypt Autocrypt: addr=mmel@freebsd.org; prefer-encrypt=mutual; keydata= mQENBFYuVRkBCADZiwLCCne3wG9b9k+R2Neo5zVo2bLaZRfNNY/v9kg283i0sb1Da4EdEiNT 15El5UyozhphUIbIR/zrVpxF1TvvFdoCyzx6a68bNY2d9dBrDcNDZC+XnyDdHQoobN87DWT1 mRVkmbg9LHZ/SVUOkGYuWyE+8UYeDAcUizuXwSK5zFWmeTyIoWNa68ifrWLfQe0p4x5jC/AI VURCi17p360vU4fhgwoMvEEhrRBWCr4DYHToFjIt2WdBy3GR1qoO0+Xkd6G+OoBULo+XDfgu L2WdPvh0K69F9/LgHkMmG5Il7SCe62QGpG2vaCgRV7BQhLX+kxlvM+WrdRatWRml4Y/3ABEB AAG0IE1pY2hhbCBNZWxvdW4gPG1tZWxAZnJlZWJzZC5vcmc+iQFABBMBCgAqAhsDBQsJCAcD BRUKCQgLBRYDAgEAAh4BAheAAhkBBQJZjBHDBQkHICOqAAoJEGkesmtexaqqIKMIAJ9xTp1w ge86ns2ZYOac5++mAgpFatohSlxYUR3gwud3Y3Ej0eumavpv/C26N6dsLnspwRenKdLbIPKe 0N8lI7CcDBIJGiFyY3c4H79QjIkYpRgbWFyCM85zEyVJpB+U7BhsgXE2uwVjE9RNhEP0KBoj sp357uqq1B1+VUO4GJ+RjdmYSOcNrjR8tTfy02456qovGjJ4JcJBlhyK6GzBKvnZSoA0s+QP OMn3gd8gdomMLEJdS3kTsfhLh2rQPZa9EmzafIyjXrirWq4+4fVFgd8SiMZyyTM+Kz30ZSUe 6SmfaQTQ/WLRIl5jku2uYQWlrRIKT9xaQzRWtZO9UgtXFRG5AQ0EVi5VGQEIALqgRkfS21D/ OqWE9mXfh2bIjrp9uC8T0MCuimbsrAdLKNNorGu2nE+rebgX8n5nYM377HOnalPGyOuXvCbQ 8MFVRdWOHxenJjXJialNdBsOf2wLva3vSSVsdoPzibWDIcJqhBOQ3EuhsILyWSPvYYKEiy95 mfhrDtuTTOAYVR9aNQBOENztB2TDJyMx/qZmtGroGV3N0Hqde/znHPtQO8RG5/FQGMfHMI5G FMuycr1ceHnLo/ovrqAl4TYV+UHSHJ+FDE9dt9wXHclWbWbC0yNugchZq6rho5Jjfv4a2v7P pyn3HoDinh1lWP7hYA0ZNExGHekLnXWVqO/lzGS6bMEAEQEAAYkBJQQYAQoADwIbDAUCWYwR wwUJByAjqgAKCRBpHrJrXsWqqrsrB/4g4ESK5TLxUxi8pLWcLPyvwtN4Fmf7VsCVefkhakaG rDPmfvfnG+OFwN60Xqoni7GBeakl01xwT4RINfvVfShDy6cHpLS7QL/M8pzfulVX38MkVkOD yGZhwjE+jyT/kZNA1Olaw3N3IefHq3brskQ7G4d9oPep2DDbw7C4Q76uOBjxy34JVB0WOsB6 NyMQB9h6LGljQtdEddyUqwnRZzzHiGvp0hPtdYQHQZlqbj4FV9lTRK7a8Ega+y7MgmeMiztG zeXyjNP02r3PRHCPagwa57bPxH2aAh4Q7UzBBZ0GTMm7DLKNtCP58WDxblrrhZ+7kHqGK8Fs bdeUpDdEYLVd Message-ID: <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> Date: Fri, 28 Dec 2018 14:13:25 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 188EA8A45C X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=bu9+24h1; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of melounmichal@gmail.com designates 2a00:1450:4864:20::343 as permitted sender) smtp.mailfrom=melounmichal@gmail.com X-Spamd-Result: default: False [-3.17 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[mmel@freebsd.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-0.08)[ip: (2.97), ipnet: 2a00:1450::/32(-1.76), asn: 15169(-1.51), country: US(-0.08)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.980,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_SHORT(-0.11)[-0.110,0]; NEURAL_HAM_LONG(-0.99)[-0.993,0]; MIME_GOOD(-0.10)[text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 13:13:28 -0000 On 24.12.2018 8:28, Mark Millard wrote: > [I built a FreeBSD head -r340288 context and tried ports head > -r484783 and the problem repeated.] > > On 2018-Dec-22, at 12:55, Mark Millard wrote: > >> [I found my E-mail records reporting successful builds using >> qemu-user-static from ports head -r484783 under FreeBSD >> head -r340287.] >> >> On 2018-Dec-22, at 00:10, Mark Millard wrote: >> >>> [I messed up the freebsd-emulation email address the first time I sent >>> this. I also forgot to indicate the qemu-user-static vintage relationship.] >>> >>> I had been reporting intermittent hang-ups for my amd64->{aarch64,armv7} port cross >>> builds in another message sequence. But it turns out that one thing I ran into >>> has hung-up every time, the same way, for amd64->armv7 cross builds: >>> multimedia/gstreamer1-qt@qt5 . So I extract the material here into a separate report >>> with some updated notes. >>> >>> A little context: I had built from ports head -r484783 before under FreeBSD head >>> -r340287 (as I remember the version). Back then it did not have this problem that it >>> now has under FreeBSD head -r341836 . One ports-specific change was to force perl5.28 >>> as the default instead of perl5.26 originally. In fact this is what drives what is >>> being rebuilt for my experiment that caught this. But I doubt the perl version is >>> important to the problem. The context has a Ryzen Threadripper 1950X and has been >>> tested both for FreeBSD under Hyper-V and for the same media native-booted. Both >>> hang-up at the same point as seen via ps or top. The native tools for cross-build >>> speedup were in use. Cross-builds targeting aarch64 did not get this problem but >>> targeting armv7 did. 121 of 129 armv7 ports built before the hang-up for the first >>> armv7 try. >>> >>> ADDED: The qemu-user-static back with head -r340287 before installing the >>> updated ports would likely be different than the -r484783 vintage. So both >>> FreeBSD and qemu-user-static may have changed over the comparison. >> >> CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful cross-builds >> based on qemu-user-static from ports head -484783 --all built under FreeBSD >> head -r340287 . So the use of the perl5.28 as the forced-default and the >> newer FreeBSD head version -r341836 as the context are the differences here. >> >>> The hang-up: >>> >>> In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 hung-up and timed >>> out. Looking during the wait in later tries shows something much like (from one of the >>> examples): >>> >>> root 33719 0.0 0.0 12920 3528 0 I 11:40 0:00.03 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >>> root 41551 0.0 0.0 12920 3520 0 I 11:43 0:00.00 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >>> root 41552 0.0 0.0 10340 1744 0 IJ 11:43 0:00.01 | | `-- /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=qt5 build >>> root 41566 0.0 0.0 10236 1796 0 IJ 11:43 0:00.00 | | `-- /bin/sh -e -c (cd /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! /usr/bin/env QT_SELE >>> root 41567 0.0 0.0 89976 12896 0 IJ 11:43 0:00.07 | | `-- /usr/local/bin/qemu-arm-static ninja -j28 -v all >>> root 41585 0.0 0.0 102848 25056 0 IJ 11:43 0:00.10 | | |-- /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>> root 41586 0.0 0.0 102852 25072 0 IJ 11:43 0:00.11 | | `-- /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>> >>> or as top showed it: >>> >>> 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=qt5 build >>> 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 0.00% /bin/sh -e -c (cd /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! /usr/bin/env QT_SELECT=qt5 QMAKEMODULES >>> 41567 root 2 52 0 88M 13M 0 select 4 0:00 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all >>> 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>> 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>> >>> So: waiting in kqread trying to run cmake. >>> >>> Unlike some intermittent hang-ups, attaching-then-detaching via gdb does not >>> resume the hung-up processes. Kills of the processes waiting on kqread stop >>> the build. >>> >>> Given the prior ports have been built already, building just >>> multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same point. >>> >>> Building anything that requires multimedia/gstreamer1-qt@qt5 seems to be >>> solidly blocked in my environment. > > > I built a FreeBSD head -r340288 context and tried cross-buiding an > amd64->armv7 ports head -r484783 of my usual ports and the problem > repeated. I also found evidence that originally in the old time frame > I'd disabled part of my originally-intended port builds because of > other problems so multimedia/gstreamer1-qt 's build was not being > tried. > > So the qemu-user-static vintage or content may be what to vary to > narrow down the problem instead of bisecting FreeBSD kernel or world > vintages. clang7 building qemu-user-static or the kernel/world has > been eliminated. > > > (I used -r340288 to match a artifact.ci.freebsd.org build, incorrectly > expecting to bisect via kernel substitutions.) > Mark, this is known problem with qemu-user-static. Emulation of every single interruptible syscall is broken by design (it have signal related races). Theses races cannot be solved without major rewrite of syscall emulation code. Unfortunately, nobody actively works on this, I think. Michal From owner-freebsd-toolchain@freebsd.org Fri Dec 28 13:13:27 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9116914385EA; Fri, 28 Dec 2018 13:13:27 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: from mail-wr1-x443.google.com (mail-wr1-x443.google.com [IPv6:2a00:1450:4864:20::443]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7CC4F8A45B; Fri, 28 Dec 2018 13:13:26 +0000 (UTC) (envelope-from melounmichal@gmail.com) Received: by mail-wr1-x443.google.com with SMTP id q18so20884606wrx.9; Fri, 28 Dec 2018 05:13:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:reply-to:subject:to:cc:references:openpgp:autocrypt:message-id :date:user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=JdfPZqVXFSTDaypPNx9VwESn1tLKAY4b6HjsrDtJslo=; b=JlXyZS8YN5HTFZamWSZi/GNS19YmOybUKCFJMINKQKVaP//C1ztYxVtXyTKZZz2C+2 GJ7paIMr0jXXGOvU9MQ/Xg9nhJ1SR2iEgSW7+BpFV+xTZM8CF5f+CsDPLKlBpfHiR1P8 JAbW/dcQeruHDnhYE4ilPEnuX72Vpc7Deop8/Z63CQg0OV40dlPHPvFpwLLDn9bA2QYK s69MIrtAJQE2SmPvPPxTW+NsmjPGFkUfuYWBRvdhN8t4rosVJ/CJjMw+vp/4cVqBTw9U i7WHPAVnY8owgAkEa2jc92xmIjQuaBl9aYkxdFVVzClGtX7FvXllxp1A6VatUfLSypG3 7avQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:reply-to:subject:to:cc:references:openpgp :autocrypt:message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=JdfPZqVXFSTDaypPNx9VwESn1tLKAY4b6HjsrDtJslo=; b=O+vJfwClLyPuDMWJhXsJVjq4zzmNx8PeexPSDIy4XZ68RvjLRXBKcEtDjiqOVPZneS vm3cfDsvS1PU+onqmysYHSJkVEq6IiZdbGnh+xi9TN226bDHgX4PuVdDebJTPheO1WpP avv6xg4y8gWCb2br8VwrbHN1FHktEy+JYpPF94+hDMjsgamOSrtgkBjXQX9Vohs+iiCv Fo5KClZ0fLyonaQls59gP9mdrfthDpFsx6gcHhz3AApLe65PVo0VHJrcYV8RWKSHJGeb W190KZ2P4GJKX2S3O1NcMofkOGFIXwGAOYigwZDrP548MrgMLy3p0oC/fvclZPMoSQj0 5NNA== X-Gm-Message-State: AJcUukc1F1VfEf6e2eYt/J5oiZKAWhhVgBuFspDalaEJ4wtpOjB88CWN gOiZ07DFjBgsES7j4IFgkygi6+pBOkI= X-Google-Smtp-Source: ALg8bN602D5pVEoG3DAlRGEYrm/4TOwzvErBayiIVY8/up7lkYhlJC5D/qx5EVapLYPO2DD3TikwSw== X-Received: by 2002:adf:be8b:: with SMTP id i11mr26586057wrh.235.1546002805216; Fri, 28 Dec 2018 05:13:25 -0800 (PST) Received: from [88.208.79.100] (halouny.humusoft.cz. [88.208.79.100]) by smtp.gmail.com with ESMTPSA id g188sm23795644wmf.32.2018.12.28.05.13.24 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 28 Dec 2018 05:13:24 -0800 (PST) From: Michal Meloun X-Google-Original-From: Michal Meloun Reply-To: mmel@freebsd.org Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) To: Mark Millard , freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd Cc: freebsd-arm , FreeBSD Toolchain References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> Openpgp: preference=signencrypt Autocrypt: addr=mmel@freebsd.org; prefer-encrypt=mutual; keydata= mQENBFYuVRkBCADZiwLCCne3wG9b9k+R2Neo5zVo2bLaZRfNNY/v9kg283i0sb1Da4EdEiNT 15El5UyozhphUIbIR/zrVpxF1TvvFdoCyzx6a68bNY2d9dBrDcNDZC+XnyDdHQoobN87DWT1 mRVkmbg9LHZ/SVUOkGYuWyE+8UYeDAcUizuXwSK5zFWmeTyIoWNa68ifrWLfQe0p4x5jC/AI VURCi17p360vU4fhgwoMvEEhrRBWCr4DYHToFjIt2WdBy3GR1qoO0+Xkd6G+OoBULo+XDfgu L2WdPvh0K69F9/LgHkMmG5Il7SCe62QGpG2vaCgRV7BQhLX+kxlvM+WrdRatWRml4Y/3ABEB AAG0IE1pY2hhbCBNZWxvdW4gPG1tZWxAZnJlZWJzZC5vcmc+iQFABBMBCgAqAhsDBQsJCAcD BRUKCQgLBRYDAgEAAh4BAheAAhkBBQJZjBHDBQkHICOqAAoJEGkesmtexaqqIKMIAJ9xTp1w ge86ns2ZYOac5++mAgpFatohSlxYUR3gwud3Y3Ej0eumavpv/C26N6dsLnspwRenKdLbIPKe 0N8lI7CcDBIJGiFyY3c4H79QjIkYpRgbWFyCM85zEyVJpB+U7BhsgXE2uwVjE9RNhEP0KBoj sp357uqq1B1+VUO4GJ+RjdmYSOcNrjR8tTfy02456qovGjJ4JcJBlhyK6GzBKvnZSoA0s+QP OMn3gd8gdomMLEJdS3kTsfhLh2rQPZa9EmzafIyjXrirWq4+4fVFgd8SiMZyyTM+Kz30ZSUe 6SmfaQTQ/WLRIl5jku2uYQWlrRIKT9xaQzRWtZO9UgtXFRG5AQ0EVi5VGQEIALqgRkfS21D/ OqWE9mXfh2bIjrp9uC8T0MCuimbsrAdLKNNorGu2nE+rebgX8n5nYM377HOnalPGyOuXvCbQ 8MFVRdWOHxenJjXJialNdBsOf2wLva3vSSVsdoPzibWDIcJqhBOQ3EuhsILyWSPvYYKEiy95 mfhrDtuTTOAYVR9aNQBOENztB2TDJyMx/qZmtGroGV3N0Hqde/znHPtQO8RG5/FQGMfHMI5G FMuycr1ceHnLo/ovrqAl4TYV+UHSHJ+FDE9dt9wXHclWbWbC0yNugchZq6rho5Jjfv4a2v7P pyn3HoDinh1lWP7hYA0ZNExGHekLnXWVqO/lzGS6bMEAEQEAAYkBJQQYAQoADwIbDAUCWYwR wwUJByAjqgAKCRBpHrJrXsWqqrsrB/4g4ESK5TLxUxi8pLWcLPyvwtN4Fmf7VsCVefkhakaG rDPmfvfnG+OFwN60Xqoni7GBeakl01xwT4RINfvVfShDy6cHpLS7QL/M8pzfulVX38MkVkOD yGZhwjE+jyT/kZNA1Olaw3N3IefHq3brskQ7G4d9oPep2DDbw7C4Q76uOBjxy34JVB0WOsB6 NyMQB9h6LGljQtdEddyUqwnRZzzHiGvp0hPtdYQHQZlqbj4FV9lTRK7a8Ega+y7MgmeMiztG zeXyjNP02r3PRHCPagwa57bPxH2aAh4Q7UzBBZ0GTMm7DLKNtCP58WDxblrrhZ+7kHqGK8Fs bdeUpDdEYLVd Message-ID: Date: Fri, 28 Dec 2018 14:13:25 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.3.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 7CC4F8A45B X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=JlXyZS8Y; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of melounmichal@gmail.com designates 2a00:1450:4864:20::443 as permitted sender) smtp.mailfrom=melounmichal@gmail.com X-Spamd-Result: default: False [-4.27 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[mmel@freebsd.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.76)[-0.760,0]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-0.51)[ip: (0.82), ipnet: 2a00:1450::/32(-1.76), asn: 15169(-1.51), country: US(-0.08)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[3.4.4.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_LAST(0.00)[] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 13:13:27 -0000 On 24.12.2018 8:28, Mark Millard wrote: > [I built a FreeBSD head -r340288 context and tried ports head > -r484783 and the problem repeated.] > > On 2018-Dec-22, at 12:55, Mark Millard wrote: > >> [I found my E-mail records reporting successful builds using >> qemu-user-static from ports head -r484783 under FreeBSD >> head -r340287.] >> >> On 2018-Dec-22, at 00:10, Mark Millard wrote: >> >>> [I messed up the freebsd-emulation email address the first time I sent >>> this. I also forgot to indicate the qemu-user-static vintage relationship.] >>> >>> I had been reporting intermittent hang-ups for my amd64->{aarch64,armv7} port cross >>> builds in another message sequence. But it turns out that one thing I ran into >>> has hung-up every time, the same way, for amd64->armv7 cross builds: >>> multimedia/gstreamer1-qt@qt5 . So I extract the material here into a separate report >>> with some updated notes. >>> >>> A little context: I had built from ports head -r484783 before under FreeBSD head >>> -r340287 (as I remember the version). Back then it did not have this problem that it >>> now has under FreeBSD head -r341836 . One ports-specific change was to force perl5.28 >>> as the default instead of perl5.26 originally. In fact this is what drives what is >>> being rebuilt for my experiment that caught this. But I doubt the perl version is >>> important to the problem. The context has a Ryzen Threadripper 1950X and has been >>> tested both for FreeBSD under Hyper-V and for the same media native-booted. Both >>> hang-up at the same point as seen via ps or top. The native tools for cross-build >>> speedup were in use. Cross-builds targeting aarch64 did not get this problem but >>> targeting armv7 did. 121 of 129 armv7 ports built before the hang-up for the first >>> armv7 try. >>> >>> ADDED: The qemu-user-static back with head -r340287 before installing the >>> updated ports would likely be different than the -r484783 vintage. So both >>> FreeBSD and qemu-user-static may have changed over the comparison. >> >> CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful cross-builds >> based on qemu-user-static from ports head -484783 --all built under FreeBSD >> head -r340287 . So the use of the perl5.28 as the forced-default and the >> newer FreeBSD head version -r341836 as the context are the differences here. >> >>> The hang-up: >>> >>> In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 hung-up and timed >>> out. Looking during the wait in later tries shows something much like (from one of the >>> examples): >>> >>> root 33719 0.0 0.0 12920 3528 0 I 11:40 0:00.03 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >>> root 41551 0.0 0.0 12920 3520 0 I 11:43 0:00.00 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >>> root 41552 0.0 0.0 10340 1744 0 IJ 11:43 0:00.01 | | `-- /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=qt5 build >>> root 41566 0.0 0.0 10236 1796 0 IJ 11:43 0:00.00 | | `-- /bin/sh -e -c (cd /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! /usr/bin/env QT_SELE >>> root 41567 0.0 0.0 89976 12896 0 IJ 11:43 0:00.07 | | `-- /usr/local/bin/qemu-arm-static ninja -j28 -v all >>> root 41585 0.0 0.0 102848 25056 0 IJ 11:43 0:00.10 | | |-- /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>> root 41586 0.0 0.0 102852 25072 0 IJ 11:43 0:00.11 | | `-- /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>> >>> or as top showed it: >>> >>> 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=qt5 build >>> 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 0.00% /bin/sh -e -c (cd /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! /usr/bin/env QT_SELECT=qt5 QMAKEMODULES >>> 41567 root 2 52 0 88M 13M 0 select 4 0:00 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all >>> 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>> 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>> >>> So: waiting in kqread trying to run cmake. >>> >>> Unlike some intermittent hang-ups, attaching-then-detaching via gdb does not >>> resume the hung-up processes. Kills of the processes waiting on kqread stop >>> the build. >>> >>> Given the prior ports have been built already, building just >>> multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same point. >>> >>> Building anything that requires multimedia/gstreamer1-qt@qt5 seems to be >>> solidly blocked in my environment. > > > I built a FreeBSD head -r340288 context and tried cross-buiding an > amd64->armv7 ports head -r484783 of my usual ports and the problem > repeated. I also found evidence that originally in the old time frame > I'd disabled part of my originally-intended port builds because of > other problems so multimedia/gstreamer1-qt 's build was not being > tried. > > So the qemu-user-static vintage or content may be what to vary to > narrow down the problem instead of bisecting FreeBSD kernel or world > vintages. clang7 building qemu-user-static or the kernel/world has > been eliminated. > > > (I used -r340288 to match a artifact.ci.freebsd.org build, incorrectly > expecting to bisect via kernel substitutions.) > Mark, this is known problem with qemu-user-static. Emulation of every single interruptible syscall is broken by design (it have signal related races). Theses races cannot be solved without major rewrite of syscall emulation code. Unfortunately, nobody actively works on this, I think. Michal From owner-freebsd-toolchain@freebsd.org Fri Dec 28 17:00:40 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E0CFA1419E1D for ; Fri, 28 Dec 2018 17:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7A5A691B15 for ; Fri, 28 Dec 2018 17:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 384F11419E1C; Fri, 28 Dec 2018 17:00:40 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 26B1E1419E1B for ; Fri, 28 Dec 2018 17:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BA64191B0F for ; Fri, 28 Dec 2018 17:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 03907130CD for ; Fri, 28 Dec 2018 17:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBSH0c8e099091 for ; Fri, 28 Dec 2018 17:00:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBSH0cRr099087 for toolchain@FreeBSD.org; Fri, 28 Dec 2018 17:00:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234070] problem with lld and wildcard characters in version scripts Date: Fri, 28 Dec 2018 17:00:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tijl@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: see_also Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 17:00:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234070 Tijl Coosemans changed: What |Removed |Added ---------------------------------------------------------------------------- See Also| |https://bugs.llvm.org/show_ | |bug.cgi?id=3D40176 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Fri Dec 28 20:22:27 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B690B142139B for ; Fri, 28 Dec 2018 20:22:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-32.consmr.mail.ne1.yahoo.com (sonic301-32.consmr.mail.ne1.yahoo.com [66.163.184.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CCB5269ED7 for ; Fri, 28 Dec 2018 20:22:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: owz7Eb8VM1nKZuEr0GgzRC_8Xh7cV3NmPnLnIUUqh58HomsqS6LvefDXXWwRvBB 3fDcM6t_u2I_URGoEsuzttcInBx1VudXdi3db27HCySFzrbYuZKn7Jet6krhrIq5qvEjH1BcHp3R CwFkADlEz6lDPLSOjGk22lz47uIB2VeA0DqlrDrc4afscwDyC1v8gcXT5aYfgnCDLKl8_Fj5pmQk YcgQdBkHllcdPwU36yk8j9GhJ1xeu7508eOfOJknWKDhSQ9AfruXmw6XT.O.mFxzh1GugsvTO_xP qaBTM3KhYmYxW1TXXV4pU7oRwvK4MUai1WOWEOCEOE66ROgtU05ZbfBF_0Nn32PwHpvWd_b2qCgG GnGCes_dSG7_TNCsZVmOTbsygk2vYBD8YADyB31Zfo7j8qB..laZlCmvvJwL5WLW5XoGsz5ak_9P vqzDbQw8EXkt9zVfZ3KfnOM06NALZ039gXGSgwrC._L98HIqQlamxqdXl.aDtvaAls5fA1mEGIH9 Z5j13SlsRDJSv4Yo1ZnZgv3UOmdTWwJhxeLl2.tjEGcfgPQPIpgw5W7AIzQ3JmFu051X7NPyeZu6 wV_ZQF9tf3i_kXHR6eDTRMnEMdEK0b1Bw6eJtrWIAHRV2dSKKUlG8M9HV39fmBoeCXJJS2AOH0mO vjrOucv0UcoiqwvhXPvFiNeaQaE3OcqweNJpmjcIfpZg.wyl2nxVb.gf3sWBlIgxgEDvSTohA2IQ kGCYYCxyW.o6.y1hjlqBhe3lW_AwBp3uUWULjVOu7LtJ46jB6_zAqGJvhvVdpueR8x4_PbXtDEGo YAmuUX1_T7qzB7z1uktlwKYwT47MkixO2knoOJZBLGQ4mll.OPwWghAx0wq4dMIhVs0yiZ4SQBBo HSdeG8gtLEI7Bpr_u.DyG05TPfKeznMIZW0R_d8W.ynbNsIR3iFdTRMx_K1wLnhk2J2yDmwVs9XY gy3p3mWHbr_3e6VQ7l4ic3bnmlHVKun8ZF87U6xnp7wp8kS825Qo6i044kI_PAFIpPaEOZAgMNW1 VFvhAhv5gBliwan.34rCeLTHwVEPEnYZubFBFF.yTmF2bhZ7uV.nFt_MpSFgyH5eG6jCM Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.ne1.yahoo.com with HTTP; Fri, 28 Dec 2018 20:22:19 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp429.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID b8b32a4346149f25d8f944b89459e9c7; Fri, 28 Dec 2018 20:12:08 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> Date: Fri, 28 Dec 2018 12:12:06 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd , freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> To: mmel@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: CCB5269ED7 X-Spamd-Bar: / X-Spamd-Result: default: False [0.86 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.81)[0.810,0]; NEURAL_HAM_LONG(-0.69)[-0.692,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.21)[ip: (4.01), ipnet: 66.163.184.0/21(1.17), asn: 36646(0.93), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.05)[0.047,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[201.184.163.66.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[201.184.163.66.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 20:22:28 -0000 On 2018-Dec-28, at 05:13, Michal Meloun = wrote: > Mark, > this is known problem with qemu-user-static. > Emulation of every single interruptible syscall is broken by design = (it > have signal related races). Theses races cannot be solved without = major > rewrite of syscall emulation code. > Unfortunately, nobody actively works on this, I think. >=20 Thanks for the note setting some expectations. On the evidence that I have I expect that more is going on than that: A) The hang-up always happens and always in the same place. So it would appear that no race is involved. B) (A) is true even for varying the number of builders in parallel (so other builds also happening) and the number of jobs allowed per builder. It also fails for only one builder allowed only one process. (I get traces from that last kind of context.) C) The problem started on the package-building servers for armv7 and armv6 without qemu-user-static having an update (FreeBSD and cmake had updates, for example). D) The problem is only observed for targeting armv7 and armv6 as far as I can tell. I've never seen it for aarch64, neither my own builds nor when I looked at the package-building server history. At least that is what got me started. (I've since learned that qemu-user-static uses fork in place of a requested vfork.) My ktrace/kdump experiment yesterday showed something odd for the kevent that hangs in cmake: 93172 qemu-arm-static CALL = kevent(0x3,0x7ffffffe7d40,0x2,0x7ffffffd7d40,0x400,0) 93172 qemu-arm-static STRU struct kevent[] =3D { { ident=3D6, = filter=3DEVFILT_READ, flags=3D0x1, fflags=3D0, data=3D0, = udata=3D0x0 } { ident=3D0x0, filter=3D, flags=3D0, = fflags=3D0x8, data=3D0x1ffff, udata=3D0x0 } } Note the 0x2 argument to kevent and the apparently-odd 2nd entry in the = struct kevent[]. The kevent use is from cmake. So far I've not identified a signal being delivered at a time that would = seem to me to be likely to contribute. (But this is not familiar code so my = judgment is likely not the best.) Note: I normally run FreeBSD using a non-debug kernel, even when using head. (The kernel does have symbols.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Fri Dec 28 21:02:10 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 82DE414227A7 for ; Fri, 28 Dec 2018 21:02:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-11.consmr.mail.ne1.yahoo.com (sonic313-11.consmr.mail.ne1.yahoo.com [66.163.185.34]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id ED6486B8F1 for ; Fri, 28 Dec 2018 21:02:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: YunzRiIVM1nr0SgP6ANyrg_P3tUJP97UGxFV7wSfjrRDLwErCsaD4RxPSSDQbdU 6cC7_HkfFGYdehkTiZIDQBol57GfbEm1yItYFX59uNGJxnj8aAuffMN1rJ5UuMU_Bd2Fxg23FCvk cmxUq0axAOB0Pnd_kHVyl8SfgnAVLf9fWBxwkboxJx0hQMl0MjpyQOMcq8wgg1dAJiecEhwkqGnK V_yH5jAK4oJJBLFIOaD1.c3x8jm4iW5xRtfKrpEMX9GJsdMl8b5pPr3zrdhpePVHsawhcU9Q496K zwuSxwv8TQJ37HcOjpZhAbxs98xi.zGvXq.XrTeGcq.w0KnrMGAKTaNzZuioWaQ.1j0d2wTiYrq1 u35Y1_8Y4CZBUtpz.LJdQvAPQuMwIkpHxLtci1AStK7DGDDhK8__A_J466ieGxb3ZNZZ9s23O60m EKqqdrW1t0JPu_nA9E36CRkmd288VY97nQXU9fkbWzoX2xg.RkTy.gD.aYy3lSeYEA1Y_vLwRWnl pdSQXlo6dIP0enHrEW_kgJuZ1jMd42EbRqjThIbXk4nVf3XH8jxDPbu1IDvu6bd4LNoBdoz5in_s .a55P9.BF4hN9I7isqA02OBzaWhVHi1CFZ6OXHPeuN79LUzUGZC6ZCwUYk8VWiqJ.hYTGsUoFhqY QJpH2UvufZFSlCfN0ydBOYv.FudEXRQ3qhroi_1OEbZkDJsl01XPmi.1FJnYY4RSChyVv2htGp9. SXF044bDvePT3Vyz_0RQ_AwqmOM1lU.8fOHrX7IS2vfjdHEWxUwXBAzQcKKbOgBi0lWtMspBW7sI FUIFeYC408dKdpSa7PvIawV0JwUs2riLa0WCJhGc0qm36qk2WxYNma.ZttYzouJXem7uilU5DD8A 4b6BFBlcLhoJzxkVqmf.3RJhOV0DwIFWuE2xVkG6BQ4c_x.41fom3SyDSMSnpMc3Y5f04cF5YDxt GGQzECvUDA56P2tAnvRQ4NQhnn92czs95vA8Q1g9LA6LWAK.my0n.u3vhXt3U9Jp4gOxFwauhtwm nThaG3qNsqsWeRo2r9jbNURbkdkSLM118o3m_vjykmOv4J5R9NZQgTtQkomqgboA7R4K.mom9AL9 A8P8- Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.ne1.yahoo.com with HTTP; Fri, 28 Dec 2018 21:02:08 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp423.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 1c1c880d52b5fc8a1a4126d5be9859e4; Fri, 28 Dec 2018 21:02:08 +0000 (UTC) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <3946C94A-FCA6-49FE-ADDB-B042BBE50913@yahoo.com> Date: Fri, 28 Dec 2018 13:02:06 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <050F532F-85A8-4FF8-A7B0-178598B06BE1@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <5C3F09FE-EA50-452D-98EE-364B7BF3ECD0@yahoo.com> <3946C94A-FCA6-49FE-ADDB-B042BBE50913@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: ED6486B8F1 X-Spamd-Bar: / X-Spamd-Result: default: False [-0.01 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.25)[-0.254,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.60)[0.595,0]; NEURAL_HAM_LONG(-0.79)[-0.787,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.95)[ip: (2.74), ipnet: 66.163.184.0/21(1.16), asn: 36646(0.93), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[34.185.163.66.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 21:02:10 -0000 [Using ktrace/kdump shows an apperent oddity in the kevent use that hang-up in cmake, not that I know it causes the hang-up.] On 2018-Dec-28, at 00:16, Mark Millard wrote: > [The historical notes are removed and replaced by partial trace > information from example hang-ups, not that I've figured out > what contributes yet.] >=20 > I ran into the following while trying to get evidence > about the hang-up for an amd64->armv7 cross-build of > multimedia/gstreamer1-qt@qt5 . >=20 > The following from trying to get evidence for the hang-up > via a manual run of "make multimedia/gstreamer1-qt FLAVOR=3Dqt5=E2=80=9D= > in a poudriere bulk -i=E2=80=99s interactive mode for the context > that has the hang-up in normal poudriere-devel runs. >=20 >=20 > =46rom top after the hang-up (to identify some context): >=20 > 14528 root 2 52 0 100M 24M 0 kqread 11 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. > 14527 root 2 52 0 88M 13M 0 select 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j1 -v all >=20 > from ps -auxd as well (to identify more context): >=20 > root 10114 0.0 0.0 10328 1756 1 I+J 13:47 0:00.01 = | `-- make FLAVOR=3Dqt5 > root 14526 0.0 0.0 10204 1792 1 I+J 13:50 0:00.00 = | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE > root 14527 0.0 0.0 90304 13084 1 I+J 13:50 0:00.09 = | `-- /usr/local/bin/qemu-arm-static ninja -j1 -v = all > root 14528 0.0 0.0 102876 25060 1 IJ 13:50 0:00.12 = | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >=20 > I had made a qemu-user-static that enabled do_strace when > it is used to run cmake or ninja. >=20 > The only do_strace lines from qemu-arm-static running cmake > or ninja mentioning process 14528 are included in the sequence: >=20 > (Before the below was a long list of "14527 fstatat=E2=80=9D lines. > I=E2=80=99ll note that "'Unknown syscall 545=E2=80=9D is from ppoll = use.) >=20 > 82400 sigprocmask(1,-1610620016,-191968524,-186261416,0,24) =3D 0 > 82400 sigaction(2,-1610620040,-191968596,-186261584,210460,0) =3D 0 > 82400 sigaction(15,-1610620040,-191968572,-186261584,210460,0) =3D 0 > 82400 sigaction(1,-1610620040,-191968548,-186261584,210460,0) =3D 0 > 82400 gettimeofday(-1610619984,0,4,-186261584,-1610619440,-1610619528) = =3D 0 > 82400 gettimeofday(-1610619984,0,4,359949,1545969996,0) =3D 0 > 82400 gettimeofday(-1610620120,0,4,2,-184666112,-1610619520) =3D 0 > 82400 fstatat(-100,"elements/gstqtvideosink/CMakeFiles", 0x9fffe200, = 0) =3D 0 > 82400 fstatat(-100,"elements/gstqtvideosink/gstqt5videosink_autogen", = 0x9fffe200, 0) =3D 0 > 82400 pipe2(-1610620176,0,-1610620108,0,-1610620120,167084) =3D 0 > 82400 fcntl(5,1,-1610620108,-185863932,-192200556,-1610620228) =3D 0 > 82400 fcntl(5,2,1,-185863932,-192200556,-1610620228) =3D 0 > 82400 vfork(0,66450,-186876196,-1610620184,-1610620240,0) =3D 82401 > 82400 close(6) =3D 0 > =3D 0 > 82400 Unknown syscall 545 > 82401 setpgid(0,0,-186876196,-1610620184,-1610620240,0) =3D 0 > 82401 sigprocmask(3,-191586912,0,-1610620184,-1610620240,0) =3D 0 > 82401 close(5) =3D 0 > 82401 open("/dev/null",0,0) =3D 5 > 82401 dup2(5,0,0,-1610620184,-1610620240,0) =3D 0 > 82401 close(5) =3D 0 > 82401 fcntl(0,2,0,-1610620184,-1610620240,0) =3D 0 > 82401 dup2(6,1,0,-1610620184,-1610620240,0) =3D 1 > 82401 fcntl(1,2,0,-1610620184,-1610620240,0) =3D 0 > 82401 dup2(6,2,0,-1610620184,-1610620240,0)82400 = sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 >=20 > The vfork then close(6) sequence for 82400 vs. the later > use of 6 in dup2 in 82401 may be rather odd. But it looks > like qemu-*-static uses do_freebsd_fork to implement > do_freebsd_vfork, despite reporting vfork before > calling do_freebsd_vfork. (Does the close(6) appear to > indicate a race for native operation of ninja for the > period when the address space is shared?) >=20 > Ninja has Subprocess::Start code that has: >=20 > #ifdef POSIX_SPAWN_USEVFORK > flags |=3D POSIX_SPAWN_USEVFORK; > #endif >=20 >=20 > if (posix_spawnattr_setflags(&attr, flags) !=3D 0) > Fatal("posix_spawnattr_setflags: %s", strerror(errno)); >=20 > const char* spawned_args[] =3D { "/bin/sh", "-c", command.c_str(), = NULL }; > if (posix_spawn(&pid_, "/bin/sh", &action, &attr, > const_cast(spawned_args), environ) !=3D 0) > Fatal("posix_spawn: %s", strerror(errno)); >=20 > that is in use here. I think that this explains the vfork use. >=20 >=20 > It turns out that putting the hung-up build in the background > and then killing 82401 with the likes of kill -6 leads to more > output that had apparently been buffered. It shows the use of > the (amd64 native) /bin/sh that in turn leads to > /usr/local/bin/cmake via qemu-arm-static. /bin/sh, being > native, gets no do_strace output from qemu-arm-static. >=20 > 82400 sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 > 82400 read(5,0x9fffd368,4096) =3D 58 > 82400 Unknown syscall 545 > 82400 sigpending(-1610620072,1,0,-191968524,0,0) =3D 0 > 82400 read(5,0x9fffd368,4096) =3D 0 > 82400 close(5) =3D 0 > 82400 wait4(82401,-1610620004,0,0,-191968640,0) =3D 82401 > 82400 mmap(0,86016,3,201330690,-1,-1610620169) =3D 0xf4777000 > 82400 gettimeofday(-1610620224,0,4,-1610619944,31,16777216) =3D 0 > 82400 write(1,0xf4950000,283)[1/129] cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake Debug > =3D 283 > 82400 write(1,0xf4950000,137)FAILED: = elements/gstqtvideosink/CMakeFiles/gstqt5videosink_autogen = elements/gstqtvideosink/gstqt5videosink_autogen/mocs_compilation.cpp=20 > =3D 137 > 82400 write(1,0xf4950000,275)cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake Debug > =3D 275 > 82400 write(1,0xf4950000,5) =3D 2 > =3D 5 >=20 > (Note that some 82400 writes are reporting 82401 information:) >=20 > 82400 write(1,0xf4950000,49)82401 = fcntl(2,2,0,-1610620184,-1610620240,0) =3D 0 > =3D 49 > 82400 write(1,0xf4950000,19)82401 close(6) =3D 0 > =3D 19 > 82400 write(1,0xf4950000,401)82401 = execve("/bin/sh",{"/bin/sh","-c","cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink && /usr/local/bin/cmake -E cmake_autogen = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build/elements/gstqt= videosink/CMakeFiles/gstqt5videosink_autogen.dir/AutogenInfo.cmake = Debug",NULL})82401 __sysctl({ 0 3 }, 2, 0x9fffda80, 0x9fffdf64, = 0xf5002097, 0x0000000c) =3D 0 > =3D 401 >=20 > (The /bin/sh activity is not logged: /bin/sh is native amd64 code = here. The > below is from the later /usr/local/bin/cmake via qemu-arm-static. >=20 > . . . (much omitted) . . . >=20 > 82400 write(1,0xf4950000,60)82401 = mmap(0,28672,3,201330690,-1,-1610621989) =3D 0xf41a0000 > =3D 60 > 82400 write(1,0xf4950000,74)82401 = clock_gettime(4,-1610621832,4,-199622492,-199622492,-199622656) =3D 0 > =3D 74 > 82400 write(1,0xf4950000,62)82401 = kqueue(-199622656,0,53102,0,-199622656,-1610621444) =3D 3 > =3D 62 > 82400 write(1,0xf4950000,81)82401 ioctl(3, 0x20006601 { IO = GRP:0x66('f') CMD:1 LEN:0 }, 0x0000cf6e, ...) =3D 0 > =3D 81 >=20 > . . . (some omitted) . . . >=20 > (Then there is a fairly long sequence of access's and then a sequence = of > fstatat's just before:) >=20 >=20 > 82400 write(1,0xf4950000,32)82401 write(9,0xf4e1a945,1) =3D 1 > =3D 32 > 82400 write(1,0xf4950000,61)82401 = clock_gettime(4,-1610622624,4,100863,1,-199483392) =3D 0 > =3D 61 > 82400 write(1,0xf4950000,106)82401 = kevent(3,-1610688200,2,-1610688200,1024,0)qemu: uncaught target signal 6 = (Abort trap) - core dumped > =3D 106 ktrace/kdump shows an oddity for the kevent that hangs-up in cmake (from a different run so a different process ID): 93172 qemu-arm-static CALL = kevent(0x3,0x7ffffffe7d40,0x2,0x7ffffffd7d40,0x400,0) 93172 qemu-arm-static STRU struct kevent[] =3D { { ident=3D6, = filter=3DEVFILT_READ, flags=3D0x1, fflags=3D0, data=3D0, = udata=3D0x0 } { ident=3D0x0, filter=3D, flags=3D0, = fflags=3D0x8, data=3D0x1ffff, udata=3D0x0 } } Note the 0x2 kevent argument and the apparently-odd 2nd entry in the = struct kevent[] . > 82400 write(1,0xf4950000,41)ninja: build stopped: subcommand failed. > =3D 41 >=20 > So it was hung at the kevent until the kill -6 . >=20 >=20 > Via another experiment ninja was at the time waiting > in ppoll: >=20 > Reading symbols from ninja...done. > [New LWP 73023] > Core was generated by `ninja'. > Program terminated with signal SIGABRT, Aborted. > #0 0xf4e5e0dc in _ppoll () from /lib/libc.so.7 > (gdb) bt > #0 0xf4e5e0dc in _ppoll () from /lib/libc.so.7 > #1 0x00033bf0 in SubprocessSet::DoWork (this=3D) at = src/subprocess-posix.cc:237 > Backtrace stopped: previous frame inner to this frame (corrupt stack?) >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Fri Dec 28 23:12:37 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F3E214259E0 for ; Fri, 28 Dec 2018 23:12:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 397EC6F92E for ; Fri, 28 Dec 2018 23:12:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id F10DB14259DD; Fri, 28 Dec 2018 23:12:36 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF65F14259DC for ; Fri, 28 Dec 2018 23:12:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E4196F92C for ; Fri, 28 Dec 2018 23:12:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id C65EC167D2 for ; Fri, 28 Dec 2018 23:12:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBSNCZcT033132 for ; Fri, 28 Dec 2018 23:12:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBSNCZaE033131 for toolchain@FreeBSD.org; Fri, 28 Dec 2018 23:12:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234480] multimedia/aom: clang 7 crashes with aom >= 1.0.0.1109 Date: Fri, 28 Dec 2018 23:12:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jbeich@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Dec 2018 23:12:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234480 Jan Beich changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|ports-bugs@FreeBSD.org |toolchain@FreeBSD.org --- Comment #2 from Jan Beich --- Outside my scope. I can mark it as BROKEN_FreeBSD_13 or USES=3Dcompiler:gcc-c++11-lib. Clang 6 reached EOL upstream, so it isn't go= od idea to downgrade to. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 03:27:21 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9F65142F9D3 for ; Sat, 29 Dec 2018 03:27:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8038982E9A for ; Sat, 29 Dec 2018 03:27:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 43B62142F9CA; Sat, 29 Dec 2018 03:27:20 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 30ADD142F9C9 for ; Sat, 29 Dec 2018 03:27:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B466C82E99 for ; Sat, 29 Dec 2018 03:27:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 013C418CA1 for ; Sat, 29 Dec 2018 03:27:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBT3RInc019342 for ; Sat, 29 Dec 2018 03:27:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBT3RIO7019341 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 03:27:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234480] multimedia/aom: clang 7 crashes with aom >= 1.0.0.1109 Date: Sat, 29 Dec 2018 03:27:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jbeich@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_file_loc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 03:27:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234480 Jan Beich changed: What |Removed |Added ---------------------------------------------------------------------------- URL| |http://www.ipv6proxy.net/go | |.php?u=3Dhttp://beefy11.ny= i.f | |reebsd.org/data/head-i386-d | |efault/p488642_s342580/logs | |/aom-1.0.0.1115.log --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 03:07:00 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 14A14142F0BC for ; Sat, 29 Dec 2018 03:07:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-22.consmr.mail.ne1.yahoo.com (sonic305-22.consmr.mail.ne1.yahoo.com [66.163.185.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 99B7D81FBB for ; Sat, 29 Dec 2018 03:06:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: vN.8rycVM1lUUsYKTXHjGDtKvOmNC2LkQhdaty7awDKGTP80OorGcqTMrWBY_sL NupIbID1wcJueTm2fbWLHg6tvKxWawp5VPIl0qo0uO8.ar.q5b3hHj.4zzgRqU_vEAeWvalsyDPD h1q._kI4A5GL2d2IkZ7DDjPonIed3S5AlaPCthzDaYaJcWziZrSNKuBYm9qA4U9KMXS_hBVUpNBo OMRlmi5ULjFJWnRwanZNkYR33GeY6ocKQNo5hatOr1xkiwC9o3YeXKDUraQuYd0ts.w4uNYFudJg S0uopk1.LiUKnRd9bNLBPnd47kgdU5kR6Pwv.GUX7tyBmqQRGzbXyxpRCISc0FuzqU2QzQC1rFnU DPfAzom.c4I1aUk.7lYp3OXxUl6iBU1hviPtzimqZGb5aqcRIGKZkxy_TwyjtlRVYX3s1_L1KGo5 SGeMEFmwNhNJ8dvBJT3O78rFG6.FZVw7yj4u3GGqPbEBJLGehRmVc9aVtVWMtrubzB1glWQoK5zy r7CXWqTuE48AVoZ1SKv89dvvEuLOdMIrHb1q1f8Gouc46IhYTzT.vXbVBvNzQSAqUVeTEr3ED9o1 5wh3HvUyDIWJr1DXeCjkKy8WdkB3wqUBsSzZvyTQ_U9PU3vBl1rb0iepamJYoXjRiSIwIj3yx9cB tFNuUhVLzaLlJTI2AUCRTazGXl1m5yJhZV4sz_76mRDcq6huW53Vs7K1LUvd3mkL3_WM2AlynUzl 5keu07fKhTLNmEIhXHF.SrhHHwu_gREQnsxoRPSH_hP_BMIWNTaBd4eqyjVabV4TG3IIJqSpeLRc IqciDRjr7apAhLB7EXP9bEpju3FMmvl3ohA.gCFLEZtv3zzIA2WmY2tpnVa_q9DZU__j314HGdC7 TiOa4A9dw7qgptiP13IXKhQ3jwFAfyfwLCWDHM5mJhKhTyRLu4XqViWJISlL0ZgjnjLgTowRTpDv JkvPzIqzOiiLgfsw8wGlPoo5G.50JwyaihOkQYbU6ibwfKtOkZ0Q3SWtZnzt8io3CuhckzI0hBms P7jaZKmuioB7FrRydMP0vYs7TETghgZTDvBwy0dOco6K1SyQawkWrV3oNnHWSkxMDi4TC5aWbUL6 Z Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.ne1.yahoo.com with HTTP; Sat, 29 Dec 2018 03:06:57 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp420.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID a30b0319a9e92381b4c3a8625c6cf7d5; Sat, 29 Dec 2018 02:56:45 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: Date: Fri, 28 Dec 2018 18:56:43 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd , freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> To: mmel@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 99B7D81FBB X-Spamd-Bar: + X-Spamd-Result: default: False [1.07 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.14)[-0.138,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.93)[0.932,0]; NEURAL_HAM_LONG(-0.28)[-0.277,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.06)[ip: (3.31), ipnet: 66.163.184.0/21(1.16), asn: 36646(0.92), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.185.163.66.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 03:07:00 -0000 On 2018-Dec-28, at 12:12, Mark Millard wrote: > On 2018-Dec-28, at 05:13, Michal Meloun = wrote: >=20 >> Mark, >> this is known problem with qemu-user-static. >> Emulation of every single interruptible syscall is broken by design = (it >> have signal related races). Theses races cannot be solved without = major >> rewrite of syscall emulation code. >> Unfortunately, nobody actively works on this, I think. >>=20 >=20 > Thanks for the note setting some expectations. >=20 > On the evidence that I have I expect that more is going on than that: >=20 > A) The hang-up always happens and always in the same place. So > it would appear that no race is involved. >=20 > B) (A) is true even for varying the number of builders in parallel > (so other builds also happening) and the number of jobs allowed per > builder. It also fails for only one builder allowed only one process. > (I get traces from that last kind of context.) >=20 > C) The problem started on the package-building servers for armv7 > and armv6 without qemu-user-static having an update (FreeBSD and > cmake had updates, for example). >=20 > D) The problem is only observed for targeting armv7 and armv6 as > far as I can tell. I've never seen it for aarch64, neither my > own builds nor when I looked at the package-building server > history. >=20 > At least that is what got me started. (I've since learned that > qemu-user-static uses fork in place of a requested vfork.) >=20 > My ktrace/kdump experiment yesterday showed something odd for the > kevent that hangs in cmake: >=20 > 93172 qemu-arm-static CALL = kevent(0x3,0x7ffffffe7d40,0x2,0x7ffffffd7d40,0x400,0) > 93172 qemu-arm-static STRU struct kevent[] =3D { { ident=3D6, = filter=3DEVFILT_READ, flags=3D0x1, fflags=3D0, data=3D0, = udata=3D0x0 } > { ident=3D0x0, filter=3D, flags=3D0, = fflags=3D0x8, data=3D0x1ffff, udata=3D0x0 } } >=20 > Note the 0x2 argument to kevent and the apparently-odd 2nd entry in = the struct > kevent[]. The kevent use is from cmake. >=20 > So far I've not identified a signal being delivered at a time that = would seem > to me to be likely to contribute. (But this is not familiar code so my = judgment > is likely not the best.) >=20 > Note: I normally run FreeBSD using a non-debug kernel, even when using > head. (The kernel does have symbols.) The detail of the signal usage involved leading up to the hang-up, starting from just before the "press return" for the "make FLAVOR=3Dqt5" command that I had entered: The only "Interrupted system call" prior to my killing the hung cmake process was (kdump -H -r -S output): 93172 100717 qemu-arm-static CALL = execve[59](0x10392,0x8605051a0,0x860cf5400) 93172 101706 qemu-arm-static RET nanosleep[240] -1 errno 4 = Interrupted system call 93172 100717 qemu-arm-static NAMI "/bin/sh" 93172 100717 sh RET execve[59] JUSTRETURN 93172 100717 sh CALL readlink[58](0x207a65,0x7fffffffccc0,0x400) This is where ninja (via qemu-arm-static) execve's the amd64-native = /bin/sh (to in turn later run cmake via qemu-arm-static). (This was after the fork = [for the requested vfork].) So it is for the close-down of the thread that was in nanosleep. There were no PSIG's and no sigreturn's prior to the kill according to = the kdump output. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-toolchain@freebsd.org Sat Dec 29 13:33:53 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB266141F798 for ; Sat, 29 Dec 2018 13:33:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 416D46F120 for ; Sat, 29 Dec 2018 13:33:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 05B42141F796; Sat, 29 Dec 2018 13:33:53 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E836E141F795 for ; Sat, 29 Dec 2018 13:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 78D116F11B for ; Sat, 29 Dec 2018 13:33:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CF2451E501 for ; Sat, 29 Dec 2018 13:33:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTDXpkT024316 for ; Sat, 29 Dec 2018 13:33:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTDXpcB024315 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 13:33:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234070] problem with lld and wildcard characters in version scripts Date: Sat, 29 Dec 2018 13:33:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tijl@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 13:33:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234070 --- Comment #1 from Tijl Coosemans --- Created attachment 200601 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D200601&action= =3Dedit qt5-version.patch Quoting https://bugs.llvm.org/show_bug.cgi?id=3D40176: "If more than one cl= ause in a version script match the same symbol, the last one takes precedence. T= hus, if you have the catch-all clause at end (i.e. "*"), it overwrites everythin= g." This patch for Qt5 changes the version scripts to put the catch-all first.= =20 Note that if this is committed all ports that depend on Qt5 need to be rebu= ilt because many library symbols will get a different (corrected) version label. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 14:09:55 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D372F142098F for ; Sat, 29 Dec 2018 14:09:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6DC616FFB1 for ; Sat, 29 Dec 2018 14:09:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 3196B142098C; Sat, 29 Dec 2018 14:09:55 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1FE44142098B for ; Sat, 29 Dec 2018 14:09:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B2EB46FFAB for ; Sat, 29 Dec 2018 14:09:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id F3C511E976 for ; Sat, 29 Dec 2018 14:09:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTE9r12023384 for ; Sat, 29 Dec 2018 14:09:53 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTE9rcO023383 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 14:09:53 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234070] problem with lld and wildcard characters in version scripts Date: Sat, 29 Dec 2018 14:09:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 14:09:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234070 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Keywords| |patch --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 15:59:26 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA2E4142445C for ; Sat, 29 Dec 2018 15:59:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3E9C774465 for ; Sat, 29 Dec 2018 15:59:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id F37C6142445B; Sat, 29 Dec 2018 15:59:25 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E084C142445A for ; Sat, 29 Dec 2018 15:59:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6070A74460 for ; Sat, 29 Dec 2018 15:59:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 89AD71F964 for ; Sat, 29 Dec 2018 15:59:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTFxOVU055701 for ; Sat, 29 Dec 2018 15:59:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTFxOKR055700 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 15:59:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234070] devel/qt5: problem with lld and wildcard characters in version scripts Date: Sat, 29 Dec 2018 15:59:24 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tijl@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: kde@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 15:59:26 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234070 Tijl Coosemans changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |toolchain@FreeBSD.org Assignee|toolchain@FreeBSD.org |kde@FreeBSD.org Summary|problem with lld and |devel/qt5: problem with lld |wildcard characters in |and wildcard characters in |version scripts |version scripts --- Comment #2 from Tijl Coosemans --- Assign to kde@ for patch review. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 12:15:44 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB31E141A20A for ; Sat, 29 Dec 2018 12:15:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 64FC36BEBC for ; Sat, 29 Dec 2018 12:15:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2911A141A206; Sat, 29 Dec 2018 12:15:44 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1637D141A204 for ; Sat, 29 Dec 2018 12:15:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A4E186BEB9 for ; Sat, 29 Dec 2018 12:15:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id DDFBB1D955 for ; Sat, 29 Dec 2018 12:15:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTCFgHR012296 for ; Sat, 29 Dec 2018 12:15:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTCFgwE012292 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 12:15:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234480] multimedia/aom: clang 7 crashes with aom >= 1.0.0.1109 Date: Sat, 29 Dec 2018 12:15:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: dim@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc bug_status assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 12:15:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234480 Dimitry Andric changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |dim@FreeBSD.org Status|New |Open Assignee|toolchain@FreeBSD.org |dim@FreeBSD.org --- Comment #3 from Dimitry Andric --- Reproduced, minimized and reported upstream: https://bugs.llvm.org/show_bug.cgi?id=3D40181 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 19:05:32 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 909CC142AA28 for ; Sat, 29 Dec 2018 19:05:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 2BD1082268 for ; Sat, 29 Dec 2018 19:05:32 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id E3499142AA27; Sat, 29 Dec 2018 19:05:31 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D19A3142AA26 for ; Sat, 29 Dec 2018 19:05:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5762882265 for ; Sat, 29 Dec 2018 19:05:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9D2B81574 for ; Sat, 29 Dec 2018 19:05:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTJ5USs037965 for ; Sat, 29 Dec 2018 19:05:30 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTJ5Uj8037964 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 19:05:30 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234480] multimedia/aom: clang 7 crashes with aom >= 1.0.0.1109 Date: Sat, 29 Dec 2018 19:05:30 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rgrimes@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: dim@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 19:05:32 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234480 Rodney W. Grimes changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |toolchain@FreeBSD.org --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 29 22:17:27 2018 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B69BD142EBA4 for ; Sat, 29 Dec 2018 22:17:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3936D8786E for ; Sat, 29 Dec 2018 22:17:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id EAF41142EBA3; Sat, 29 Dec 2018 22:17:26 +0000 (UTC) Delivered-To: toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D7EB4142EBA2 for ; Sat, 29 Dec 2018 22:17:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 642E487868 for ; Sat, 29 Dec 2018 22:17:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8858330D4 for ; Sat, 29 Dec 2018 22:17:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBTMHPah096760 for ; Sat, 29 Dec 2018 22:17:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBTMHPsF096759 for toolchain@FreeBSD.org; Sat, 29 Dec 2018 22:17:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: toolchain@FreeBSD.org Subject: [Bug 234480] multimedia/aom: clang 7 crashes with aom >= 1.0.0.1109 Date: Sat, 29 Dec 2018 22:17:25 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: dim@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Dec 2018 22:17:27 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234480 Dimitry Andric changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |brooks@FreeBSD.org --- Comment #8 from Dimitry Andric --- (In reply to doctor from comment #7) > Crash on compile now >=20 > Assertion failed: ((VT.getVectorNumElements() + N2C->getZExtValue() <=3D > N1.getValueType().getVectorNumElements()) && "Extract subvector overflow!= "), > function getNode, file > /usr/ports/devel/llvm70/work/llvm-7.0.1.src/lib/CodeGen/SelectionDAG/ > SelectionDAG.cpp, line 4708. > Stack dump: > 0. Program arguments: /usr/local/llvm70/bin/clang-7 Ah, you're using the port version of clang 7.0, which doesn't yet have the patch. It's a little annoying that we have to apply those in two places. Brooks, are you OK with adding the patches of base r342592 and base r342593= to the llvm70 port? I can put up review if you like --=20 You are receiving this mail because: You are on the CC list for the bug.=