From owner-freebsd-emulation@freebsd.org Mon Dec 31 00:38:57 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E674143B896 for ; Mon, 31 Dec 2018 00:38:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-12.consmr.mail.bf2.yahoo.com (sonic304-12.consmr.mail.bf2.yahoo.com [74.6.128.35]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0A3C375568 for ; Mon, 31 Dec 2018 00:38:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 5ER293AVM1nYvxUVQp1SOJ2JY9oTqoEra0yamggZlr6CsuilPTlX3gomiy4MtUd Ai16CS9aKKe0y63Eu0yMAi4HgptjfXkUHxkx2xwotBJ81PkM35hsMX9WRbffkFH4wHX1XxgEkUVy qphqY1NniQt2sG0lE4VBG3wIFVVX._j9tv0B8bIQ7HX33PEnpqIi8kSSB8FCP6Duvw06QfkcPX90 j64kjbA60H1vx1oC2lPTu2XHILSDr6s0a9n1W8K_scpf7BNmSdgFPM4SZJ4Yl2X6iKguTX6i0qWX V6A0Mh8wfahwP7DA3eC1wXPmfPSmiEKfOdkk5ckpPaZJ30Qfgim9N9LHJt3IvmBx3cBiRara_7Ba LlxTiMTN.rrDZyXRzz.UgRMsG53XDvoGRKN1CITGni.GPFoKzPz25zK4zO_NUGDRIjcHgIlDyRXX GXK0e4HAKVM_.uHb50YfbZKmDp.I_vE.445lN16zMku9FkQ35gnzDUzJ5NemPhKjIxWtPSBCWwce ZKrErVCcrwLRwkoIcCnI.NG2eroXWJtwa9hsr_MgEhU2E7ue.wC5kg.pAddj5lA47_.DWtsaH0gk 6RGrWwsPmPvn_7_k7wSXy8P.8hJJkdhSHL9AjhNPjxd2iSWSN8H1tvTAGxGnpcNVxlgA6A8dwRW7 PWaVhGv6lAaNXGU_xxC68g2rvDZASL1M7mePK4xVOTtmycZflzCTJbWGQAaNvC2KqZCZ61rr2fdv U4w6kMiNrSMIf_6npPOMwv85gLKWY9yQelxlBs8lAq_9whoYozrqceWpsvzxW8crmcC_IyhQpPB6 XC_WL0uznyX9_8tEP_Y8WK7TGykFbWPbwoC0Pk8gI2gOCXFCn9Y7G2obXG1zw9J.sljgCfdmQH_u 4pf6A7HIm_gMJPM4TojLBoWqcYhGN4BOtK6wERh2944zfcQerFxrp5HZEAcF2z8m25LgZ4vqtlb9 3NIV9Ki8UcyKekwfOkzNGdVbnzHmC1_RROrbOrsTsPsLnwhQI_060DFpqseYJaYNkOlH50Dezy1x Q1HKf093xalJFKBw45_dU_i3.dOKz.iUlJ4HDvgTtUHA0PkZWyKz0TulI.U9OtjLxiQ0op.A- Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.bf2.yahoo.com with HTTP; Mon, 31 Dec 2018 00:38:49 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp422.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 57b6b0495726289929d5de26bdecfcdf; Mon, 31 Dec 2018 00:38:44 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> Date: Sun, 30 Dec 2018 16:38:42 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd , freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> To: mmel@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 0A3C375568 X-Spamd-Bar: / X-Spamd-Result: default: False [0.94 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.31)[-0.307,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.46)[0.457,0]; NEURAL_HAM_LONG(-0.11)[-0.108,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.41)[ip: (4.36), ipnet: 74.6.128.0/21(1.54), asn: 26101(1.23), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[35.128.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 00:38:57 -0000 On 2018-Dec-28, at 12:12, Mark Millard wrote: > On 2018-Dec-28, at 05:13, Michal Meloun = wrote: >=20 >> Mark, >> this is known problem with qemu-user-static. >> Emulation of every single interruptible syscall is broken by design = (it >> have signal related races). Theses races cannot be solved without = major >> rewrite of syscall emulation code. >> Unfortunately, nobody actively works on this, I think. >>=20 >=20 > Thanks for the note setting some expectations. > . . . It turns out that I've been through (part of?) this before and mikael.urankar@gmail.com had back then provided a qemu-user-static patch (that might have been arm specific or 32-bit target specific when running on a 64-bit host). (The qemu-user-static code structure seems to have changed some afterwards and the patch is no longer where he had pointed me to back then.) To show size and offsets on armv7 vs. armd64 for struct kevent I use: # more kevent_size_offsets.c=20 #include "/usr/include/sys/event.h" // kevent #include // offsetof #include // printf int main() { printf("%lu\n", (unsigned long) sizeof(struct kevent)); printf("ident %lu\n", (unsigned long) offsetof(struct kevent, = ident)); printf("filter %lu\n", (unsigned long) offsetof(struct kevent, = filter)); printf("flags %lu\n", (unsigned long) offsetof(struct kevent, = flags)); printf("fflags %lu\n", (unsigned long) offsetof(struct kevent, = fflags)); printf("data %lu\n", (unsigned long) offsetof(struct kevent, = data)); printf("udata %lu\n", (unsigned long) offsetof(struct kevent, = udata)); printf("ext %lu\n", (unsigned long) offsetof(struct kevent, = ext)); return 0; } It ends up showing on armv7 (under qemu-arm-static insteead of native, = not that it matters here): # ./a.out 64 ident 0 filter 4 flags 6 fflags 8 data 16 udata 24 ext 32 On amd64 (native) it ends up as: # ./a.out 64 ident 0 filter 8 flags 10 fflags 12 data 16 udata 24 ext 32 Thus a translation of layout is required when hosted. This is for: struct kevent { __uintptr_t ident; /* identifier for this event */ short filter; /* filter for event */ unsigned short flags; /* action flags for kqueue */ unsigned int fflags; /* filter flag value */ __int64_t data; /* filter data value */ void *udata; /* opaque user data identifier = */ __uint64_t ext[4]; /* extensions */ }; But qemu-user-static has for translation purposes: struct target_freebsd_kevent { abi_ulong ident; int16_t filter; uint16_t flags; uint32_t fflags; int64_t data; abi_ulong udata; uint64_t ext[4]; } __packed; (note the __packed) for which in amd64's qemu_arm_static has the size and offsets: # gdb qemu-arm-static . . . (gdb) p/d sizeof(struct target_freebsd_kevent) $1 =3D 56 (gdb) p/d &((struct target_freebsd_kevent *)0)->ident $2 =3D 0 (gdb) p/d &((struct target_freebsd_kevent *)0)->filter $3 =3D 4 (gdb) p/d &((struct target_freebsd_kevent *)0)->flags $4 =3D 6 (gdb) p/d &((struct target_freebsd_kevent *)0)->fflags $5 =3D 8 (gdb) p/d &((struct target_freebsd_kevent *)0)->data $6 =3D 12 (gdb) p/d &((struct target_freebsd_kevent *)0)->udata $7 =3D 20 (gdb) p/d &((struct target_freebsd_kevent *)0)->ext $8 =3D 24 which which does not match the armv7 offsets for data, udata, or ext and does not have the right size for struct target_freebsd_kevent[] indexing to match armv7's struct target_freebsd_kevent[] indexing. This in turn makes the do_freebsd_kevent code do the wrong thing in its: struct target_freebsd_kevent *target_changelist, *target_eventlist; . . . for (i =3D 0; i < arg3; i++) { __get_user(changelist[i].ident, = &target_changelist[i].ident); __get_user(changelist[i].filter, = &target_changelist[i].filter); __get_user(changelist[i].flags, = &target_changelist[i].flags); __get_user(changelist[i].fflags, = &target_changelist[i].fflags); __get_user(changelist[i].data, &target_changelist[i].data); /* __get_user(changelist[i].udata, = &target_changelist[i].udata); */ #if TARGET_ABI_BITS =3D=3D 32 changelist[i].udata =3D (void = *)(uintptr_t)target_changelist[i].udata; tswap32s((uint32_t *)&changelist[i].udata); #else changelist[i].udata =3D (void = *)(uintptr_t)target_changelist[i].udata; tswap64s((uint64_t *)&changelist[i].udata); #endif __get_user(changelist[i].ext[0], = &target_changelist[i].ext[0]); __get_user(changelist[i].ext[1], = &target_changelist[i].ext[1]); __get_user(changelist[i].ext[2], = &target_changelist[i].ext[2]); __get_user(changelist[i].ext[3], = &target_changelist[i].ext[3]); } . . . for (i =3D 0; i < arg5; i++) { __put_user(eventlist[i].ident, &target_eventlist[i].ident); __put_user(eventlist[i].filter, = &target_eventlist[i].filter); __put_user(eventlist[i].flags, &target_eventlist[i].flags); __put_user(eventlist[i].fflags, = &target_eventlist[i].fflags); __put_user(eventlist[i].data, &target_eventlist[i].data); /* __put_user(eventlist[i].udata, = &target_eventlist[i].udata);*/ #if TARGET_ABI_BITS =3D=3D 32 tswap32s((uint32_t *)&eventlist[i].data); target_eventlist[i].data =3D (uintptr_t)eventlist[i].data; #else tswap64s((uint64_t *)&eventlist[i].data); target_eventlist[i].data =3D (uintptr_t)eventlist[i].data; #endif __put_user(eventlist[i].ext[0], = &target_eventlist[i].ext[0]); __put_user(eventlist[i].ext[1], = &target_eventlist[i].ext[1]); __put_user(eventlist[i].ext[2], = &target_eventlist[i].ext[2]); __put_user(eventlist[i].ext[3], = &target_eventlist[i].ext[3]); } I'll eventually do something to have struct target_freebsd_kevent for amd64-native targeting armv7 and see if that is sufficient to avoid the problem in my context. Previously removing the __packed was enough to make the structure the same size with the same offsets as for armv7. (Such might not have been appropriate to all targets.) armv6 would have the same problem as I understand things. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Mon Dec 31 01:26:16 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4B5AE143D208 for ; Mon, 31 Dec 2018 01:26:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-14.consmr.mail.bf2.yahoo.com (sonic314-14.consmr.mail.bf2.yahoo.com [74.6.132.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8644777031 for ; Mon, 31 Dec 2018 01:26:14 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: GCCA8DAVM1kUKxhiZC8K8BRc3IuZ3yLJKqIXG.4_x_.P8EH8M7AagoQvnyA5vTG 5AvuN8stcgjNaxL9Z1HIvS79Yf0mnvF8yWwGNK9H6I22rLXQr2cvQYUyBzb2NHeyKzEhNkF.I7gf AT1gqwO8UQnMy.f1xseIx2lRfJkWnUWBs_paoelClh02aNIc3k9EY0r_VbabEIO7CzEcCfYCRP2l Ixws9HIw2mjF6Se.Hx2WqSXUaVb8E6RvQ6e3q6dhZ1C_C4hXbjVCu6pTCPL0X1EaVq39iWMvt5Ax fGIfgOZjZoGrc._pWtdtDh2v5bncKvsKRtrb1Zvy3tIq22USMlsBVWA_e_PuStLvnJ.sqae.XQ7V zh9MCPnhpvnoyqnQYpnfaBk4kx9zMU5VYMu.gvvJdGrrH6R0D4EmwDuSe_uW3dT4ol0q1qXdSlA0 vPO0WFE_pPYCyvY8K6Zi7G.L2Be3AwqPdu.1a2dQgCLmUrl79701SNNnSXakEW6ZGknARz9bIpos .9Y0n6yjA5L8Rbc7MyTr2bH8ZlaUS64_Ruwxr6gSZMEaKI1lCnDt5Foc0uckzQ3nFNU9ZyZ.JShv pPjfq1vTyBQgQOX9VT_fivUoIzeKMEnE_ssLiLtNCaaYkaaHePGd_qB.JH2.cNhlaYTDFsTkJICT gYph1la6EJ3H3Vw_9_rzr3HlZ42tPP_nx9F1TY0cjjsCAchArofoNlvGR20iSDJmqw8W2NnxWySG SLqtcoRlD0r3zTxeysQF1Bg5Es0fgnHdnK7oBJ7IXrIWGIaDxqIPAIBE1MEaPqhKG9sFwUkCBQS3 OZ7FyYGxbEcgBTBjTawK2zxNK6povtllziHMruDNUD1dMfjSV.Iq5KerMx5N8_XQUkDW1EOdWS2t RzOFeJTi8LzkH8K7ZkzZTrWjnlcBicPFnD2P0StLY_u9yUzHwyEDWTiKqYGc1BtGUVicKersZZCP Zz2TZD3eMQmwUktY5oQf9gnEPj37V6KQZEbhPWjXdMik47gtXxU5JGLD._BtPwN_I0UR8uHwgWn8 LjRqP9RCh_FovgCix9YUfMf6RTes7Jg0TnRGkTO_tc7YFQeWCt4mSY1UNWd_g9Lj2BiImZLE0VMg - Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.bf2.yahoo.com with HTTP; Mon, 31 Dec 2018 01:26:08 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp403.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 04ffb892c2e4a018446db2706dc31fd2; Mon, 31 Dec 2018 01:26:04 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: Date: Sun, 30 Dec 2018 17:26:01 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd , freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> To: mmel@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 8644777031 X-Spamd-Bar: ++ X-Spamd-Result: default: False [2.01 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.10)[-0.098,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.90)[0.904,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.58)[ip: (5.23), ipnet: 74.6.128.0/21(1.54), asn: 26101(1.23), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.13)[0.125,0]; RCVD_IN_DNSWL_NONE(0.00)[124.132.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 01:26:16 -0000 [Removing __packed did make the size and offsets match armv7 and the build worked based on the reconstructed qemu-arm-static.] On 2018-Dec-30, at 16:38, Mark Millard wrote: > On 2018-Dec-28, at 12:12, Mark Millard wrote: >=20 >> On 2018-Dec-28, at 05:13, Michal Meloun = wrote: >>=20 >>> Mark, >>> this is known problem with qemu-user-static. >>> Emulation of every single interruptible syscall is broken by design = (it >>> have signal related races). Theses races cannot be solved without = major >>> rewrite of syscall emulation code. >>> Unfortunately, nobody actively works on this, I think. >>>=20 >>=20 >> Thanks for the note setting some expectations. >> . . . >=20 >=20 > It turns out that I've been through (part of?) this before and > mikael.urankar@gmail.com had back then provided a qemu-user-static > patch (that might have been arm specific or 32-bit target specific > when running on a 64-bit host). (The qemu-user-static code structure > seems to have changed some afterwards and the patch is no longer > where he had pointed me to back then.) >=20 > To show size and offsets on armv7 vs. armd64 for struct kevent > I use: >=20 > # more kevent_size_offsets.c=20 > #include "/usr/include/sys/event.h" // kevent > #include // offsetof > #include // printf >=20 > int > main() > { > printf("%lu\n", (unsigned long) sizeof(struct kevent)); > printf("ident %lu\n", (unsigned long) offsetof(struct kevent, = ident)); > printf("filter %lu\n", (unsigned long) offsetof(struct kevent, = filter)); > printf("flags %lu\n", (unsigned long) offsetof(struct kevent, = flags)); > printf("fflags %lu\n", (unsigned long) offsetof(struct kevent, = fflags)); > printf("data %lu\n", (unsigned long) offsetof(struct kevent, = data)); > printf("udata %lu\n", (unsigned long) offsetof(struct kevent, = udata)); > printf("ext %lu\n", (unsigned long) offsetof(struct kevent, = ext)); > return 0; > } >=20 > It ends up showing on armv7 (under qemu-arm-static insteead of native, = not > that it matters here): >=20 > # ./a.out > 64 > ident 0 > filter 4 > flags 6 > fflags 8 > data 16 > udata 24 > ext 32 >=20 > On amd64 (native) it ends up as: >=20 > # ./a.out > 64 > ident 0 > filter 8 > flags 10 > fflags 12 > data 16 > udata 24 > ext 32 >=20 > Thus a translation of layout is required when hosted. This is for: >=20 > struct kevent { > __uintptr_t ident; /* identifier for this event */ > short filter; /* filter for event */ > unsigned short flags; /* action flags for kqueue */ > unsigned int fflags; /* filter flag value */ > __int64_t data; /* filter data value */ > void *udata; /* opaque user data identifier = */ > __uint64_t ext[4]; /* extensions */ > }; >=20 > But qemu-user-static has for translation purposes: >=20 > struct target_freebsd_kevent { > abi_ulong ident; > int16_t filter; > uint16_t flags; > uint32_t fflags; > int64_t data; > abi_ulong udata; > uint64_t ext[4]; > } __packed; >=20 > (note the __packed) for which in amd64's qemu_arm_static has > the size and offsets: >=20 > # gdb qemu-arm-static > . . . > (gdb) p/d sizeof(struct target_freebsd_kevent) > $1 =3D 56 > (gdb) p/d &((struct target_freebsd_kevent *)0)->ident > $2 =3D 0 > (gdb) p/d &((struct target_freebsd_kevent *)0)->filter > $3 =3D 4 > (gdb) p/d &((struct target_freebsd_kevent *)0)->flags > $4 =3D 6 > (gdb) p/d &((struct target_freebsd_kevent *)0)->fflags > $5 =3D 8 > (gdb) p/d &((struct target_freebsd_kevent *)0)->data > $6 =3D 12 > (gdb) p/d &((struct target_freebsd_kevent *)0)->udata > $7 =3D 20 > (gdb) p/d &((struct target_freebsd_kevent *)0)->ext > $8 =3D 24 >=20 > which which does not match the armv7 offsets for > data, udata, or ext and does not have the right size > for struct target_freebsd_kevent[] indexing to > match armv7's struct target_freebsd_kevent[] indexing. >=20 > This in turn makes the do_freebsd_kevent code do the wrong > thing in its: >=20 > struct target_freebsd_kevent *target_changelist, *target_eventlist; > . . . > for (i =3D 0; i < arg3; i++) { > __get_user(changelist[i].ident, = &target_changelist[i].ident); > __get_user(changelist[i].filter, = &target_changelist[i].filter); > __get_user(changelist[i].flags, = &target_changelist[i].flags); > __get_user(changelist[i].fflags, = &target_changelist[i].fflags); > __get_user(changelist[i].data, &target_changelist[i].data); > /* __get_user(changelist[i].udata, = &target_changelist[i].udata); */ > #if TARGET_ABI_BITS =3D=3D 32 > changelist[i].udata =3D (void = *)(uintptr_t)target_changelist[i].udata; > tswap32s((uint32_t *)&changelist[i].udata); > #else > changelist[i].udata =3D (void = *)(uintptr_t)target_changelist[i].udata; > tswap64s((uint64_t *)&changelist[i].udata); > #endif > __get_user(changelist[i].ext[0], = &target_changelist[i].ext[0]); > __get_user(changelist[i].ext[1], = &target_changelist[i].ext[1]); > __get_user(changelist[i].ext[2], = &target_changelist[i].ext[2]); > __get_user(changelist[i].ext[3], = &target_changelist[i].ext[3]); > } > . . . > for (i =3D 0; i < arg5; i++) { > __put_user(eventlist[i].ident, &target_eventlist[i].ident); > __put_user(eventlist[i].filter, = &target_eventlist[i].filter); > __put_user(eventlist[i].flags, &target_eventlist[i].flags); > __put_user(eventlist[i].fflags, = &target_eventlist[i].fflags); > __put_user(eventlist[i].data, &target_eventlist[i].data); > /* __put_user(eventlist[i].udata, = &target_eventlist[i].udata);*/ > #if TARGET_ABI_BITS =3D=3D 32 > tswap32s((uint32_t *)&eventlist[i].data); > target_eventlist[i].data =3D (uintptr_t)eventlist[i].data; > #else > tswap64s((uint64_t *)&eventlist[i].data); > target_eventlist[i].data =3D (uintptr_t)eventlist[i].data; > #endif > __put_user(eventlist[i].ext[0], = &target_eventlist[i].ext[0]); > __put_user(eventlist[i].ext[1], = &target_eventlist[i].ext[1]); > __put_user(eventlist[i].ext[2], = &target_eventlist[i].ext[2]); > __put_user(eventlist[i].ext[3], = &target_eventlist[i].ext[3]); > } >=20 >=20 >=20 > I'll eventually do something to have struct target_freebsd_kevent for > amd64-native targeting armv7 and see if that is sufficient to avoid = the > problem in my context. Previously removing the __packed was enough to > make the structure the same size with the same offsets as for armv7. > (Such might not have been appropriate to all targets.) >=20 > armv6 would have the same problem as I understand things. Using commented out __packed in: struct target_freebsd11_kevent { abi_ulong ident; int16_t filter; uint16_t flags; uint32_t fflags; abi_long data; abi_ulong udata; } ; // __packed; struct target_freebsd_kevent { abi_ulong ident; int16_t filter; uint16_t flags; uint32_t fflags; int64_t data; abi_ulong udata; uint64_t ext[4]; } ; // __packed; in = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall_defs.h was sufficient to allow the multimedia/gstreamer1-qt@qt5 build to = complete: no more hang-up. So this is likely what is wrong for the packages-builders as well. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Mon Dec 31 05:01:28 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 299C21421CB5 for ; Mon, 31 Dec 2018 05:01:28 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: from mail-ua1-x942.google.com (mail-ua1-x942.google.com [IPv6:2607:f8b0:4864:20::942]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 63FEF870B4 for ; Mon, 31 Dec 2018 05:01:25 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: by mail-ua1-x942.google.com with SMTP id d19so8398631uaq.11 for ; Sun, 30 Dec 2018 21:01:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chen-org-nz.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=QFPFb9gWPIEkXrgIwZErCATYwfa5hjOLLmWTWs7MFh8=; b=XwfRu4l07HKkDgYJMTBNHWd4xdPiktOFg5uaO/uaFQDDAz97yjgsxnZdV6g12Pe3Sj EdiFSZo20vxTScii9v9WjxKnDYAIdztrB+eW/nwLfyauJhOr9/BRT9Pp7iB25mplFb5R glFehgS5T3yyTmxXqAnJATIor3hCOTsqd8haEby93UGsGYxYML7Fs/9uNy9zXoxKReoe f/UqmEeUmv4+iv5WYFEHocb49UthVmbdBhjU/UFD0b/0S7cbWLGZZ5RpCdEDEiUfsexP pztzvElMfFI+iI9NywXtzz0xjRHy+xDb3drdyBeBFkjju5ePndbM7cMeScDse6fLjsTF xwmw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=QFPFb9gWPIEkXrgIwZErCATYwfa5hjOLLmWTWs7MFh8=; b=jAjzqA6h/AJwfaQDPUYXcuMP6aCxRqN5YVP69+Nl62ozXdLmUgcBf4ese6ia7RF2T/ s12h+kMoF//54eDPfwmHvgcn4dCP8FAWmGYHq1lRRDiYqKDMznTnE+lkWoe261Y6vTea v5kbsDXcoFyENf/qusf3racJBSG7lWeIM2HYcyw2huR0LBX8oqoQKsGO14R99ULB2Y8m SFBlbieh8tWMEWOG9CEP9f3p2lR77LosrWsmi3f54cdHBh8WbUpENwrNof7E/nb1UjV8 UZQb+0gxxxApaByXgi9kQegBvowiTl9iulk1irAvQj6QStOcygkEjo+a3yUlOvWcrJMZ Z1wg== X-Gm-Message-State: AJcUukeLjkKuCbDpgUZjrmzq/LC0OO1Is6YDuzKvHoviOoMMUv4edVwc gxIgYzoL2k4O23jzUnuQMmIjjuGSEisfhZmPn5yAFw== X-Google-Smtp-Source: ALg8bN4J8U9fsaGZYK/bh16OjkRonekxzqt8NmRA+IHsb83EmbS/YLQ83Dp+gRCgqwKwaNqAFpnblxe3aGzb65QIQAc= X-Received: by 2002:ab0:73c4:: with SMTP id m4mr13774871uaq.101.1546232484418; Sun, 30 Dec 2018 21:01:24 -0800 (PST) MIME-Version: 1.0 References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> In-Reply-To: From: Jonathan Chen Date: Mon, 31 Dec 2018 18:01:13 +1300 Message-ID: Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] To: Mark Millard Cc: mmel@freebsd.org, freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 63FEF870B4 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=pass header.d=chen-org-nz.20150623.gappssmtp.com header.s=20150623 header.b=XwfRu4l0 X-Spamd-Result: default: False [1.68 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.60)[-0.596,0]; R_DKIM_ALLOW(-0.20)[chen-org-nz.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.98)[0.981,0]; IP_SCORE(0.27)[ip: (4.89), ipnet: 2607:f8b0::/32(-1.91), asn: 15169(-1.55), country: US(-0.08)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-emulation@freebsd.org]; DMARC_NA(0.00)[chen.org.nz]; NEURAL_HAM_LONG(-0.16)[-0.161,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[chen-org-nz.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[alt1.aspmx.l.google.com]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_IN_DNSWL_NONE(0.00)[2.4.9.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; SUSPICIOUS_RECIPS(1.50)[] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 05:01:28 -0000 On Mon, 31 Dec 2018 at 14:34, Mark Millard via freebsd-ports wrote: > > [Removing __packed did make the size and offsets match armv7 > and the build worked based on the reconstructed qemu-arm-static.] Thanks for the analysis Mark! I've been suffering quite a few hangups with my ports crossbuilds on amd64->armv7 on 12-STABLE, and I'll be trying your suggestions to see whether it resolves the issue. Cheers. -- Jonathan Chen From owner-freebsd-emulation@freebsd.org Mon Dec 31 08:05:47 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 129DC142AD5C for ; Mon, 31 Dec 2018 08:05:47 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-20.consmr.mail.ne1.yahoo.com (sonic309-20.consmr.mail.ne1.yahoo.com [66.163.184.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 37B098F007 for ; Mon, 31 Dec 2018 08:05:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: oyA5EscVM1mqNZkxzVcgwUqOKvV_U3MMD3PfEZxE_7AieulH4igtebPJaoW6pk8 hK1ONZrFGv8Fx0ncA0cuBJWacJMWD1G7hV0Y0AqB1C2fAD4ztXhFj7ocFQsK9Ne6WEpIFgyExWdW KmCzFjIoUcrt0bGjBCftAzAyOXlkNlseptznyyiodskp2aVZDpVIR2bCswSmxCK_yMEvhYqMkIJP D9jQs4KXG2W756WJvaDhMAPwb.ekLf2XxUEPYUq2TTJL0TzgVULeXcPPwpPu8Piiofi5FcdV90vS 0P2hDfePQJJPjAV0FsSZSKpFGozNPw0GjZggko7PRs8Y3wM7IOdZAu_Vt6Bh0B0pv6moKi9f4Nfq eDdq8QE6iNl1kyhqjZOylUhTXpqjXvzqcUZ63KiZs1ruVFKNDtFcRFyPGjIVl.eK3vpdGQYiP5_q rLf4hq0k6zDPDSOdkXAhZIv53AJpWWcgKWwQiDgrPDvRp7EcSRCL3GWE5a..dGHkXxk0bCXxhbMr aV3Bjj0XOAw4dOxyjYMZ31FU6euUTAblvg8Vhd2ToLDzlQpR3zF3HGnqh9TVW0Jb4nyR7INTSO1g plKKY7L66YOEVkHXPE1ekAe0S0.eahjFXC7Z2va20w_glHUvfDYq6HzqOidIhdK87VVVd3Sdacw_ bnq0vVK46MXBETwCHXHTmCNv.4IqOxtTYRA0ZoPgidpAN0Z1slNo4OHSXAkLKo0IdfxvkQZnXvB_ VGL8c4VFYm.GxUTocR9EiNSNm53GtP9W7p270Nf67NvbjV4iQhU6.QOhmPWtSyvb5iKK8AuZY8k. ZoIm0q3v0iEwLxjR8fxPb.Ebd6UCstE5ZZRk.PVpyLR3CHwjN9eGaU7E2mpJdd.dctz9xHiBwgky E0YLlmYJF0H8jiv63SpL0vg00vTT0I233ZtpMjTvl8yP4NtafXdo0OQK_oOhqPBRfAPAY4WYDnLI SsAJgLEjCP5DTCocGB_VEOx7EL5GmNC4pFbD2zxyiuOSZTnHEPRS37Kqvt0JZAJ6qxnuIXhB1cMP sUEcdez.ZPgMgsrTYQxXkm06kjleBPqrGKoWksaTpySWvZpThuUwLy6H5APtAf3gm4.UoSmAjsoc - Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.ne1.yahoo.com with HTTP; Mon, 31 Dec 2018 08:05:37 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp417.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 9a7d61f623df156aa1a0a58f98273bbf; Mon, 31 Dec 2018 08:05:33 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: Date: Mon, 31 Dec 2018 00:05:31 -0800 Cc: mmel@freebsd.org, freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Transfer-Encoding: 7bit Message-Id: <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> To: Jonathan Chen X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 37B098F007 X-Spamd-Bar: + X-Spamd-Result: default: False [1.74 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; RCPT_COUNT_SEVEN(0.00)[7]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.54)[-0.544,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.64)[0.642,0]; NEURAL_HAM_LONG(-0.42)[-0.425,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.08)[ip: (3.39), ipnet: 66.163.184.0/21(1.15), asn: 36646(0.92), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[146.184.163.66.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[146.184.163.66.rep.mailspike.net : 127.0.0.17]; SUSPICIOUS_RECIPS(1.50)[] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 08:05:47 -0000 On 2018-Dec-30, at 21:01, Jonathan Chen wrote: > On Mon, 31 Dec 2018 at 14:34, Mark Millard via freebsd-ports > wrote: >> >> [Removing __packed did make the size and offsets match armv7 >> and the build worked based on the reconstructed qemu-arm-static.] > > Thanks for the analysis Mark! I've been suffering quite a few hangups > with my ports crossbuilds on amd64->armv7 on 12-STABLE, and I'll be > trying your suggestions to see whether it resolves the issue. If you have something like a kqread state for a hang-up consistently in the same place, then Mikael Urankar 's fix (or any other way of getting the right sizes and field offsets for kevent) has a chance of fixing what you have observed. But if you have a form of hang-up that shows no sign of being tied to kevent or hangs-up only sometimes, I'd be surprised if the __packed change(s) would fix the issue. I've seen such racy hang-ups from lld's creation of (#cpu)+2 threads, as FreeBSD counts cpus. I've selectively forced -Wl,--no-threads at times in specific contexts to avoid that. binutils ld does not tolerate the option. ports does not appear to have an equivalent of: LDFLAGS.lld+= -Wl,--no-threads that would be lld specific. === Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Sun Dec 30 10:22:54 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A5CFD142226B for ; Sun, 30 Dec 2018 10:22:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 362A68032C for ; Sun, 30 Dec 2018 10:22:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id ED94F142226A; Sun, 30 Dec 2018 10:22:53 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B2A151422268 for ; Sun, 30 Dec 2018 10:22:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F42D8032B for ; Sun, 30 Dec 2018 10:22:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 07B7B335F; Sun, 30 Dec 2018 10:22:53 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id DCE70335E for ; Sun, 30 Dec 2018 10:22:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 85D238032A for ; Sun, 30 Dec 2018 10:22:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CD8019DED for ; Sun, 30 Dec 2018 10:22:51 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBUAMpea052284 for ; Sun, 30 Dec 2018 10:22:51 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBUAMpFi052283 for vbox@FreeBSD.org; Sun, 30 Dec 2018 10:22:51 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Sun, 30 Dec 2018 10:22:51 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: guru@unixarea.de X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 2F42D8032B X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 11:27:58 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Dec 2018 10:22:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #11 from Matthias Apitz --- I have had a look in the provided log file of the synth build; it says among other things: emulators___virtualbox-ose-2018-12-25.log: ... DEFAULT_VERSIONS+=3Dsamba=3D4.7 DEFAULT_VERSIONS+=3Dssl=3Dbase #DEFAULT_VERSIONS+=3Dssl=3Dopenssl ... Checking for ssl: found version OpenSSL 1.1.1a-freebsd 20 Nov 2018, OK. ... my log file says: virtualbox-ose-5.2.22_2.log-base: ... .if ${.CURDIR:M*/emulators/virtualbox-ose} DEFAULT_VERSIONS=3Dssl=3Dbase .endif ... Checking for ssl: found version OpenSSL 1.1.1a-freebsd 20 Nov 2018, OK. ... kBuild: Linking VBoxDTrace ld: error: undefined symbol: SSL_load_error_strings >>> referenced by tcp.c:314 (/wrkdirs/usr/ports/emulators/virtualbox-ose/wo= rk/VirtualBox-5.2.22/src/VBox/RDP/client-1.8.3/tcp.c:314) >>> /wrkdirs/usr/ports/emulators/virtualbox-ose/work/VirtualB= ox-5.2.22/out/freebsd.amd64/release/obj/rdesktop-vrdp/tcp.o:(tcp_tls_connec= t) a look into the compiled source has: # find * -exec grep -H SSL_load_error_strings {} \; src/VBox/RDP/client-1.8.3/tcp.c: SSL_load_error_strings(); src/VBox/Runtime/VBox/VBoxRTDeps.cpp: (PFNRT)SSL_load_error_strings, src/VBox/Runtime/r3/win/VBoxRT-openssl-pre-1.1.def: SSL_load_error_strin= gs src/VBox/RDP/client-1.8.3/tcp.c: ... /* Establish a SSL/TLS 1.0 connection */ RD_BOOL tcp_tls_connect(void) ^^^^^^^^^^^^^^^ { int err; long options; if (!g_ssl_initialized) { SSL_load_error_strings(); ^^^^^^^^^^^^^^^^^^^^^^^^^ SSL_library_init(); ^^^^^^^^^^^^^^^^^^^ g_ssl_initialized =3D True; } /* create process context */ if (g_ssl_ctx =3D=3D NULL) { ... a look into the SSL library in base shows: [root@jet ~]# uname -a FreeBSD jet 13.0-CURRENT FreeBSD 13.0-CURRENT r342378 GENERIC amd64 [root@jet ~]# strings /usr/lib/libssl.a | grep OpenSSL OpenSSL 1.1.1a-freebsd 20 Nov 2018 [root@jet ~]# nm /usr/lib/libssl.a | grep SSL_load_error_strings i.e. the missing symbol SSL_load_error_strings is not in my library in base= ;=20 I'm clueless how this can link in the system where it works; can the OP please check two things: 1. the resulting object file ..../tcp.o if this contains a reference to SSL_load_error_strings, and if not why? 2. the library /usr/lib/libssl.a if this contains the symbol SSL_load_error_strings, and if not how this can be resolved for tcp.o --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Sun Dec 30 12:39:28 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36964142610C for ; Sun, 30 Dec 2018 12:39:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id BC5C98426A for ; Sun, 30 Dec 2018 12:39:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 7FEB6142610B; Sun, 30 Dec 2018 12:39:27 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 45059142610A for ; Sun, 30 Dec 2018 12:39:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DCFD184268 for ; Sun, 30 Dec 2018 12:39:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id B26674678; Sun, 30 Dec 2018 12:39:26 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id AE1604677 for ; Sun, 30 Dec 2018 12:39:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 619A484267 for ; Sun, 30 Dec 2018 12:39:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A4D18B0E3 for ; Sun, 30 Dec 2018 12:39:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBUCdPbm019615 for ; Sun, 30 Dec 2018 12:39:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBUCdPwD019610 for vbox@FreeBSD.org; Sun, 30 Dec 2018 12:39:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Sun, 30 Dec 2018 12:39:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: Trond.Endrestol@ximalas.info X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: DCFD184268 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-3.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 11:28:08 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Dec 2018 12:39:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #12 from Trond.Endrestol@ximalas.info --- (In reply to Matthias Apitz from comment #11) uname -a FreeBSD FQDN 12.0-STABLE FreeBSD 12.0-STABLE #0 r342575: Fri Dec 28 19:16:59 CET 2018 root@FQDN:/usr/obj/usr/src/amd64.amd64/sys/E5530 amd64 strings /usr/lib/libssl.a | grep OpenSSL OpenSSL 1.1.1a-freebsd 20 Nov 2018 nm /usr/lib/libssl.a | grep SSL_load_error_strings [nothing found] On inspection of /usr/include/openssl/ssl.h, I came across this, around line 1595: # if OPENSSL_API_COMPAT < 0x10100000L # define SSL_load_error_strings() \ OPENSSL_init_ssl(OPENSSL_INIT_LOAD_SSL_STRINGS \ | OPENSSL_INIT_LOAD_CRYPTO_STRINGS, NULL) # endif nm .../VirtualBox-5.2.22/out/freebsd.amd64/release/obj/rdesktop-vrdp/tcp.o U __error U __inet_addr U __stdoutp U close U connect U ERR_print_errors_fp U error U EVP_PKEY_free 0000000000000058 b g_in U g_network_error 0000000000000000 b g_out U g_reconnect_loop 00000000000000a0 b g_run_ui 0000000000000050 b g_sock 0000000000000048 b g_ssl 00000000000000a8 b g_ssl_ctx 00000000000000a4 b g_ssl_initialized 0000000000000000 D g_tcp_port_rdp U g_user_quit U gethostbyname U getpeername U getsockname U getsockopt U i2d_PublicKey U OPENSSL_init_ssl U recv U select U send U setsockopt U socket U sprintf U SSL_connect U SSL_CTX_free U SSL_CTX_new U SSL_CTX_set_options U SSL_free U SSL_get_error U SSL_get_peer_certificate U SSL_get_shutdown U SSL_new U SSL_pending U SSL_read U SSL_set_fd U SSL_shutdown U SSL_write U strerror 0000000000000710 T tcp_connect 00000000000008e0 T tcp_disconnect 0000000000000950 T tcp_get_address 00000000000000b0 b tcp_get_address.ipaddr 0000000000000000 T tcp_init 00000000000009c0 T tcp_is_connected 0000000000000260 T tcp_recv 0000000000000a00 T tcp_reset_state 0000000000000a80 T tcp_run_ui 0000000000000060 T tcp_send 00000000000004e0 T tcp_tls_connect 0000000000000620 T tcp_tls_get_server_pubkey U TLSv1_client_method U ui_select U X509_free U X509_get_pubkey U xfree U xmalloc U xrealloc I have a hypothesis that my global ccache might be fooling me, although I m= ade sure to really empty my ccache after upgrading base from 11.2 to 12.0 back = in late October. I'll rename my existing ccache, create a new one, and see how that goes. I haven't removed security/openssl from my LiveSystem since net/rdesktop needs it, but that should not affect synth and its chroots. rdesktop and OpenSSL from ports might go away once I'm familiar with net/remmina. Some months ago I was struck by a mishap where Subversion left some subtrees untouched because I had edited some files here and there. Since then I alwa= ys run svn up --accept=3Dtheirs-full --non-interactive /usr/ports to get rid o= f my own conflicting changes and ensuring the entire ports tree is always correc= t. The only change I have in effect are some changes to Mk/bsd.gecko.mk to all= ow for the use of ccache and a couple of extra patchfiles for ports-mgmt/synth, and all those changes should be benign. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Sun Dec 30 13:10:05 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0B06F14269EB for ; Sun, 30 Dec 2018 13:10:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8BD3D84F16 for ; Sun, 30 Dec 2018 13:10:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 4724914269EA; Sun, 30 Dec 2018 13:10:04 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1FF5B14269E8 for ; Sun, 30 Dec 2018 13:10:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B0D0484F14 for ; Sun, 30 Dec 2018 13:10:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 86D9C4AE9; Sun, 30 Dec 2018 13:10:03 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 833844AE8 for ; Sun, 30 Dec 2018 13:10:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 478E684F13 for ; Sun, 30 Dec 2018 13:10:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8C6ACB570 for ; Sun, 30 Dec 2018 13:10:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBUDA2FK045556 for ; Sun, 30 Dec 2018 13:10:02 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBUDA2Ew045555 for vbox@FreeBSD.org; Sun, 30 Dec 2018 13:10:02 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Sun, 30 Dec 2018 13:10:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: Trond.Endrestol@ximalas.info X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: B0D0484F14 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-3.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 11:28:17 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Dec 2018 13:10:05 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #13 from Trond.Endrestol@ximalas.info --- (In reply to Trond.Endrestol from comment #12) My hypothesis has been falsified: ccache -s cache directory /var/cache/ccache primary config /var/cache/ccache/ccache.conf secondary config (readonly) /usr/local/etc/ccache.conf stats zero time Sun Dec 30 13:44:01 2018 cache hit (direct) 0 cache hit (preprocessed) 0 cache miss 0 cache hit rate 0.00 % called for link 26 no input file 94 cleanups performed 0 files in cache 0 cache size 0.0 kB max cache size 32.0 GB ccache isn't used by emulators/virtualbox-ose. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Sun Dec 30 16:22:44 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E7B57142CD19 for ; Sun, 30 Dec 2018 16:22:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 6C4EA8B3F8 for ; Sun, 30 Dec 2018 16:22:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 2A812142CD11; Sun, 30 Dec 2018 16:22:43 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 05482142CD0D for ; Sun, 30 Dec 2018 16:22:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B66D8B3F7 for ; Sun, 30 Dec 2018 16:22:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 89E597249; Sun, 30 Dec 2018 16:22:42 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 84CDB7248 for ; Sun, 30 Dec 2018 16:22:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 490EE8B3F6 for ; Sun, 30 Dec 2018 16:22:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 72280D411 for ; Sun, 30 Dec 2018 16:22:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBUGMfvL018213 for ; Sun, 30 Dec 2018 16:22:41 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBUGMfcW018212 for vbox@FreeBSD.org; Sun, 30 Dec 2018 16:22:41 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Sun, 30 Dec 2018 16:22:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: guru@unixarea.de X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 9B66D8B3F7 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.989,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US] X-Mailman-Approved-At: Mon, 31 Dec 2018 11:28:27 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Dec 2018 16:22:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #14 from Matthias Apitz --- (In reply to Trond.Endrestol from comment #12) Based on your findings, I tried in the make.conf file for poudriere: .if ${.CURDIR:M*/emulators/virtualbox-ose} DEFAULT_VERSIONS+=3Dssl=3Dbase CFLAGS+=3D -DOPENSSL_API_COMPAT=3D0 .endif but this does no change anything; --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Sun Dec 30 21:00:13 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8ABF41434CB5 for ; Sun, 30 Dec 2018 21:00:13 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A99F66D79D for ; Sun, 30 Dec 2018 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 6D7171434CAF; Sun, 30 Dec 2018 21:00:12 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3291C1434CAE for ; Sun, 30 Dec 2018 21:00:12 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CA4B86D792 for ; Sun, 30 Dec 2018 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by freefall.freebsd.org (Postfix) id 94903A9B1; Sun, 30 Dec 2018 21:00:11 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 61266A9B0 for ; Sun, 30 Dec 2018 21:00:11 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D5CF66D786 for ; Sun, 30 Dec 2018 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 20E6DFBC5 for ; Sun, 30 Dec 2018 21:00:10 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBUL0AdR088054 for ; Sun, 30 Dec 2018 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBUL0Ace088049 for vbox@FreeBSD.org; Sun, 30 Dec 2018 21:00:10 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201812302100.wBUL0Ace088049@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: vbox@FreeBSD.org Subject: Problem reports for vbox@FreeBSD.org that need special attention Date: Sun, 30 Dec 2018 21:00:09 +0000 MIME-Version: 1.0 X-Rspamd-Queue-Id: CA4B86D792 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[FreeBSD.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 12:56:22 +0000 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Dec 2018 21:00:13 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 226073 | emulators/virtualbox-ose-additions -- fix two min 1 problems total for which you should take action. From owner-freebsd-emulation@freebsd.org Mon Dec 31 08:37:08 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 018F6142BCB2 for ; Mon, 31 Dec 2018 08:37:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A7F628FF82 for ; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 636E1142BCAC; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 40DA7142BCAB for ; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E90688FF7F for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id C15E414F45; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id A31D114F44 for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3F6018FF7C for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 8465E162B7 for ; Mon, 31 Dec 2018 08:37:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBV8b5fN034334 for ; Mon, 31 Dec 2018 08:37:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBV8b5eE034332 for vbox@FreeBSD.org; Mon, 31 Dec 2018 08:37:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 234520] emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 Date: Mon, 31 Dec 2018 08:37:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: E90688FF7F X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.994,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 12:56:35 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 08:37:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234520 Bug ID: 234520 Summary: emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 Product: Ports & Packages Version: Latest Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: Individual Port(s) Assignee: vbox@FreeBSD.org Reporter: d8zNeCFG@aon.at Assignee: vbox@FreeBSD.org Flags: maintainer-feedback?(vbox@FreeBSD.org) Scenario: - Server A: . running FreeBSD 12.0 . re0: . providing virtual disks on ZVOLs . acting as VirtualBox host with virtual disks attached directly (via vmd= ks pointing to the ZVOLs) . using bridged networking to re0 . providing NFS storage for FreeBSD ports distfiles - Server B: . running FreeBSD 12.0 . em0: . acting as VirtualBox host with virtual disks attached via iSCSI from se= rver A . using bridged networking to em0 - Server C: . running Windows 10 Professional . acting as Hyper-V host with virtual disks attached via iSCSI from serve= r A . using bridged networking to the LAN interface - VirtualBox client: . FreeBSD 12.0 i386 . can run on either server A, B, or C . Builds ports, fetching distfiles from a shared directory on host A via = NFS. Result: - If the client is run on A or C, NFS between the client and server A runs = as usual. - If the client is run on B (i.e., NFS is done over the wire to machine A),= NFS has extremely poor performance, to the point of no throughput at all - The iSCSI provisioning from A for the client on B is running at normal sp= eed (i.e., the emulated machine itself sees normal disk performance) - When B was still running 11.2, NFS performance was normal. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Mon Dec 31 08:37:07 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AAB39142BCAD for ; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 5AE478FF80 for ; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 1EC69142BCA9; Mon, 31 Dec 2018 08:37:07 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0648142BCA8 for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 919ED8FF7E for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 5EEBE14F43; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 4057B14F42 for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 059E68FF7B for ; Mon, 31 Dec 2018 08:37:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 41DB5162B6 for ; Mon, 31 Dec 2018 08:37:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBV8b50q034328 for ; Mon, 31 Dec 2018 08:37:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBV8b5Zn034326 for vbox@FreeBSD.org; Mon, 31 Dec 2018 08:37:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: maintainer-feedback requested: [Bug 234520] emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 Date: Mon, 31 Dec 2018 08:37:04 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 919ED8FF7E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 12:56:45 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 08:37:07 -0000 Bugzilla Automation has asked vbox@FreeBSD.org for maintainer-feedback: Bug 234520: emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234520 --- Description --- Scenario: - Server A: . running FreeBSD 12.0 . re0: . providing virtual disks on ZVOLs . acting as VirtualBox host with virtual disks attached directly (via vmd= ks pointing to the ZVOLs) . using bridged networking to re0 . providing NFS storage for FreeBSD ports distfiles - Server B: . running FreeBSD 12.0 . em0: . acting as VirtualBox host with virtual disks attached via iSCSI from se= rver A . using bridged networking to em0 - Server C: . running Windows 10 Professional . acting as Hyper-V host with virtual disks attached via iSCSI from serve= r A . using bridged networking to the LAN interface - VirtualBox client: . FreeBSD 12.0 i386 . can run on either server A, B, or C . Builds ports, fetching distfiles from a shared directory on host A via = NFS. Result: - If the client is run on A or C, NFS between the client and server A runs = as usual. - If the client is run on B (i.e., NFS is done over the wire to machine A),= NFS has extremely poor performance, to the point of no throughput at all - The iSCSI provisioning from A for the client on B is running at normal sp= eed (i.e., the emulated machine itself sees normal disk performance) - When B was still running 11.2, NFS performance was normal. From owner-freebsd-emulation@freebsd.org Mon Dec 31 08:52:21 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EC9B1142C365 for ; Mon, 31 Dec 2018 08:52:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 7C100904E6 for ; Mon, 31 Dec 2018 08:52:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 3A201142C364; Mon, 31 Dec 2018 08:52:20 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 17A22142C363 for ; Mon, 31 Dec 2018 08:52:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B2843904E5 for ; Mon, 31 Dec 2018 08:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 9AE2515069; Mon, 31 Dec 2018 08:52:19 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 9666015068 for ; Mon, 31 Dec 2018 08:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5BCAA904E3 for ; Mon, 31 Dec 2018 08:52:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9709E1658D for ; Mon, 31 Dec 2018 08:52:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id wBV8qIJt068840 for ; Mon, 31 Dec 2018 08:52:18 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id wBV8qIgL068839 for vbox@FreeBSD.org; Mon, 31 Dec 2018 08:52:18 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 234520] emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 Date: Mon, 31 Dec 2018 08:52:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: B2843904E5 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Mon, 31 Dec 2018 12:56:54 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 08:52:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234520 Martin Birgmeier changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |d8zNeCFG@aon.at --- Comment #1 from Martin Birgmeier --- The same thing happens with a 64-bit client running FreeBSD 12.0 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Mon Dec 31 18:17:05 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 36BE1143BD23 for ; Mon, 31 Dec 2018 18:17:05 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: from mail-vs1-xe43.google.com (mail-vs1-xe43.google.com [IPv6:2607:f8b0:4864:20::e43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B616B76936 for ; Mon, 31 Dec 2018 18:17:02 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: by mail-vs1-xe43.google.com with SMTP id y27so16831359vsi.1 for ; Mon, 31 Dec 2018 10:17:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=chen-org-nz.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=oA8R8OTMVP5nqZ/84IF8NfoX9sHi/7YO4Ow7mg9WvCc=; b=jnCS1RJP+l9efv1+10mxdhoEMORIUXqbYExoOXbHJu+Wk6K2A7E619csAmTbGAUWiX hPDNQgsBfnTIoeJg2W/0xmiH9Bzl7dPdCgtYvd6DDWqLMT8yDLo5sMVplJB2+RmkvnH5 1pcKhfJrQb0houBCQiRwU1hEM8TeMkJI0DWPvNCLIMcxLAmkaSB/Rxijma1ZUicyWC+p /CycYBu4AzK7sc2oXpyAk4oxQiVYvqrM/r70AtCZJA1qYYNHQBCsOIdmBPzesCnatE+F WM0IiWeGSHackIKhVtgMy3FrODMevsZrxSVml+3tMcgr1cjDSufevcaT8mG6ghJrL81t qXng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=oA8R8OTMVP5nqZ/84IF8NfoX9sHi/7YO4Ow7mg9WvCc=; b=J80QRK7c/eCg8DjO5cp13uAGe7S7YAdW+4wgUYS2RPj4F4ycUeMwNpkzp4yO6DEsOj XWLAgIvzKGtQrqa8cLeIZkat+mF9IWS68zmB2u0VG6NCOw/0sEjxCeA9BJH2BquzCYto F+Im+sI0hR8cakwzNnGN5m8Tyfduub2/GuzauPdIr764crhaJN/U8spAr6VM4ZuH85yW NXVOx4NoLPIkt2kT42cmmsP0/LlZ9NTjr5MBlSf5NcVZelkyBn962u0FEexNvnCYDmUT qGLfpxbKRyfBF87jFduL72ibI3a8/OjVOOlVtZrJyhlOp9XcKBZIxt/Bp017bwTIg5n6 PvEA== X-Gm-Message-State: AA+aEWbOhpq0+M/nCD6RFTMwK4a2N5cv4msTkZaQgxiPEKngCq28Lr/Q 6Ga2TV7uurCdvIp2qjuN+UIM3PHdvtMxDrf4Izf3Jw== X-Google-Smtp-Source: AFSGD/WamyiZqPddZL65QVX3WFI7IxrVHjb44abOfNyRGwpfDS/3I8ZAXuthlo+BCwyrKz/KzHrqfqNF5k9lgT+qJpA= X-Received: by 2002:a67:5bdc:: with SMTP id w89mr15553112vsg.109.1546280221720; Mon, 31 Dec 2018 10:17:01 -0800 (PST) MIME-Version: 1.0 References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> In-Reply-To: <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> From: Jonathan Chen Date: Tue, 1 Jan 2019 07:16:40 +1300 Message-ID: Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] To: Mark Millard Cc: mmel@freebsd.org, freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: B616B76936 X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; dkim=pass header.d=chen-org-nz.20150623.gappssmtp.com header.s=20150623 header.b=jnCS1RJP X-Spamd-Result: default: False [0.19 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.85)[-0.848,0]; R_DKIM_ALLOW(-0.20)[chen-org-nz.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.50)[0.502,0]; IP_SCORE(0.09)[ip: (4.03), ipnet: 2607:f8b0::/32(-1.95), asn: 15169(-1.56), country: US(-0.08)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-emulation@freebsd.org]; DMARC_NA(0.00)[chen.org.nz]; NEURAL_HAM_LONG(-0.75)[-0.745,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt1.aspmx.l.google.com]; DKIM_TRACE(0.00)[chen-org-nz.20150623.gappssmtp.com:+]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_IN_DNSWL_NONE(0.00)[3.4.e.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; SUSPICIOUS_RECIPS(1.50)[] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 18:17:05 -0000 On Mon, 31 Dec 2018 at 21:05, Mark Millard wrote: [...] > But if you have a form of hang-up that shows no sign of being tied > to kevent or hangs-up only sometimes, I'd be surprised if the __packed > change(s) would fix the issue. With the __packed-modified qemu-user-static, the amd64->armv7 crossbuilds does not hang anymore, but I get build failures instead. Interestingly enough, an unmodified qemu-user-static gets further along in a amd64->armv6 crossbuild, with only one reproducible hang. Cheers. -- Jonathan Chen From owner-freebsd-emulation@freebsd.org Mon Dec 31 20:05:52 2018 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90041143E896 for ; Mon, 31 Dec 2018 20:05:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.ne1.yahoo.com (sonic310-22.consmr.mail.ne1.yahoo.com [66.163.186.203]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 31DF482F51 for ; Mon, 31 Dec 2018 20:05:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: UQN7FI0VM1n5nZk3WR3voHWoQkVFc6BC1vW._8LcwBAopbwO7AHVzxG7qmOPrlx u50CR1tA3.WxwmDlKbwNj8g8eYbLA4i8GBr2XryOSXBXnkHqCyf7wR..dwylwJosA8HBa8z9xNDk l5a7x3z.bV17_Ej_JvXYfE0Mo7jL_cOhTJzIlzNHi6xRUffUJdSAZCRLmBEWGWwIlvI7G22Ud.Ta D7HveKucFNnU7jtBYndMvV6b5BAh9aRJ.RlMm18pzIxflRK0pBA1a9olyHtbtRGJv7lXtnRTr60q 0FdzRc6Em3k_Qgoy3q.WEa1pxqav4MpLlaiTi0Tjbjg_6Bie.3qvw46S7Uv2.baDUmJgXYEhcnuK CUYHQpVZSzZkovyYweOeM47ig8Hj1qK8_HPkcufNw_.ADmUqk0E6_v.BtPX_GWrMPJqfNoVG8rID G9e4gh6SCTaZiQRxOwSOZs3Jow5lMbx1w4F0MS3R1zexC0O.FnurA7ey2GL4MxJnVLRUimGkWUJc AzNip8NuCDI4X8EOq6rfHsX9qDta_ZpiElLGPMROOrtM8SybWX6k9mzFaPX5.0.VxFITauYev82o 25wWdSe0iaIwl.eYGb0Ik7GH4qTefPVzuYmsWDsiSTdS4movVJz2XaTAbjVtuYN2pZvhg_MGGevb EcjeejGw.VhCRi69NPw3ADGA33XGbsoHeDyZXo.eiTcM1WPMBSOHtkne8kqijQbadAKhOOJVbqK0 kmVzK9fPFTKDH4pkMRQUleVMk_mVSDQlVLY4qc1efmZTPDTquHdJiC_tQMtsDqpuhEs46acJR5T4 txwRCOVOntd13W42m.2PwnHMq_nBea.440oPOkGeapy1tPXkUJje0hHqesXDCd3PSmQhLVe5oypm uCGoXH82YZnQD1_QWmEpHiGkf3Ayx_yfaBN9kN_DFaumSZOkDKilGebtSBVUzbOMwZP_1cIcg9jJ bA.df6KbWuB8F1p0.bP.FAzSarQjsYPBZMkYyGoKNAk2POecB5ZvKqYqGPqbLhuOGJYt1qh0xSbS mCKsJ0AujfgArFk5N6KAnPv2Z69tLoKudQpOmBUJgxASb77WfuQ6RsbXhYe.4t2WUCs8w Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.ne1.yahoo.com with HTTP; Mon, 31 Dec 2018 20:05:43 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp409.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 0742405770bc6c0a367a982b1de2352c; Mon, 31 Dec 2018 20:05:39 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: Date: Mon, 31 Dec 2018 12:05:37 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <984303F3-ADCD-442A-B1E9-412B8365B399@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> To: Jonathan Chen X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 31DF482F51 X-Spamd-Bar: / X-Spamd-Result: default: False [0.55 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.50)[-0.495,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.84)[0.844,0]; NEURAL_HAM_LONG(-0.40)[-0.397,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.11)[ip: (3.58), ipnet: 66.163.184.0/21(1.13), asn: 36646(0.91), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[203.186.163.66.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 20:05:52 -0000 On 2018-Dec-31, at 10:16, Jonathan Chen wrote: > On Mon, 31 Dec 2018 at 21:05, Mark Millard = wrote: > [...] >> But if you have a form of hang-up that shows no sign of being tied >> to kevent or hangs-up only sometimes, I'd be surprised if the = __packed >> change(s) would fix the issue. >=20 > With the __packed-modified qemu-user-static, the amd64->armv7 > crossbuilds does not hang anymore, but I get build failures instead. > Interestingly enough, an unmodified qemu-user-static gets further > along in a amd64->armv6 crossbuild, with only one reproducible hang. I tend to compare cross-build failures to native-build attempts. The multimedia-gstreamer1-qt@qt5 hang-up was qemu-arm-static specific, not occurring native. That and being reliable about hanging-up is what prompted the investigation. The lld thread fanout hangup also has only happened under qemu-arm-static but I do not have a context with more than 4 cores for armv7: far less than 28 (FreeBSD under Hyper-V) or 32 cpus (FreeBSD native) that I use for cross-builds. I do not know if you care to but it is possible to see if the FreeBSD package builders get failures or hangs for the same ports. I use head port build examples below: http://beefy16.nyi.freebsd.org/jail.html?mastername=3Dhead-armv7-default http://beefy8.nyi.freebsd.org/jail.html?mastername=3Dhead-armv6-default The pages displayed show a list of port version (p??????) and freebsd version (s??????) looking like p??????_s?????? . Those links take you to pages for exploring the built, failed, skipped, and ignored ports. Of course, for race-condition problems in builds, checking is messier because of needing to look at possibly many port/system combinations. My attempts to build x11/lumina fail for: [00:01:02] [01] [00:00:00] Building multimedia/libvpx | libvpx-1.7.0_2 [00:02:23] [01] [00:01:21] Saved multimedia/libvpx | libvpx-1.7.0_2 = wrkdir to: = /usr/local/poudriere/data/wrkdirs/FBSDFSSDjailArmV7-default/default/libvpx= -1.7.0_2.tar [00:02:23] [01] [00:01:21] Finished multimedia/libvpx | libvpx-1.7.0_2: = Failed: build [00:02:24] [01] [00:01:22] Skipping multimedia/ffmpeg | ffmpeg-4.1,1: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-libav | = gstreamer1-libav-1.14.4_2: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-plugins-core | = gstreamer1-plugins-core-1.14: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping x11/lumina | lumina-1.4.1,3: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping x11/lumina-core | lumina-core-1.4.1: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed . . . [00:06:19] Failed ports: multimedia/libvpx:build [00:06:19] Skipped ports: multimedia/ffmpeg multimedia/gstreamer1-libav = multimedia/gstreamer1-plugins-core x11/lumina x11/lumina-core [FBSDFSSDjailArmV7-default] [2018-12-30_17h04m02s] [committing:] Queued: = 7 Built: 1 Failed: 1 Skipped: 5 Ignored: 0 Tobuild: 0 Time: = 00:06:16 Native build attempts on an armv7 get the same. But I'm still at: # svnlite info | grep "Re[plv]" Relative URL: ^/head Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 341836 Last Changed Rev: 341836 because I froze at that while investigating the reliable hang and have not started progressing again yet. Last I looked the head-armv7-default package builds were also failing for libvpx if I remember right. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Tue Jan 1 01:45:40 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9F336142255A for ; Tue, 1 Jan 2019 01:45:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 1DFEF8E5F8 for ; Tue, 1 Jan 2019 01:45:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id D5FF31422557; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 99AAF1422556 for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4057B8E5F5 for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 17E5039EB; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 147DF39EA for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AD2998E5F2 for ; Tue, 1 Jan 2019 01:45:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CB5801F92E for ; Tue, 1 Jan 2019 01:45:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x011jbDR027235 for ; Tue, 1 Jan 2019 01:45:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x011jbFo027234 for vbox@FreeBSD.org; Tue, 1 Jan 2019 01:45:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: maintainer-approval requested: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client : [Attachment 200668] vbox-ose.patch Date: Tue, 01 Jan 2019 01:45:37 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 4057B8E5F5 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Tue, 01 Jan 2019 02:42:44 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2019 01:45:40 -0000 Naram Qashat has asked vbox@FreeBSD.org for maintainer-approval: Bug 232969: emulators/virtualbox-ose: link error while linking the RDP clie= nt https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 Attachment 200668: vbox-ose.patch https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D200668&action=3Dedit --- Comment #15 from Naram Qashat --- Created attachment 200668 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D200668&action= =3Dedit vbox-ose.patch I actually fixed this on my own system by patching src/VBox/RDP/client-1.8.3/Makefile.kmk to not include /usr/lib in the LIBPA= TH of the RDP client. (The rest of the patch actually includes a fix from bug #228219, since I was including that in my local tree at the time, so if you want to ignore the Config.kmk patch for this bug, that's fine, I could resu= bmit without that portion.) From owner-freebsd-emulation@freebsd.org Tue Jan 1 01:45:40 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B221D142255B for ; Tue, 1 Jan 2019 01:45:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 437648E5F9 for ; Tue, 1 Jan 2019 01:45:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0485C1422559; Tue, 1 Jan 2019 01:45:40 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D60E11422558 for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7C1638E5F6 for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 546D739ED; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 5160C39EC for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 18CCC8E5F4 for ; Tue, 1 Jan 2019 01:45:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 3C9E91F930 for ; Tue, 1 Jan 2019 01:45:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x011jcfd027243 for ; Tue, 1 Jan 2019 01:45:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x011jc22027242 for vbox@FreeBSD.org; Tue, 1 Jan 2019 01:45:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Tue, 01 Jan 2019 01:45:37 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cyberbotx@cyberbotx.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc flagtypes.name attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 7C1638E5F6 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-1.00)[-0.995,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Tue, 01 Jan 2019 03:00:50 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2019 01:45:40 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 Naram Qashat changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cyberbotx@cyberbotx.com, | |vbox@FreeBSD.org Attachment #200668| |maintainer-approval?(vbox@F Flags| |reeBSD.org) --- Comment #15 from Naram Qashat --- Created attachment 200668 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D200668&action= =3Dedit vbox-ose.patch I actually fixed this on my own system by patching src/VBox/RDP/client-1.8.3/Makefile.kmk to not include /usr/lib in the LIBPA= TH of the RDP client. (The rest of the patch actually includes a fix from bug #228219, since I was including that in my local tree at the time, so if you want to ignore the Config.kmk patch for this bug, that's fine, I could resu= bmit without that portion.) --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Tue Jan 1 03:20:58 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5C43C1425B6A for ; Tue, 1 Jan 2019 03:20:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C38EE6AD9F for ; Tue, 1 Jan 2019 03:20:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: Wz_.scgVM1khe5KePqMyFXlkE6GTgublMfEO44SQCg.lgOj5KMs4VaCw7ajcmPi k_BdqefUXyaEiRGRe6GlzEHe6_IluIhSfsBiLsGgx1kSjbRjnUyaNFgV6qnHlf54d9vwGDLemX0G g7eGRlQadi2HOBwKHDivodc8Bb3G_hqa92WVpfuOHjL.DyVmH9PqGT6tSpdwhzhOk03G6pZVm8fs 535tE7AEviK.nB8wA5oGsgxEhrfmAiLXhSwbtJQkXRmvYY_f5Vikc__ecd5vmLlLJaLLyUJWx5go TlhvcFZrZDi89jMgpDX.3n.6rbT7M8pW1ICXlIYVd8VqyaOArzaoWpiAxkzMEF0p2WCLH_YL3rlg Kl4CkQkM9.dnCjvRNW5y8xEDRHDiiAkPbqOo1kBJ5K.HA8u0r4Ah1xMr9DRLSSXKOIXl7obqSXlV DlhDb.KnHnn_pSAtN0HO1FdU18rE3jPivtF51VPq9hSdLyzIkwZtpUOyfW.RDR69l3QHewiWuTcW oB.4Av.0BCGvLlI.k9OWyEKA7KwO5blugxNqzT1zj5OT3Qf0xM1fT88Z1lOEvKw8XAY8BsiWD0sB PUU9_c2b.Zy0jS4_GSJYhP8riDn488Xh9EdGp4.5bdJP1XZRUJ.Y6jslg23wYSB5ecgq1qCbw107 ks3_G5DeU3IyGroq5XnZQWoq3zb2HAEPNDtUb2oBIqCKWY61RwDzjvN.NYVxhG.JbMIEnQZekzAU EhF0d5lq7cagsXNxnpYOK2gLpqAD.uSj_eHzh_kcMqph_e3zsg3hW6Ld8QVFkrE7an_zp.HvNptf XyMS6MgzJ5RQ5MG4FZ1X1qMTmIs2Rw1GJd5cQabQQlFERRlC1Ix8kzNBeeow2EFzBayE4lZ6uktl KVic4.m8t4_vWYSCPSXAo3ftBDHiHd8VRc3MHnHiyVLLSwvb8_k9p0yHt6KR3.DGxp3w7wmjZhRj LEZTclDGa1fwp0G1T1shZuKidWjhKC6sDEsTRdjLoH2VDSHDDozOiU28Xm012.iWg.mfKgU_iF7t msW7W6o67K88YhjIWmiRIulHWzYUbVaOBj4dYEDfLDnasL0JR1jOL1_MECXGoGZqqSg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Tue, 1 Jan 2019 03:20:50 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp414.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID dbd0bb2a6a724229abedbad683618265; Tue, 01 Jan 2019 02:50:24 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: <984303F3-ADCD-442A-B1E9-412B8365B399@yahoo.com> Date: Mon, 31 Dec 2018 18:50:23 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <642A3C38-5229-4BA3-9BA7-CD78F52D0335@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> <984303F3-ADCD-442A-B1E9-412B8365B399@yahoo.com> To: Jonathan Chen X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: C38EE6AD9F X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.19 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.995,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.11)[0.109,0]; NEURAL_HAM_LONG(-0.99)[-0.995,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.20)[ipnet: 98.137.64.0/21(0.60), asn: 36647(0.48), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[146.64.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2019 03:20:58 -0000 [I listed my /usr/src svn veriosn information instead of /usr/ports . Correcting. . .] On 2018-Dec-31, at 12:05, Mark Millard wrote: > On 2018-Dec-31, at 10:16, Jonathan Chen wrote: >=20 >> On Mon, 31 Dec 2018 at 21:05, Mark Millard = wrote: >> [...] >>> But if you have a form of hang-up that shows no sign of being tied >>> to kevent or hangs-up only sometimes, I'd be surprised if the = __packed >>> change(s) would fix the issue. >>=20 >> With the __packed-modified qemu-user-static, the amd64->armv7 >> crossbuilds does not hang anymore, but I get build failures instead. >> Interestingly enough, an unmodified qemu-user-static gets further >> along in a amd64->armv6 crossbuild, with only one reproducible hang. >=20 > I tend to compare cross-build failures to native-build attempts. The > multimedia-gstreamer1-qt@qt5 hang-up was qemu-arm-static specific, > not occurring native. That and being reliable about hanging-up is > what prompted the investigation. >=20 > The lld thread fanout hangup also has only happened under > qemu-arm-static but I do not have a context with more than 4 cores for > armv7: far less than 28 (FreeBSD under Hyper-V) or 32 cpus (FreeBSD > native) that I use for cross-builds. >=20 > I do not know if you care to but it is possible to see if the FreeBSD > package builders get failures or hangs for the same ports. I use > head port build examples below: >=20 > http://beefy16.nyi.freebsd.org/jail.html?mastername=3Dhead-armv7-default= >=20 > http://beefy8.nyi.freebsd.org/jail.html?mastername=3Dhead-armv6-default >=20 > The pages displayed show a list of port version (p??????) and freebsd > version (s??????) looking like p??????_s?????? . Those links take you > to pages for exploring the built, failed, skipped, and ignored > ports. >=20 > Of course, for race-condition problems in builds, checking is messier > because of needing to look at possibly many port/system combinations. >=20 > My attempts to build x11/lumina fail for: >=20 > [00:01:02] [01] [00:00:00] Building multimedia/libvpx | libvpx-1.7.0_2 > [00:02:23] [01] [00:01:21] Saved multimedia/libvpx | libvpx-1.7.0_2 = wrkdir to: = /usr/local/poudriere/data/wrkdirs/FBSDFSSDjailArmV7-default/default/libvpx= -1.7.0_2.tar > [00:02:23] [01] [00:01:21] Finished multimedia/libvpx | = libvpx-1.7.0_2: Failed: build > [00:02:24] [01] [00:01:22] Skipping multimedia/ffmpeg | ffmpeg-4.1,1: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed > [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-libav | = gstreamer1-libav-1.14.4_2: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed > [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-plugins-core = | gstreamer1-plugins-core-1.14: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed > [00:02:24] [01] [00:01:22] Skipping x11/lumina | lumina-1.4.1,3: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed > [00:02:24] [01] [00:01:22] Skipping x11/lumina-core | = lumina-core-1.4.1: Dependent port multimedia/libvpx | libvpx-1.7.0_2 = failed > . . . > [00:06:19] Failed ports: multimedia/libvpx:build > [00:06:19] Skipped ports: multimedia/ffmpeg = multimedia/gstreamer1-libav multimedia/gstreamer1-plugins-core = x11/lumina x11/lumina-core > [FBSDFSSDjailArmV7-default] [2018-12-30_17h04m02s] [committing:] = Queued: 7 Built: 1 Failed: 1 Skipped: 5 Ignored: 0 Tobuild: 0 = Time: 00:06:16 >=20 > Native build attempts on an armv7 get the same. >=20 > But I'm still at: >=20 > . . . Correcting to have the /usr/ports information: # svnlite info /usr/ports/ | grep "Re[plv]" Relative URL: ^/head Repository Root: svn://svn.freebsd.org/ports Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 Revision: 484783 Last Changed Rev: 484783 >=20 > because I froze at that while investigating the reliable hang and > have not started progressing again yet. Last I looked the > head-armv7-default package builds were also failing for libvpx if > I remember right. Looks like more recently libvpx builds on the package builders. So next = time that I update the ports tree I'll get to see the next problem (if any). =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Tue Jan 1 01:47:10 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BA7D314225B5 for ; Tue, 1 Jan 2019 01:47:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4A2258E61B for ; Tue, 1 Jan 2019 01:47:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0DB8714225B4; Tue, 1 Jan 2019 01:47:10 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DF59F14225B3 for ; Tue, 1 Jan 2019 01:47:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 84C2D8E61A for ; Tue, 1 Jan 2019 01:47:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 5E1383A06; Tue, 1 Jan 2019 01:47:09 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 5AA193A05 for ; Tue, 1 Jan 2019 01:47:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 02A8A8E616 for ; Tue, 1 Jan 2019 01:47:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 46C601F935 for ; Tue, 1 Jan 2019 01:47:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x011l8fX028741 for ; Tue, 1 Jan 2019 01:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x011l81b028738 for vbox@FreeBSD.org; Tue, 1 Jan 2019 01:47:08 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Tue, 01 Jan 2019 01:47:08 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cyberbotx@cyberbotx.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 84C2D8E61A X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.995,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Tue, 01 Jan 2019 03:49:58 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2019 01:47:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #16 from Naram Qashat --- (In reply to Naram Qashat from comment #15) Oh, I should point out that I was compiling with libressl as opposed to ope= nssl from ports. But I believe this should fix the latter as well, I hope. --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Wed Jan 2 02:43:59 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EB66614321DF for ; Wed, 2 Jan 2019 02:43:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A91B96E5E2 for ; Wed, 2 Jan 2019 02:43:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: LAWn62YVM1kZnptCb7wVUs.rq0nxsLjkM4HCu3G4jTSBGz7rsFnfSGv57pzpJ_w kVxMvKFZm_3yMflld52DjxeWI1BoxzvqlnFRuaOkytQG2_nAR1suHpjNwIcjZfebHr_gOtoqCGwn xLxiyuuqWeQLnGxTOIk1G53VeLxsxUnPiQpHZo4CDfSjiODM37h1DfBo08KvYsZFDqjej3ZvH2du uUYvGg.C6dyXPm2UtJ3p8RvXvYVizbttPQPz1RhUGEqO3fh.fUszP9iAg32bfZeq_wss0khmgbML .XU0UJnlBkzTmFafjLhtNMTdMVZFIormxff0XbWnDOIXVI4rnMqZqxuk4YNJc0HD__3iso7xNn6q .5WRjHfxStmwevYewkHPfgGZ1alOTLHnkn2nEbikb1_QTd3Fbp4fi.3qCoCCN53OlILnGz2Vb3EI NoffKEAvcB9MCXYT3qER2oNnkXJUrtE3fxMFNzxlN5TYlWFONAvHxKLa4BvTC1sbMQ7IR5_6VNdz vLTBkxi7LGewlmJWqiCi2VKzlXbYyY7i.NO.0ygRXTQQnvewVSAXr.IL1vNYb21AkqRl.tRCd8cS FgQItfUnhKL9XLk4hvQCUwb6CsBvY5HEjA10gKqbVnq9vIuiANTkVEFUBn3Nn6jFfqHLkKuZprBP vmSx3eHjPHFK78Alr4G_cBFcoGOGKkcUKuQOvLTEDyMk_uNvnl53jX5VslOqd2JurI0zJzaBiVjT 0CS4QvFzPRmM.J9M724_jg4arQ0YaiEPsZrj5SYxL0LZFLDf6R37RNELrRHdbWx.aP.fdqW0O1Dp PBADUX24sJKpMOxtuFYTJGJkxXaxcp88.FZRT902Td82fbYKCzN_i1foz0w7AVzr0YzT99APnCKr medeX0u4bZzq_Tj3yh4wdCoRKU95ZjCMPMYPSFUtkwP_jATzdVrWLaueZZfk7evtWte_FNljOg1N 2iS77ayzeNxrXVX8K0Nm8nn1kMzDNTqDgPAVdBgWMjghMH7jQw8Ehjd7_.crJQ00bigwuskcM9X6 M4N7crxyNGCO5WLfzzNRQNb1E0zWrOXK0UxTa2_npXCv3yXgCXNsagmQayt4WJe5Q1ll_WIzt Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Wed, 2 Jan 2019 02:43:54 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp405.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 2ea84824158dc5b5004ef3d5e7a20719; Wed, 02 Jan 2019 02:43:50 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 (with backtrace, code, and value details) Message-Id: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> Date: Tue, 1 Jan 2019 18:43:49 -0800 Cc: freebsd-arm To: freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: A91B96E5E2 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.84 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.99)[-0.987,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-1.34)[ip: (-7.71), ipnet: 98.137.64.0/21(0.60), asn: 36647(0.48), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.69.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Jan 2019 02:43:59 -0000 The below showed up for poudiere-devel bulk getting stuck using one = FreeBSD cpu while building graphics/poppler-qt5 . This is not a kevent hang-up, = unlike the last hang-up that I analyzed. I do not yet know how repeatable this = is but the original hang-up and the one experiment the below is from. =46rom top: PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME = CPU COMMAND 12789 root 4 52 0 166M 33M 0 uwait 6 36:06 = 97.22% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/graphics/poppler-qt5/work/poppler-0 Note: The vast margority of the 36:06 has been stuck in the uwait loop = involved. =46rom ps -auxd: root 94075 0.0 0.0 12932 3552 1 S+ 10:42 0:01.21 = | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 root 1944 0.0 0.0 12932 3540 1 I+ 10:42 0:00.00 = | |-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 root 1957 0.0 0.0 12932 3556 1 I 10:42 0:00.04 = | |-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: = build_pkg (poppler-qt5-0.72.0) (sh) root 12328 0.0 0.0 12932 3548 1 I 10:49 0:00.00 = | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: = build_pkg (poppler-qt5-0.72.0) (sh) root 12329 0.0 0.0 10328 1756 1 IJ 10:49 0:00.01 = | | `-- /usr/bin/make -C /usr/ports/graphics/poppler-qt5 = stage root 12350 0.0 0.0 9860 1248 1 IJ 10:49 0:00.00 = | | `-- /usr/bin/make -f Makefile = DESTDIR=3D/wrkdirs/usr/ports/graphics/poppler-qt5/work/stage install root 12353 0.0 0.0 10236 1664 1 IJ 10:49 0:00.05 = | | `-- /nxb-bin/usr/bin/make -f CMakeFiles/Makefile2 = qt5/all root 12787 0.0 0.0 9856 1236 1 IJ 10:50 0:00.00 = | | `-- /nxb-bin/usr/bin/make -f = qt5/tests/CMakeFiles/check_qt5_attachments_autogen.dir/build.make = qt5/test root 12789 100.0 0.0 169868 33528 1 IJ 10:50 36:35.26 = | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/ root 94423 0.0 0.0 12932 3484 1 S+ 10:42 0:12.91 = | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 (gdb) attach 12789 Attaching to process 12789 Reading symbols from = /usr/local/poudriere/data/.m/FBSDFSSDjailArmV7-default/01/usr/local/bin/qe= mu-arm-static...done. [New LWP 101168 of process 12789] [New LWP 101178 of process 12789] [New LWP 101499 of process 12789] [Switching to LWP 100304 of process 12789] _umtx_op () at _umtx_op.S:3 3 RSYSCALL(_umtx_op) (gdb) info threads Id Target Id Frame=20 * 1 LWP 100304 of process 12789 _umtx_op () at _umtx_op.S:3 2 LWP 101168 of process 12789 _umtx_op_err () at = /usr/src/lib/libthr/arch/amd64/amd64/_umtx_op_err.S:37 3 LWP 101178 of process 12789 _umtx_op () at _umtx_op.S:3 4 LWP 101499 of process 12789 0x0000000060051c26 in = atomic_cmpset_int (dst=3D, expect=3D, = src=3D536870912) at /usr/include/machine/atomic.h:220 (gdb) thread 4 [Switching to thread 4 (LWP 101499 of process 12789)] #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 220 ATOMIC_CMPSET(int); (gdb) bt #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 #5 0x00000000600392f0 in target_cpu_loop (env=3D0x86159b118) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/arm/target_arch_cpu.h:207 #6 0x0000000060038c99 in cpu_loop (env=3D0xf4dede80) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/main.c:121 #7 0x0000000060050c1a in new_freebsd_thread_start (arg=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:152 #8 0x00000000601ad5f6 in thread_start (curthread=3D0x861571300) at = /usr/src/lib/libthr/thread/thr_create.c:291 #9 0x0000000000000000 in ?? () Backtrace stopped: Cannot access memory at address 0x7fffdfbb3000 181 #define ATOMIC_CMPSET(TYPE) \ 182 static __inline int \ 183 atomic_cmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE expect, = u_##TYPE src) \ 184 { \ (gdb)=20 185 u_char res; \ 186 \ 187 __asm __volatile( \ 188 " " MPLOCKED " " \ 189 " cmpxchg %3,%1 ; " \ 190 " sete %0 ; " \ 191 "# atomic_cmpset_" #TYPE " " \ 192 : "=3Dq" (res), /* 0 */ \ 193 "+m" (*dst), /* 1 */ \ 194 "+a" (expect) /* 2 */ \ (gdb)=20 195 : "r" (src) /* 3 */ \ 196 : "memory", "cc"); \ 197 return (res); \ 198 } \ . . . 218 ATOMIC_CMPSET(char); 219 ATOMIC_CMPSET(short); 220 ATOMIC_CMPSET(int); 221 ATOMIC_CMPSET(long); (gdb) up #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 178 return atomic_cmpset_acq_32(addr, current, new); (gdb) list 173 static int tcmpset_32(uint32_t *addr, uint32_t a, uint32_t b) 174 { 175 uint32_t current =3D tswap32(a); 176 uint32_t new =3D tswap32(b); 177=09 178 return atomic_cmpset_acq_32(addr, current, new); 179 } (gdb) up #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { (gdb) list 1259 } 1260 } 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { 1262 /* decrement reader count */ 1263 for (;;) { 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { 1266 unlock_user_struct(target_urwlock, 1267 target_addr, 1); 1268 return -TARGET_EPERM; (gdb)=20 1269 } 1270 } else { 1271 break; 1272 } 1273 } 1274 } else { 1275 unlock_user_struct(target_urwlock, target_addr, 1); 1276 return -TARGET_EPERM; 1277 } 1278=09 The above loop is where the code is stuck looping, using most of the = capacity of one cpu (as FreeBSD classifies cpus). The value of state is stuck at: (gdb) print state $2 =3D 536870913 I'll note that the loop is inside qemu-arm-atatic, not in the cmake that = it is running. To show a little more context before the assembler for the routine that = ends up containing that loop: (gdb) up #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 474 ret =3D freebsd_rw_unlock(obj); (gdb) list 469 ret =3D freebsd_rw_wrlock(obj, val, 0, NULL); 470 } 471 break; 472=09 473 case TARGET_UMTX_OP_RW_UNLOCK: 474 ret =3D freebsd_rw_unlock(obj); 475 break; 476=09 477 #if defined(__FreeBSD_version) && __FreeBSD_version > 900000 478 #ifdef UMTX_OP_MUTEX_WAKE2 (gdb) up #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); (gdb) list 1359 ret =3D do_freebsd__umtx_unlock(arg1); 1360 break; 1361 #endif 1362=09 1363 case TARGET_FREEBSD_NR__umtx_op: /* undocumented */ 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); 1365 break; 1366=09 1367 /* 1368 * ioctl(2) As for the assembler level view for the routine containing the loop (via inlining and such): Dump of assembler code for function freebsd_rw_unlock: 0x0000000060051bd0 <+0>: push %rbp 0x0000000060051bd1 <+1>: mov %rsp,%rbp 0x0000000060051bd4 <+4>: push %rbx 0x0000000060051bd5 <+5>: push %rax 0x0000000060051bd6 <+6>: mov %edi,%ebx 0x0000000060051bd8 <+8>: mov $0x20,%esi 0x0000000060051bdd <+13>: mov $0x3,%edx 0x0000000060051be2 <+18>: callq 0x60036b70 0x0000000060051be7 <+23>: mov %eax,%ecx 0x0000000060051be9 <+25>: mov $0xfffffff2,%eax 0x0000000060051bee <+30>: test %ecx,%ecx 0x0000000060051bf0 <+32>: jne 0x60051c50 = 0x0000000060051bf2 <+34>: mov %ebx,%edi 0x0000000060051bf4 <+36>: add 0x26a6355(%rip),%rdi # = 0x626f7f50 0x0000000060051bfb <+43>: je 0x60051c50 = 0x0000000060051bfd <+45>: mov (%rdi),%ecx 0x0000000060051bff <+47>: mov 0x4(%rdi),%edx 0x0000000060051c02 <+50>: test %ecx,%ecx 0x0000000060051c04 <+52>: js 0x60051c30 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx 0x0000000060051c0c <+60>: je 0x60051c4b = 0x0000000060051c0e <+62>: lea -0x1(%rcx),%esi 0x0000000060051c11 <+65>: nopw %cs:0x0(%rax,%rax,1) 0x0000000060051c1b <+75>: nopl 0x0(%rax,%rax,1) NOTE: loop is below: 0x0000000060051c20 <+80>: mov %ecx,%eax =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) 0x0000000060051c26 <+86>: sete %bl 0x0000000060051c29 <+89>: test %bl,%bl 0x0000000060051c2b <+91>: je 0x60051c20 Note: loop is above 0x0000000060051c2d <+93>: jmp 0x60051c57 = 0x0000000060051c2f <+95>: nop 0x0000000060051c30 <+96>: mov %ecx,%esi 0x0000000060051c32 <+98>: and $0x7fffffff,%esi 0x0000000060051c38 <+104>: mov %ecx,%eax 0x0000000060051c3a <+106>: lock cmpxchg %esi,(%rdi) 0x0000000060051c3e <+110>: sete %bl 0x0000000060051c41 <+113>: test %bl,%bl 0x0000000060051c43 <+115>: jne 0x60051c57 = 0x0000000060051c45 <+117>: mov (%rdi),%ecx 0x0000000060051c47 <+119>: test %ecx,%ecx 0x0000000060051c49 <+121>: js 0x60051c30 0x0000000060051c4b <+123>: mov $0xffffffff,%eax 0x0000000060051c50 <+128>: add $0x8,%rsp 0x0000000060051c54 <+132>: pop %rbx 0x0000000060051c55 <+133>: pop %rbp 0x0000000060051c56 <+134>: retq =20 0x0000000060051c57 <+135>: test $0x2,%dl 0x0000000060051c5a <+138>: jne 0x60051c70 = 0x0000000060051c5c <+140>: test $0x40000000,%ecx 0x0000000060051c62 <+146>: jne 0x60051c82 = 0x0000000060051c64 <+148>: xor %eax,%eax 0x0000000060051c66 <+150>: test $0x20000000,%ecx 0x0000000060051c6c <+156>: je 0x60051c50 = 0x0000000060051c6e <+158>: jmp 0x60051c89 = 0x0000000060051c70 <+160>: test $0x20000000,%ecx 0x0000000060051c76 <+166>: jne 0x60051c89 = 0x0000000060051c78 <+168>: xor %eax,%eax 0x0000000060051c7a <+170>: test $0x40000000,%ecx 0x0000000060051c80 <+176>: je 0x60051c50 = 0x0000000060051c82 <+178>: mov $0x1,%edx 0x0000000060051c87 <+183>: jmp 0x60051c8e = 0x0000000060051c89 <+185>: mov $0x7fffffff,%edx 0x0000000060051c8e <+190>: mov $0x3,%esi 0x0000000060051c93 <+195>: xor %ecx,%ecx 0x0000000060051c95 <+197>: xor %r8d,%r8d 0x0000000060051c98 <+200>: callq 0x601b5970 <_umtx_op> 0x0000000060051c9d <+205>: mov %eax,%edi 0x0000000060051c9f <+207>: add $0x8,%rsp 0x0000000060051ca3 <+211>: pop %rbx 0x0000000060051ca4 <+212>: pop %rbp --Type for more, q to quit, c to continue without paging-- 0x0000000060051ca5 <+213>: jmpq 0x60040a40 End of assembler dump. For just before the "lock cmpxchg %esi,(%rdi)" in the loop: rax 0x20000001 536870913 rbx 0xf4dede00 4108246528 rcx 0x20000001 536870913 rdx 0x2 2 rsi 0x20000000 536870912 rdi 0xf4dede80 4108246656 (gdb) x 0xf4dede80 0xf4dede80: 0x40000001 0x0000000060051c20 <+80>: mov %ecx,%eax =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) 0x0000000060051c26 <+86>: sete %bl 0x0000000060051c29 <+89>: test %bl,%bl 0x0000000060051c2b <+91>: je 0x60051c20 At this point I do not have interpretation of the details, not even a comparison to the source code. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Wed Jan 2 03:37:47 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3D1B14331BB for ; Wed, 2 Jan 2019 03:37:47 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 458746FC24 for ; Wed, 2 Jan 2019 03:37:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 9S7KqawVM1nsPJ2rmLRCkK81xnAOujtjrZAZ_VPMhtSSUzzUIabeCq4RsuRMhQE pmbhZirJMlPYD9DOH_2mfs301u0JsmMg3ruIsweqns5DaSVqJoX.QzIXlHgBDil3_pXQYqiUWPZE gbR5ntoy20xslcRa8x8FqaY643NSi5YyPSzonVMey4Uy2hMh014S5ogvvlrnfsbBe1GhpEmAYHTE QVeeHv5lQ54kf7MA7Le6FjNK97VBAjw4mD7Phv7Bjc24cTzaFNpVdLYI1y0FicNB0_5e.Yf__kwj ezyCZrzLaxXj0s3HXQ1CJRwv45tXaC69nAbbRNgHfoMn93XDn9vE3v6hHUCdrxZ0O.bs1RRAT3zo 9JR8_0S2pK6vaSpnKUAj5fHq.s5XyOp.W2onQ8z7mz1hYpS1Cr0jooBSeRtJDqWa1snDGIHF9IQu A.pEuv5SAxHPaoUvWsqHFQ8R5M7YqFbW63oMUY0Bd9eXZGKl.8qhtTxHs5YBEX0W7VJtAzXzqDxD 7pdycplmYIWCFLz5X5zbyXAr6.aWgSqLQ2zJKwxj03gyB.72bvk8ySGS7lPY88xB4fXLjEpPvdck IUMxbPEFZmivZRgf9wmsdkVyVYzi8BboISYBmOo00qUmoyUjfWgM3WTClOnsY7B00kbe7zfAiStE RS_t2iYJOm6MMiCYnla0hzdh9XA3O4q5SIBk039ne8aCJbIR_amwPKWmYv2dymHmAYPk7W.0AyZS QTANPJel6YXXzXVBMN5P8u5Lysy1_7AmnR8xOybOmdq9IAYnfPWdm3HqWCPm0369U6w6ZYa0cYjZ D_TFfloxr58X.cPG5YifiOnN7QfSn2_cy6P11wPIaGh_xip__THEcKBZxJ6ajKmzlvv7lYbuySA2 ulUFOQPdzktZTe7Drb3WWyhVK6T_v.tvPtRa2m97D2v.JnLFfCqSrzIWzhED1j2.kDJ1qpS8pasq Z.mVmkcC9Ca8RTQTl3ryvLR.OvxVLZf4PoB_c4MM3qfmYgpSH.8gslhehxtMbR4o5SZxuqhZo.w3 fKRqvvuHphcbWoIGqbvXTQVvGF7CkGFp4fMP41joq8YpYW6XX89LdljVOSJ2rmBr6niyIfSA- Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Wed, 2 Jan 2019 03:37:38 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp421.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 1fc6b5ff2c0640e8f6371145fc776cba; Wed, 02 Jan 2019 03:37:36 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 [problem possibly found] From: Mark Millard In-Reply-To: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> Date: Tue, 1 Jan 2019 19:37:35 -0800 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> To: freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 458746FC24 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.77 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.92)[-0.923,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.34)[ip: (-2.69), ipnet: 98.137.64.0/21(0.60), asn: 36647(0.48), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[146.64.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Jan 2019 03:37:47 -0000 [It looks to me like the assembler code has some code moved out of the loop that it should not be (by intent). It appears that calling tcmpset_32 does not prevent code motion to before the call and the variable involved was not declared volatile.] On 2019-Jan-1, at 18:43, Mark Millard wrote: > The below showed up for poudiere-devel bulk getting stuck using one = FreeBSD > cpu while building graphics/poppler-qt5 . This is not a kevent = hang-up, unlike > the last hang-up that I analyzed. I do not yet know how repeatable = this is > but the original hang-up and the one experiment the below is from. >=20 > =46rom top: >=20 > PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME = CPU COMMAND > 12789 root 4 52 0 166M 33M 0 uwait 6 36:06 = 97.22% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/graphics/poppler-qt5/work/poppler-0 >=20 > Note: The vast margority of the 36:06 has been stuck in the uwait loop = involved. >=20 > =46rom ps -auxd: >=20 > root 94075 0.0 0.0 12932 3552 1 S+ 10:42 = 0:01.21 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > root 1944 0.0 0.0 12932 3540 1 I+ 10:42 = 0:00.00 | |-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > root 1957 0.0 0.0 12932 3556 1 I 10:42 = 0:00.04 | |-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: = build_pkg (poppler-qt5-0.72.0) (sh) > root 12328 0.0 0.0 12932 3548 1 I 10:49 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][01]: build_pkg (poppler-qt5-0.72.0) = (sh) > root 12329 0.0 0.0 10328 1756 1 IJ 10:49 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/graphics/poppler-qt5 stage > root 12350 0.0 0.0 9860 1248 1 IJ 10:49 = 0:00.00 | | `-- /usr/bin/make -f Makefile = DESTDIR=3D/wrkdirs/usr/ports/graphics/poppler-qt5/work/stage install > root 12353 0.0 0.0 10236 1664 1 IJ 10:49 = 0:00.05 | | `-- /nxb-bin/usr/bin/make -f = CMakeFiles/Makefile2 qt5/all > root 12787 0.0 0.0 9856 1236 1 IJ 10:50 = 0:00.00 | | `-- /nxb-bin/usr/bin/make -f = qt5/tests/CMakeFiles/check_qt5_attachments_autogen.dir/build.make = qt5/test > root 12789 100.0 0.0 169868 33528 1 IJ 10:50 = 36:35.26 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/ > root 94423 0.0 0.0 12932 3484 1 S+ 10:42 = 0:12.91 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 >=20 >=20 > (gdb) attach 12789 > Attaching to process 12789 > Reading symbols from = /usr/local/poudriere/data/.m/FBSDFSSDjailArmV7-default/01/usr/local/bin/qe= mu-arm-static...done. > [New LWP 101168 of process 12789] > [New LWP 101178 of process 12789] > [New LWP 101499 of process 12789] > [Switching to LWP 100304 of process 12789] > _umtx_op () at _umtx_op.S:3 > 3 RSYSCALL(_umtx_op) > (gdb) info threads > Id Target Id Frame=20 > * 1 LWP 100304 of process 12789 _umtx_op () at _umtx_op.S:3 > 2 LWP 101168 of process 12789 _umtx_op_err () at = /usr/src/lib/libthr/arch/amd64/amd64/_umtx_op_err.S:37 > 3 LWP 101178 of process 12789 _umtx_op () at _umtx_op.S:3 > 4 LWP 101499 of process 12789 0x0000000060051c26 in = atomic_cmpset_int (dst=3D, expect=3D, = src=3D536870912) at /usr/include/machine/atomic.h:220 > (gdb) thread 4 > [Switching to thread 4 (LWP 101499 of process 12789)] > #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 > 220 ATOMIC_CMPSET(int); >=20 > (gdb) bt > #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 > #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 > #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) > at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 > arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 > #5 0x00000000600392f0 in target_cpu_loop (env=3D0x86159b118) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/arm/target_arch_cpu.h:207 > #6 0x0000000060038c99 in cpu_loop (env=3D0xf4dede80) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/main.c:121 > #7 0x0000000060050c1a in new_freebsd_thread_start (arg=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:152 > #8 0x00000000601ad5f6 in thread_start (curthread=3D0x861571300) at = /usr/src/lib/libthr/thread/thr_create.c:291 > #9 0x0000000000000000 in ?? () > Backtrace stopped: Cannot access memory at address 0x7fffdfbb3000 >=20 > 181 #define ATOMIC_CMPSET(TYPE) \ > 182 static __inline int \ > 183 atomic_cmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE expect, = u_##TYPE src) \ > 184 { \ > (gdb)=20 > 185 u_char res; \ > 186 \ > 187 __asm __volatile( \ > 188 " " MPLOCKED " " \ > 189 " cmpxchg %3,%1 ; " \ > 190 " sete %0 ; " \ > 191 "# atomic_cmpset_" #TYPE " " \ > 192 : "=3Dq" (res), /* 0 */ \ > 193 "+m" (*dst), /* 1 */ \ > 194 "+a" (expect) /* 2 */ \ > (gdb)=20 > 195 : "r" (src) /* 3 */ \ > 196 : "memory", "cc"); \ > 197 return (res); \ > 198 } \ > . . . > 218 ATOMIC_CMPSET(char); > 219 ATOMIC_CMPSET(short); > 220 ATOMIC_CMPSET(int); > 221 ATOMIC_CMPSET(long); >=20 > (gdb) up > #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 > 178 return atomic_cmpset_acq_32(addr, current, new); > (gdb) list > 173 static int tcmpset_32(uint32_t *addr, uint32_t a, uint32_t b) > 174 { > 175 uint32_t current =3D tswap32(a); > 176 uint32_t new =3D tswap32(b); > 177=09 > 178 return atomic_cmpset_acq_32(addr, current, new); > 179 } >=20 > (gdb) up > #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { > (gdb) list > 1259 } > 1260 } > 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { > 1262 /* decrement reader count */ > 1263 for (;;) { > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { > 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { > 1266 unlock_user_struct(target_urwlock, > 1267 target_addr, 1); > 1268 return -TARGET_EPERM; > (gdb)=20 > 1269 } > 1270 } else { > 1271 break; > 1272 } > 1273 } > 1274 } else { > 1275 unlock_user_struct(target_urwlock, target_addr, 1); > 1276 return -TARGET_EPERM; > 1277 } > 1278=09 >=20 > The above loop is where the code is stuck looping, using most of the = capacity of > one cpu (as FreeBSD classifies cpus). The value of state is stuck at: >=20 > (gdb) print state > $2 =3D 536870913 >=20 > I'll note that the loop is inside qemu-arm-atatic, not in the cmake = that it > is running. >=20 >=20 >=20 > To show a little more context before the assembler for the routine = that ends up > containing that loop: >=20 > (gdb) up > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) > at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 > 474 ret =3D freebsd_rw_unlock(obj); > (gdb) list > 469 ret =3D freebsd_rw_wrlock(obj, val, 0, NULL); > 470 } > 471 break; > 472=09 > 473 case TARGET_UMTX_OP_RW_UNLOCK: > 474 ret =3D freebsd_rw_unlock(obj); > 475 break; > 476=09 > 477 #if defined(__FreeBSD_version) && __FreeBSD_version > 900000 > 478 #ifdef UMTX_OP_MUTEX_WAKE2 >=20 > (gdb) up > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 > arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 > 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); > (gdb) list > 1359 ret =3D do_freebsd__umtx_unlock(arg1); > 1360 break; > 1361 #endif > 1362=09 > 1363 case TARGET_FREEBSD_NR__umtx_op: /* undocumented */ > 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); > 1365 break; > 1366=09 > 1367 /* > 1368 * ioctl(2) >=20 > As for the assembler level view for the routine containing the > loop (via inlining and such): >=20 > Dump of assembler code for function freebsd_rw_unlock: > 0x0000000060051bd0 <+0>: push %rbp > 0x0000000060051bd1 <+1>: mov %rsp,%rbp > 0x0000000060051bd4 <+4>: push %rbx > 0x0000000060051bd5 <+5>: push %rax > 0x0000000060051bd6 <+6>: mov %edi,%ebx > 0x0000000060051bd8 <+8>: mov $0x20,%esi > 0x0000000060051bdd <+13>: mov $0x3,%edx > 0x0000000060051be2 <+18>: callq 0x60036b70 > 0x0000000060051be7 <+23>: mov %eax,%ecx > 0x0000000060051be9 <+25>: mov $0xfffffff2,%eax > 0x0000000060051bee <+30>: test %ecx,%ecx > 0x0000000060051bf0 <+32>: jne 0x60051c50 = > 0x0000000060051bf2 <+34>: mov %ebx,%edi > 0x0000000060051bf4 <+36>: add 0x26a6355(%rip),%rdi # = 0x626f7f50 > 0x0000000060051bfb <+43>: je 0x60051c50 = > 0x0000000060051bfd <+45>: mov (%rdi),%ecx > 0x0000000060051bff <+47>: mov 0x4(%rdi),%edx > 0x0000000060051c02 <+50>: test %ecx,%ecx > 0x0000000060051c04 <+52>: js 0x60051c30 > 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx > 0x0000000060051c0c <+60>: je 0x60051c4b = > 0x0000000060051c0e <+62>: lea -0x1(%rcx),%esi > 0x0000000060051c11 <+65>: nopw %cs:0x0(%rax,%rax,1) > 0x0000000060051c1b <+75>: nopl 0x0(%rax,%rax,1) > NOTE: loop is below: > 0x0000000060051c20 <+80>: mov %ecx,%eax > =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c26 <+86>: sete %bl > 0x0000000060051c29 <+89>: test %bl,%bl > 0x0000000060051c2b <+91>: je 0x60051c20 > Note: loop is above > 0x0000000060051c2d <+93>: jmp 0x60051c57 = > 0x0000000060051c2f <+95>: nop > 0x0000000060051c30 <+96>: mov %ecx,%esi > 0x0000000060051c32 <+98>: and $0x7fffffff,%esi > 0x0000000060051c38 <+104>: mov %ecx,%eax > 0x0000000060051c3a <+106>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c3e <+110>: sete %bl > 0x0000000060051c41 <+113>: test %bl,%bl > 0x0000000060051c43 <+115>: jne 0x60051c57 = > 0x0000000060051c45 <+117>: mov (%rdi),%ecx > 0x0000000060051c47 <+119>: test %ecx,%ecx > 0x0000000060051c49 <+121>: js 0x60051c30 > 0x0000000060051c4b <+123>: mov $0xffffffff,%eax > 0x0000000060051c50 <+128>: add $0x8,%rsp > 0x0000000060051c54 <+132>: pop %rbx > 0x0000000060051c55 <+133>: pop %rbp > 0x0000000060051c56 <+134>: retq =20 > 0x0000000060051c57 <+135>: test $0x2,%dl > 0x0000000060051c5a <+138>: jne 0x60051c70 = > 0x0000000060051c5c <+140>: test $0x40000000,%ecx > 0x0000000060051c62 <+146>: jne 0x60051c82 = > 0x0000000060051c64 <+148>: xor %eax,%eax > 0x0000000060051c66 <+150>: test $0x20000000,%ecx > 0x0000000060051c6c <+156>: je 0x60051c50 = > 0x0000000060051c6e <+158>: jmp 0x60051c89 = > 0x0000000060051c70 <+160>: test $0x20000000,%ecx > 0x0000000060051c76 <+166>: jne 0x60051c89 = > 0x0000000060051c78 <+168>: xor %eax,%eax > 0x0000000060051c7a <+170>: test $0x40000000,%ecx > 0x0000000060051c80 <+176>: je 0x60051c50 = > 0x0000000060051c82 <+178>: mov $0x1,%edx > 0x0000000060051c87 <+183>: jmp 0x60051c8e = > 0x0000000060051c89 <+185>: mov $0x7fffffff,%edx > 0x0000000060051c8e <+190>: mov $0x3,%esi > 0x0000000060051c93 <+195>: xor %ecx,%ecx > 0x0000000060051c95 <+197>: xor %r8d,%r8d > 0x0000000060051c98 <+200>: callq 0x601b5970 <_umtx_op> > 0x0000000060051c9d <+205>: mov %eax,%edi > 0x0000000060051c9f <+207>: add $0x8,%rsp > 0x0000000060051ca3 <+211>: pop %rbx > 0x0000000060051ca4 <+212>: pop %rbp > --Type for more, q to quit, c to continue without paging-- > 0x0000000060051ca5 <+213>: jmpq 0x60040a40 > End of assembler dump. >=20 > For just before the "lock cmpxchg %esi,(%rdi)" in the loop: >=20 > rax 0x20000001 536870913 > rbx 0xf4dede00 4108246528 > rcx 0x20000001 536870913 > rdx 0x2 2 > rsi 0x20000000 536870912 > rdi 0xf4dede80 4108246656 >=20 > (gdb) x 0xf4dede80 > 0xf4dede80: 0x40000001 >=20 > 0x0000000060051c20 <+80>: mov %ecx,%eax > =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c26 <+86>: sete %bl > 0x0000000060051c29 <+89>: test %bl,%bl > 0x0000000060051c2b <+91>: je 0x60051c20 >=20 >=20 > At this point I do not have interpretation of the details, not even > a comparison to the source code. In the source code there is: 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { 1262 /* decrement reader count */ 1263 for (;;) { 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { 1266 unlock_user_struct(target_urwlock, 1267 target_addr, 1); 1268 return -TARGET_EPERM; (gdb)=20 1269 } 1270 } else { 1271 break; 1272 } 1273 } But in the assembler code it appears to me that the code: 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { 1266 unlock_user_struct(target_urwlock, 1267 target_addr, 1); 1268 return -TARGET_EPERM; (gdb)=20 1269 } was factored out of the loop, with the test moved to before the loop. The TARGET_URWLOCK_READER_COUNT use masks off based on 0x1fffffff . But the code for the conditional test is before the loop: 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx 0x0000000060051c0c <+60>: je 0x60051c4b = . . . NOTE: loop is below: 0x0000000060051c20 <+80>: mov %ecx,%eax =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) 0x0000000060051c26 <+86>: sete %bl 0x0000000060051c29 <+89>: test %bl,%bl 0x0000000060051c2b <+91>: je 0x60051c20 Note: loop is above I may try declaring state volatile in an attempt to prevent the code motion. (But what of other uses of tcmpset_32 controlling subordinate code in other places?) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Wed Jan 2 04:53:02 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8A1E81434C61 for ; Wed, 2 Jan 2019 04:53:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 333997207D for ; Wed, 2 Jan 2019 04:53:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: rivfqgUVM1k4_w1bRsr93rAsOEKgFiWiCmOQ8Drt.kdoIuNnQH_dzk_7gj4ysi1 R2tL2PLwoRSNaZYJa3AD3_lD14PRHAqWHy7nbaKlXKOhuBBTai2y6y4pwyLmh0Cvb0TztkLwg0iY ZiX.JkpbwzeFDtri9ORRJqql8pKxuaa0Not9jbRoYxC1Mk79HnotbQgPIs4uUY2PlmyJ1JhEoSl7 YbmoJmPokeJrDd7zuOtcUEH0xcIk77t0HmX1sqaAMBdNBG.bxMG1PzH_uojq.bHI_fZApq.s05mA yjxx5WcoPrAhdRvPZf3KEwWEve5GFQG42_xcyWZ4l6pSdYqFdkAJWNcUYC20.KbicCUex7vAhc_i V49GSMf67Dlhj31zs3di_Vs5heUYfUKoAcuwh8a2tGyfRXUpCHgKcD_GScFyNJxe.C5jWZxPbiTP Jx1UZy91caSSl5bU_5r8pJgBGsvUJ9loqAJKPOLxw0FcSNAWl5IOoR0A9J3CQ6EMJlyfEXr5gJQd tJ99VHtUVfHZ3Cgwauxw7h2Y0EmgkZfuz4B8aQswe0DS0oWDK3zjS8yvx8DwmjtAFY_ReV6RNFDS 13Xv0vSNMZOeM9PmVfYq8rhsCo3asWeU2I8HAwEo.UiAD5QQL0seJ_hRx45E2BQrBp.WZbEqwAJt Z1IYTtESe6AlY56I6jIP2DAEhgcc_.dt08rBwfgZZ6CYL_NmZ85Ww2GQTFmb.2m1Sy.p9kR1BRXO 4fl0H4tgv1gg0rFQ32d9Km9.nMpFbIICIoyuoM05_pP4bVTd0m3WTNHNF_oTw.Ejcv6Ir8kpTEu_ ZrhMo9myjLKfmInu982NqUoaJY3PyymaVabJnnn_sjLK3ynHqLq6qwI8OjlqzYoA9TpJB3b4KI2U go1BaOfw4_0zT7shUK7RNhxvP2iKuTVInYzVkWCQWWNGK61BDxFhlTLB.9gftPBvf7J7jIkWkgK5 y0oiv8d8RqldK_nZkMDNx75PV8tB.oOHR6TlqGMMJ3ibzDHKH934IPJrJ9ZQMSkX1T7LY6CpB2ko p.Hdw.W4Zthd4GZdq9HDFEf0vT31mF7NERO3X7Ys_CVtSp1DyMUGY91fpGIYIEtoD756dYek- Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Wed, 2 Jan 2019 04:52:54 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp403.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID a77ac9e2e0bfe980ae387608a47651aa; Wed, 02 Jan 2019 04:42:43 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 [problem not found] From: Mark Millard In-Reply-To: Date: Tue, 1 Jan 2019 20:42:42 -0800 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> To: freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 333997207D X-Spamd-Bar: - X-Spamd-Result: default: False [-1.32 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.81)[-0.809,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.15)[0.146,0]; NEURAL_HAM_LONG(-0.79)[-0.790,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.64)[ip: (2.21), ipnet: 98.137.64.0/21(0.59), asn: 36647(0.47), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[82.64.137.98.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[82.64.137.98.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Jan 2019 04:53:02 -0000 [I was wrong: it is code elimination, not motion. volatile is not a fix.] On 2019-Jan-1, at 19:37, Mark Millard wrote: > [It looks to me like the assembler code has some code moved out of the > loop that it should not be (by intent). It appears that calling > tcmpset_32 does not prevent code motion to before the call and > the variable involved was not declared volatile.] >=20 > On 2019-Jan-1, at 18:43, Mark Millard wrote: >=20 >> The below showed up for poudiere-devel bulk getting stuck using one = FreeBSD >> cpu while building graphics/poppler-qt5 . This is not a kevent = hang-up, unlike >> the last hang-up that I analyzed. I do not yet know how repeatable = this is >> but the original hang-up and the one experiment the below is from. >>=20 >> =46rom top: >>=20 >> PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME = CPU COMMAND >> 12789 root 4 52 0 166M 33M 0 uwait 6 36:06 = 97.22% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/graphics/poppler-qt5/work/poppler-0 >>=20 >> Note: The vast margority of the 36:06 has been stuck in the uwait = loop involved. >>=20 >> =46rom ps -auxd: >>=20 >> root 94075 0.0 0.0 12932 3552 1 S+ 10:42 = 0:01.21 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 >> root 1944 0.0 0.0 12932 3540 1 I+ 10:42 = 0:00.00 | |-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 >> root 1957 0.0 0.0 12932 3556 1 I 10:42 = 0:00.04 | |-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: = build_pkg (poppler-qt5-0.72.0) (sh) >> root 12328 0.0 0.0 12932 3548 1 I 10:49 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][01]: build_pkg (poppler-qt5-0.72.0) = (sh) >> root 12329 0.0 0.0 10328 1756 1 IJ 10:49 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/graphics/poppler-qt5 stage >> root 12350 0.0 0.0 9860 1248 1 IJ 10:49 = 0:00.00 | | `-- /usr/bin/make -f Makefile = DESTDIR=3D/wrkdirs/usr/ports/graphics/poppler-qt5/work/stage install >> root 12353 0.0 0.0 10236 1664 1 IJ 10:49 = 0:00.05 | | `-- /nxb-bin/usr/bin/make -f = CMakeFiles/Makefile2 qt5/all >> root 12787 0.0 0.0 9856 1236 1 IJ 10:50 = 0:00.00 | | `-- /nxb-bin/usr/bin/make -f = qt5/tests/CMakeFiles/check_qt5_attachments_autogen.dir/build.make = qt5/test >> root 12789 100.0 0.0 169868 33528 1 IJ 10:50 = 36:35.26 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/ >> root 94423 0.0 0.0 12932 3484 1 S+ 10:42 = 0:12.91 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 >>=20 >>=20 >> (gdb) attach 12789 >> Attaching to process 12789 >> Reading symbols from = /usr/local/poudriere/data/.m/FBSDFSSDjailArmV7-default/01/usr/local/bin/qe= mu-arm-static...done. >> [New LWP 101168 of process 12789] >> [New LWP 101178 of process 12789] >> [New LWP 101499 of process 12789] >> [Switching to LWP 100304 of process 12789] >> _umtx_op () at _umtx_op.S:3 >> 3 RSYSCALL(_umtx_op) >> (gdb) info threads >> Id Target Id Frame=20 >> * 1 LWP 100304 of process 12789 _umtx_op () at _umtx_op.S:3 >> 2 LWP 101168 of process 12789 _umtx_op_err () at = /usr/src/lib/libthr/arch/amd64/amd64/_umtx_op_err.S:37 >> 3 LWP 101178 of process 12789 _umtx_op () at _umtx_op.S:3 >> 4 LWP 101499 of process 12789 0x0000000060051c26 in = atomic_cmpset_int (dst=3D, expect=3D, = src=3D536870912) at /usr/include/machine/atomic.h:220 >> (gdb) thread 4 >> [Switching to thread 4 (LWP 101499 of process 12789)] >> #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 >> 220 ATOMIC_CMPSET(int); >>=20 >> (gdb) bt >> #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 >> #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 >> #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 >> #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) >> at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 >> #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 >> arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 >> #5 0x00000000600392f0 in target_cpu_loop (env=3D0x86159b118) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/arm/target_arch_cpu.h:207 >> #6 0x0000000060038c99 in cpu_loop (env=3D0xf4dede80) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/main.c:121 >> #7 0x0000000060050c1a in new_freebsd_thread_start (arg=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:152 >> #8 0x00000000601ad5f6 in thread_start (curthread=3D0x861571300) at = /usr/src/lib/libthr/thread/thr_create.c:291 >> #9 0x0000000000000000 in ?? () >> Backtrace stopped: Cannot access memory at address 0x7fffdfbb3000 >>=20 >> 181 #define ATOMIC_CMPSET(TYPE) \ >> 182 static __inline int \ >> 183 atomic_cmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE expect, = u_##TYPE src) \ >> 184 { \ >> (gdb)=20 >> 185 u_char res; \ >> 186 \ >> 187 __asm __volatile( \ >> 188 " " MPLOCKED " " \ >> 189 " cmpxchg %3,%1 ; " \ >> 190 " sete %0 ; " \ >> 191 "# atomic_cmpset_" #TYPE " " \ >> 192 : "=3Dq" (res), /* 0 */ \ >> 193 "+m" (*dst), /* 1 */ \ >> 194 "+a" (expect) /* 2 */ \ >> (gdb)=20 >> 195 : "r" (src) /* 3 */ \ >> 196 : "memory", "cc"); \ >> 197 return (res); \ >> 198 } \ >> . . . >> 218 ATOMIC_CMPSET(char); >> 219 ATOMIC_CMPSET(short); >> 220 ATOMIC_CMPSET(int); >> 221 ATOMIC_CMPSET(long); >>=20 >> (gdb) up >> #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 >> 178 return atomic_cmpset_acq_32(addr, current, new); >> (gdb) list >> 173 static int tcmpset_32(uint32_t *addr, uint32_t a, uint32_t b) >> 174 { >> 175 uint32_t current =3D tswap32(a); >> 176 uint32_t new =3D tswap32(b); >> 177=09 >> 178 return atomic_cmpset_acq_32(addr, current, new); >> 179 } >>=20 >> (gdb) up >> #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 >> 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { >> (gdb) list >> 1259 } >> 1260 } >> 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { >> 1262 /* decrement reader count */ >> 1263 for (;;) { >> 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { >> 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { >> 1266 unlock_user_struct(target_urwlock, >> 1267 target_addr, 1); >> 1268 return -TARGET_EPERM; >> (gdb)=20 >> 1269 } >> 1270 } else { >> 1271 break; >> 1272 } >> 1273 } >> 1274 } else { >> 1275 unlock_user_struct(target_urwlock, target_addr, 1); >> 1276 return -TARGET_EPERM; >> 1277 } >> 1278=09 >>=20 >> The above loop is where the code is stuck looping, using most of the = capacity of >> one cpu (as FreeBSD classifies cpus). The value of state is stuck at: >>=20 >> (gdb) print state >> $2 =3D 536870913 >>=20 >> I'll note that the loop is inside qemu-arm-atatic, not in the cmake = that it >> is running. >>=20 >>=20 >>=20 >> To show a little more context before the assembler for the routine = that ends up >> containing that loop: >>=20 >> (gdb) up >> #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) >> at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 >> 474 ret =3D freebsd_rw_unlock(obj); >> (gdb) list >> 469 ret =3D freebsd_rw_wrlock(obj, val, 0, NULL); >> 470 } >> 471 break; >> 472=09 >> 473 case TARGET_UMTX_OP_RW_UNLOCK: >> 474 ret =3D freebsd_rw_unlock(obj); >> 475 break; >> 476=09 >> 477 #if defined(__FreeBSD_version) && __FreeBSD_version > 900000 >> 478 #ifdef UMTX_OP_MUTEX_WAKE2 >>=20 >> (gdb) up >> #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 >> arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 >> 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); >> (gdb) list >> 1359 ret =3D do_freebsd__umtx_unlock(arg1); >> 1360 break; >> 1361 #endif >> 1362=09 >> 1363 case TARGET_FREEBSD_NR__umtx_op: /* undocumented */ >> 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); >> 1365 break; >> 1366=09 >> 1367 /* >> 1368 * ioctl(2) >>=20 >> As for the assembler level view for the routine containing the >> loop (via inlining and such): >>=20 >> Dump of assembler code for function freebsd_rw_unlock: >> 0x0000000060051bd0 <+0>: push %rbp >> 0x0000000060051bd1 <+1>: mov %rsp,%rbp >> 0x0000000060051bd4 <+4>: push %rbx >> 0x0000000060051bd5 <+5>: push %rax >> 0x0000000060051bd6 <+6>: mov %edi,%ebx >> 0x0000000060051bd8 <+8>: mov $0x20,%esi >> 0x0000000060051bdd <+13>: mov $0x3,%edx >> 0x0000000060051be2 <+18>: callq 0x60036b70 >> 0x0000000060051be7 <+23>: mov %eax,%ecx >> 0x0000000060051be9 <+25>: mov $0xfffffff2,%eax >> 0x0000000060051bee <+30>: test %ecx,%ecx >> 0x0000000060051bf0 <+32>: jne 0x60051c50 = >> 0x0000000060051bf2 <+34>: mov %ebx,%edi >> 0x0000000060051bf4 <+36>: add 0x26a6355(%rip),%rdi # = 0x626f7f50 >> 0x0000000060051bfb <+43>: je 0x60051c50 = >> 0x0000000060051bfd <+45>: mov (%rdi),%ecx >> 0x0000000060051bff <+47>: mov 0x4(%rdi),%edx >> 0x0000000060051c02 <+50>: test %ecx,%ecx >> 0x0000000060051c04 <+52>: js 0x60051c30 >> 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx >> 0x0000000060051c0c <+60>: je 0x60051c4b = >> 0x0000000060051c0e <+62>: lea -0x1(%rcx),%esi >> 0x0000000060051c11 <+65>: nopw %cs:0x0(%rax,%rax,1) >> 0x0000000060051c1b <+75>: nopl 0x0(%rax,%rax,1) >> NOTE: loop is below: >> 0x0000000060051c20 <+80>: mov %ecx,%eax >> =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) >> 0x0000000060051c26 <+86>: sete %bl >> 0x0000000060051c29 <+89>: test %bl,%bl >> 0x0000000060051c2b <+91>: je 0x60051c20 >> Note: loop is above >> 0x0000000060051c2d <+93>: jmp 0x60051c57 = >> 0x0000000060051c2f <+95>: nop >> 0x0000000060051c30 <+96>: mov %ecx,%esi >> 0x0000000060051c32 <+98>: and $0x7fffffff,%esi >> 0x0000000060051c38 <+104>: mov %ecx,%eax >> 0x0000000060051c3a <+106>: lock cmpxchg %esi,(%rdi) >> 0x0000000060051c3e <+110>: sete %bl >> 0x0000000060051c41 <+113>: test %bl,%bl >> 0x0000000060051c43 <+115>: jne 0x60051c57 = >> 0x0000000060051c45 <+117>: mov (%rdi),%ecx >> 0x0000000060051c47 <+119>: test %ecx,%ecx >> 0x0000000060051c49 <+121>: js 0x60051c30 >> 0x0000000060051c4b <+123>: mov $0xffffffff,%eax >> 0x0000000060051c50 <+128>: add $0x8,%rsp >> 0x0000000060051c54 <+132>: pop %rbx >> 0x0000000060051c55 <+133>: pop %rbp >> 0x0000000060051c56 <+134>: retq =20 >> 0x0000000060051c57 <+135>: test $0x2,%dl >> 0x0000000060051c5a <+138>: jne 0x60051c70 = >> 0x0000000060051c5c <+140>: test $0x40000000,%ecx >> 0x0000000060051c62 <+146>: jne 0x60051c82 = >> 0x0000000060051c64 <+148>: xor %eax,%eax >> 0x0000000060051c66 <+150>: test $0x20000000,%ecx >> 0x0000000060051c6c <+156>: je 0x60051c50 = >> 0x0000000060051c6e <+158>: jmp 0x60051c89 = >> 0x0000000060051c70 <+160>: test $0x20000000,%ecx >> 0x0000000060051c76 <+166>: jne 0x60051c89 = >> 0x0000000060051c78 <+168>: xor %eax,%eax >> 0x0000000060051c7a <+170>: test $0x40000000,%ecx >> 0x0000000060051c80 <+176>: je 0x60051c50 = >> 0x0000000060051c82 <+178>: mov $0x1,%edx >> 0x0000000060051c87 <+183>: jmp 0x60051c8e = >> 0x0000000060051c89 <+185>: mov $0x7fffffff,%edx >> 0x0000000060051c8e <+190>: mov $0x3,%esi >> 0x0000000060051c93 <+195>: xor %ecx,%ecx >> 0x0000000060051c95 <+197>: xor %r8d,%r8d >> 0x0000000060051c98 <+200>: callq 0x601b5970 <_umtx_op> >> 0x0000000060051c9d <+205>: mov %eax,%edi >> 0x0000000060051c9f <+207>: add $0x8,%rsp >> 0x0000000060051ca3 <+211>: pop %rbx >> 0x0000000060051ca4 <+212>: pop %rbp >> --Type for more, q to quit, c to continue without paging-- >> 0x0000000060051ca5 <+213>: jmpq 0x60040a40 >> End of assembler dump. >>=20 >> For just before the "lock cmpxchg %esi,(%rdi)" in the loop: >>=20 >> rax 0x20000001 536870913 >> rbx 0xf4dede00 4108246528 >> rcx 0x20000001 536870913 >> rdx 0x2 2 >> rsi 0x20000000 536870912 >> rdi 0xf4dede80 4108246656 >>=20 >> (gdb) x 0xf4dede80 >> 0xf4dede80: 0x40000001 >>=20 >> 0x0000000060051c20 <+80>: mov %ecx,%eax >> =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) >> 0x0000000060051c26 <+86>: sete %bl >> 0x0000000060051c29 <+89>: test %bl,%bl >> 0x0000000060051c2b <+91>: je 0x60051c20 >>=20 >>=20 >> At this point I do not have interpretation of the details, not even >> a comparison to the source code. >=20 >=20 > . . . (misleading notes deleted) . . . I was wrong about the code motion: in . . . } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { /* decrement reader count */ for (;;) { if (!tcmpset_32(&target_urwlock->rw_state, state, (state - = 1))) { if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) { unlock_user_struct(target_urwlock, target_addr, 1); return -TARGET_EPERM; } } else { break; } } the outer test was leading to the inner-if being eliminated. While "volatile state" stopped that from happening it did not fix the hang-up in the loop. (There are likely other consequences to the use of memory involved instead of just a register as well.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Wed Jan 2 09:38:06 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86817143C600 for ; Wed, 2 Jan 2019 09:38:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-2.consmr.mail.bf2.yahoo.com (sonic308-2.consmr.mail.bf2.yahoo.com [74.6.130.41]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D401683B15 for ; Wed, 2 Jan 2019 09:38:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: MbZRxqYVM1l0RTrWfY6B92ehXKJR0C1h1dBiyFQS.v2aTdKrGhofAhr7awVzRnc 5fbpIqxQKZRQ2jM72yV_zjdBR8RCQc0sEAFdkXmM.6ua2btuW97BqkLiExhy7D2ntO80xlkkSr0M oFllVLUy2zJlOWuFzZMnV1bLm0XaISM0pEGF2yBwKQY.dFS00CgN3tK0hu55XAc2DRuaQzqIsQmZ eLUCoqUpdEcJe5RlMCtJPY3RAa4z0onXbYk2aq_C.eOq3bfMQ9CZFtzpbZScAEc5rdZzdxSYtnsC 3m9UzQUD_5aV0naei5y60Vst8.eFISJSviU5hVkTGYt8xo7tEvNBTmtrmHHkFDqcqeKZ0dFFjE66 m3q2Td8SYNNidAKlp.QNjJfvjFSO5EVVgaJbsZt2x_lwqrXWK3qu4AgY3m13Z3ivcvBQ_QH3em7l JCeieNunB5ihHTyrENUibvA2E3esVeyKuhd3.z6QZgLMVot6gIZCRQj_fu_uBH_ONcugGucdiYDf EHDf2ERPtWlgQTO32Dp.icDgYfnA4CcwIf3AKmhfocrlt434BmKAqHbpDHI8sRuErOrIlgAM3XNZ K7UvlevwscAzf3.08kM98qDXoIrAmVrm4Y94C4R2JTDHy82vHRAPzZTfofNTrtwKWarFxxr6WuiC 59Hn0NMIysOrUP032GTTZO1ezzY.XHV8y.OKFxktYutNsfEN7Vg..PKEo9xFuTy0alBYy.qSeuLK cuPzBrFk3cIyLUzQEgl4jc6xrjC.Uh2Z9N6SgyxXBFm9Emg2FueJJvRCz6Ejz3Umvwd67TUMghAc tjR9ELh77Mt1.nSVgd5xy6u7xmaJxsNQf5jvA7OLzMojx_ZG3y9Jt1WQxyvBfb2oBkDELlyVr1CJ 9AbTtCHCNVv6cfEbaLxHnRpX5iQT39UEFdTJHAetnKrLwVJQDtKgc2_Bd60sCOyKtGUeFCmnTJqG FmPWFXWzVjEDmdvU_iyK7V0RiZwvcEO1GtJyigpN6IDeBf7S8wgLOTX_h9A3hsRWovQwTVIvyGZN sYbXfZ36K0ECCoNlIBbiEHZDFWzhnnETHJxGrp0oXQ4uJwRwalXpeloPpVQ2IrnLwSMBud2buYE8 7V30- Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.bf2.yahoo.com with HTTP; Wed, 2 Jan 2019 09:37:57 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp410.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID c13c494d5caefe516d52fee49a1e7ccf; Wed, 02 Jan 2019 09:37:56 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 [a tested fix included] From: Mark Millard In-Reply-To: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> Date: Wed, 2 Jan 2019 01:37:53 -0800 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> To: Sean Bruno , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: D401683B15 X-Spamd-Bar: + X-Spamd-Result: default: False [1.27 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.40)[-0.400,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.83)[0.830,0]; NEURAL_HAM_LONG(-0.02)[-0.020,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.37)[ip: (4.24), ipnet: 74.6.128.0/21(1.50), asn: 26101(1.20), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[41.130.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Jan 2019 09:38:06 -0000 On 2019-Jan-1, at 18:43, Mark Millard wrote: > The below showed up for poudiere-devel bulk getting stuck using one = FreeBSD > cpu while building graphics/poppler-qt5 . This is not a kevent = hang-up, unlike > the last hang-up that I analyzed. I do not yet know how repeatable = this is > but the original hang-up and the one experiment the below is from. >=20 > =46rom top: >=20 > PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME = CPU COMMAND > 12789 root 4 52 0 166M 33M 0 uwait 6 36:06 = 97.22% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/graphics/poppler-qt5/work/poppler-0 >=20 > Note: The vast margority of the 36:06 has been stuck in the uwait loop = involved. >=20 > =46rom ps -auxd: >=20 > root 94075 0.0 0.0 12932 3552 1 S+ 10:42 = 0:01.21 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > root 1944 0.0 0.0 12932 3540 1 I+ 10:42 = 0:00.00 | |-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > root 1957 0.0 0.0 12932 3556 1 I 10:42 = 0:00.04 | |-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: = build_pkg (poppler-qt5-0.72.0) (sh) > root 12328 0.0 0.0 12932 3548 1 I 10:49 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][01]: build_pkg (poppler-qt5-0.72.0) = (sh) > root 12329 0.0 0.0 10328 1756 1 IJ 10:49 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/graphics/poppler-qt5 stage > root 12350 0.0 0.0 9860 1248 1 IJ 10:49 = 0:00.00 | | `-- /usr/bin/make -f Makefile = DESTDIR=3D/wrkdirs/usr/ports/graphics/poppler-qt5/work/stage install > root 12353 0.0 0.0 10236 1664 1 IJ 10:49 = 0:00.05 | | `-- /nxb-bin/usr/bin/make -f = CMakeFiles/Makefile2 qt5/all > root 12787 0.0 0.0 9856 1236 1 IJ 10:50 = 0:00.00 | | `-- /nxb-bin/usr/bin/make -f = qt5/tests/CMakeFiles/check_qt5_attachments_autogen.dir/build.make = qt5/test > root 12789 100.0 0.0 169868 33528 1 IJ 10:50 = 36:35.26 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/ > root 94423 0.0 0.0 12932 3484 1 S+ 10:42 = 0:12.91 | `-- sh -e /usr/local/share/poudriere/bulk.sh = -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 >=20 >=20 > (gdb) attach 12789 > Attaching to process 12789 > Reading symbols from = /usr/local/poudriere/data/.m/FBSDFSSDjailArmV7-default/01/usr/local/bin/qe= mu-arm-static...done. > [New LWP 101168 of process 12789] > [New LWP 101178 of process 12789] > [New LWP 101499 of process 12789] > [Switching to LWP 100304 of process 12789] > _umtx_op () at _umtx_op.S:3 > 3 RSYSCALL(_umtx_op) > (gdb) info threads > Id Target Id Frame=20 > * 1 LWP 100304 of process 12789 _umtx_op () at _umtx_op.S:3 > 2 LWP 101168 of process 12789 _umtx_op_err () at = /usr/src/lib/libthr/arch/amd64/amd64/_umtx_op_err.S:37 > 3 LWP 101178 of process 12789 _umtx_op () at _umtx_op.S:3 > 4 LWP 101499 of process 12789 0x0000000060051c26 in = atomic_cmpset_int (dst=3D, expect=3D, = src=3D536870912) at /usr/include/machine/atomic.h:220 > (gdb) thread 4 > [Switching to thread 4 (LWP 101499 of process 12789)] > #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 > 220 ATOMIC_CMPSET(int); >=20 > (gdb) bt > #0 0x0000000060051c26 in atomic_cmpset_int (dst=3D, = expect=3D, src=3D536870912) at = /usr/include/machine/atomic.h:220 > #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 > #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) > at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 > arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 > #5 0x00000000600392f0 in target_cpu_loop (env=3D0x86159b118) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/arm/target_arch_cpu.h:207 > #6 0x0000000060038c99 in cpu_loop (env=3D0xf4dede80) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/main.c:121 > #7 0x0000000060050c1a in new_freebsd_thread_start (arg=3D) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:152 > #8 0x00000000601ad5f6 in thread_start (curthread=3D0x861571300) at = /usr/src/lib/libthr/thread/thr_create.c:291 > #9 0x0000000000000000 in ?? () > Backtrace stopped: Cannot access memory at address 0x7fffdfbb3000 >=20 > 181 #define ATOMIC_CMPSET(TYPE) \ > 182 static __inline int \ > 183 atomic_cmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE expect, = u_##TYPE src) \ > 184 { \ > (gdb)=20 > 185 u_char res; \ > 186 \ > 187 __asm __volatile( \ > 188 " " MPLOCKED " " \ > 189 " cmpxchg %3,%1 ; " \ > 190 " sete %0 ; " \ > 191 "# atomic_cmpset_" #TYPE " " \ > 192 : "=3Dq" (res), /* 0 */ \ > 193 "+m" (*dst), /* 1 */ \ > 194 "+a" (expect) /* 2 */ \ > (gdb)=20 > 195 : "r" (src) /* 3 */ \ > 196 : "memory", "cc"); \ > 197 return (res); \ > 198 } \ > . . . > 218 ATOMIC_CMPSET(char); > 219 ATOMIC_CMPSET(short); > 220 ATOMIC_CMPSET(int); > 221 ATOMIC_CMPSET(long); >=20 > (gdb) up > #1 tcmpset_32 (addr=3D, a=3D, = b=3D536870912) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:178 > 178 return atomic_cmpset_acq_32(addr, current, new); > (gdb) list > 173 static int tcmpset_32(uint32_t *addr, uint32_t a, uint32_t b) > 174 { > 175 uint32_t current =3D tswap32(a); > 176 uint32_t new =3D tswap32(b); > 177=09 > 178 return atomic_cmpset_acq_32(addr, current, new); > 179 } >=20 > (gdb) up > #2 freebsd_rw_unlock (target_addr=3D4108246528) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.c:1264 > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { > (gdb) list > 1259 } > 1260 } > 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { > 1262 /* decrement reader count */ > 1263 for (;;) { > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { > 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { > 1266 unlock_user_struct(target_urwlock, > 1267 target_addr, 1); > 1268 return -TARGET_EPERM; > (gdb)=20 > 1269 } > 1270 } else { > 1271 break; > 1272 } > 1273 } > 1274 } else { > 1275 unlock_user_struct(target_urwlock, target_addr, 1); > 1276 return -TARGET_EPERM; > 1277 } > 1278=09 >=20 > The above loop is where the code is stuck looping, using most of the = capacity of > one cpu (as FreeBSD classifies cpus). The value of state is stuck at: >=20 > (gdb) print state > $2 =3D 536870913 >=20 > I'll note that the loop is inside qemu-arm-atatic, not in the cmake = that it > is running. >=20 >=20 >=20 > To show a little more context before the assembler for the routine = that ends up > containing that loop: >=20 > (gdb) up > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=3D, = op=3D536870912, val=3D, uaddr=3D, = target_time=3D) > at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/freebsd/os-thread.h:474 > 474 ret =3D freebsd_rw_unlock(obj); > (gdb) list > 469 ret =3D freebsd_rw_wrlock(obj, val, 0, NULL); > 470 } > 471 break; > 472=09 > 473 case TARGET_UMTX_OP_RW_UNLOCK: > 474 ret =3D freebsd_rw_unlock(obj); > 475 break; > 476=09 > 477 #if defined(__FreeBSD_version) && __FreeBSD_version > 900000 > 478 #ifdef UMTX_OP_MUTEX_WAKE2 >=20 > (gdb) up > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=3D0x86159b118, = num=3D454, arg1=3D, arg2=3D, = arg3=3D, arg4=3D0, arg5=3D0, arg6=3D-184411592, = arg7=3D-199471616,=20 > arg8=3D-1622188640) at = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/syscall.c:1364 > 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); > (gdb) list > 1359 ret =3D do_freebsd__umtx_unlock(arg1); > 1360 break; > 1361 #endif > 1362=09 > 1363 case TARGET_FREEBSD_NR__umtx_op: /* undocumented */ > 1364 ret =3D do_freebsd__umtx_op(arg1, arg2, arg3, arg4, = arg5); > 1365 break; > 1366=09 > 1367 /* > 1368 * ioctl(2) >=20 > As for the assembler level view for the routine containing the > loop (via inlining and such): >=20 > Dump of assembler code for function freebsd_rw_unlock: > 0x0000000060051bd0 <+0>: push %rbp > 0x0000000060051bd1 <+1>: mov %rsp,%rbp > 0x0000000060051bd4 <+4>: push %rbx > 0x0000000060051bd5 <+5>: push %rax > 0x0000000060051bd6 <+6>: mov %edi,%ebx > 0x0000000060051bd8 <+8>: mov $0x20,%esi > 0x0000000060051bdd <+13>: mov $0x3,%edx > 0x0000000060051be2 <+18>: callq 0x60036b70 > 0x0000000060051be7 <+23>: mov %eax,%ecx > 0x0000000060051be9 <+25>: mov $0xfffffff2,%eax > 0x0000000060051bee <+30>: test %ecx,%ecx > 0x0000000060051bf0 <+32>: jne 0x60051c50 = > 0x0000000060051bf2 <+34>: mov %ebx,%edi > 0x0000000060051bf4 <+36>: add 0x26a6355(%rip),%rdi # = 0x626f7f50 > 0x0000000060051bfb <+43>: je 0x60051c50 = > 0x0000000060051bfd <+45>: mov (%rdi),%ecx > 0x0000000060051bff <+47>: mov 0x4(%rdi),%edx > 0x0000000060051c02 <+50>: test %ecx,%ecx > 0x0000000060051c04 <+52>: js 0x60051c30 > 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx > 0x0000000060051c0c <+60>: je 0x60051c4b = > 0x0000000060051c0e <+62>: lea -0x1(%rcx),%esi > 0x0000000060051c11 <+65>: nopw %cs:0x0(%rax,%rax,1) > 0x0000000060051c1b <+75>: nopl 0x0(%rax,%rax,1) > NOTE: loop is below: > 0x0000000060051c20 <+80>: mov %ecx,%eax > =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c26 <+86>: sete %bl > 0x0000000060051c29 <+89>: test %bl,%bl > 0x0000000060051c2b <+91>: je 0x60051c20 > Note: loop is above > 0x0000000060051c2d <+93>: jmp 0x60051c57 = > 0x0000000060051c2f <+95>: nop > 0x0000000060051c30 <+96>: mov %ecx,%esi > 0x0000000060051c32 <+98>: and $0x7fffffff,%esi > 0x0000000060051c38 <+104>: mov %ecx,%eax > 0x0000000060051c3a <+106>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c3e <+110>: sete %bl > 0x0000000060051c41 <+113>: test %bl,%bl > 0x0000000060051c43 <+115>: jne 0x60051c57 = > 0x0000000060051c45 <+117>: mov (%rdi),%ecx > 0x0000000060051c47 <+119>: test %ecx,%ecx > 0x0000000060051c49 <+121>: js 0x60051c30 > 0x0000000060051c4b <+123>: mov $0xffffffff,%eax > 0x0000000060051c50 <+128>: add $0x8,%rsp > 0x0000000060051c54 <+132>: pop %rbx > 0x0000000060051c55 <+133>: pop %rbp > 0x0000000060051c56 <+134>: retq =20 > 0x0000000060051c57 <+135>: test $0x2,%dl > 0x0000000060051c5a <+138>: jne 0x60051c70 = > 0x0000000060051c5c <+140>: test $0x40000000,%ecx > 0x0000000060051c62 <+146>: jne 0x60051c82 = > 0x0000000060051c64 <+148>: xor %eax,%eax > 0x0000000060051c66 <+150>: test $0x20000000,%ecx > 0x0000000060051c6c <+156>: je 0x60051c50 = > 0x0000000060051c6e <+158>: jmp 0x60051c89 = > 0x0000000060051c70 <+160>: test $0x20000000,%ecx > 0x0000000060051c76 <+166>: jne 0x60051c89 = > 0x0000000060051c78 <+168>: xor %eax,%eax > 0x0000000060051c7a <+170>: test $0x40000000,%ecx > 0x0000000060051c80 <+176>: je 0x60051c50 = > 0x0000000060051c82 <+178>: mov $0x1,%edx > 0x0000000060051c87 <+183>: jmp 0x60051c8e = > 0x0000000060051c89 <+185>: mov $0x7fffffff,%edx > 0x0000000060051c8e <+190>: mov $0x3,%esi > 0x0000000060051c93 <+195>: xor %ecx,%ecx > 0x0000000060051c95 <+197>: xor %r8d,%r8d > 0x0000000060051c98 <+200>: callq 0x601b5970 <_umtx_op> > 0x0000000060051c9d <+205>: mov %eax,%edi > 0x0000000060051c9f <+207>: add $0x8,%rsp > 0x0000000060051ca3 <+211>: pop %rbx > 0x0000000060051ca4 <+212>: pop %rbp > --Type for more, q to quit, c to continue without paging-- > 0x0000000060051ca5 <+213>: jmpq 0x60040a40 > End of assembler dump. >=20 > For just before the "lock cmpxchg %esi,(%rdi)" in the loop: >=20 > rax 0x20000001 536870913 > rbx 0xf4dede00 4108246528 > rcx 0x20000001 536870913 > rdx 0x2 2 > rsi 0x20000000 536870912 > rdi 0xf4dede80 4108246656 >=20 > (gdb) x 0xf4dede80 > 0xf4dede80: 0x40000001 >=20 > 0x0000000060051c20 <+80>: mov %ecx,%eax > =3D> 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > 0x0000000060051c26 <+86>: sete %bl > 0x0000000060051c29 <+89>: test %bl,%bl > 0x0000000060051c2b <+91>: je 0x60051c20 >=20 >=20 > At this point I do not have interpretation of the details, not even > a comparison to the source code. Note: The problem was observed in building ports head -r488859 's = graphics/poppler-qt5 . In the below code I've added a missing statement: > 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { > 1262 /* decrement reader count */ > 1263 for (;;) { > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, = (state - 1))) { __get_user(state, &target_urwlock->rw_state); > 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { > 1266 unlock_user_struct(target_urwlock, > 1267 target_addr, 1); > 1268 return -TARGET_EPERM; > (gdb)=20 > 1269 } > 1270 } else { > 1271 break; > 1272 } > 1273 } The lack of the update to 'state' is why it was valid for the compiler to eliminate the code for: > 1265 if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) = { > 1266 unlock_user_struct(target_urwlock, > 1267 target_addr, 1); > 1268 return -TARGET_EPERM; > (gdb)=20 > 1269 } So (without old line numbers): } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { /* decrement reader count */ for (;;) { if (!tcmpset_32(&target_urwlock->rw_state, state, (state - = 1))) { __get_user(state, &target_urwlock->rw_state); if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) { unlock_user_struct(target_urwlock, target_addr, 1); return -TARGET_EPERM; } } else { break; } } This follows the structure of other tcmpset_32 use in the source file. With this change poudriere-devel's bulk worked for graphics/poppler-qt5 as a amd64->armv7 cross-build (FreeBSD head -r341836 based, under = Hyper-V, with 28 logical-processors assigned): [00:00:13] [01] [00:00:00] Building graphics/poppler-qt5 | = poppler-qt5-0.72.0 [00:08:03] [01] [00:07:50] Finished graphics/poppler-qt5 | = poppler-qt5-0.72.0: Success =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Thu Jan 3 01:41:21 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2528C14388BE; Thu, 3 Jan 2019 01:41:21 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BCB5382FBB; Thu, 3 Jan 2019 01:41:20 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-lj1-f177.google.com (mail-lj1-f177.google.com [209.85.208.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 51D5311457; Thu, 3 Jan 2019 01:41:20 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-lj1-f177.google.com with SMTP id v1-v6so28542784ljd.0; Wed, 02 Jan 2019 17:41:20 -0800 (PST) X-Gm-Message-State: AJcUukfWT9N8dMCGmqn38AmC6tRmV8i4GIuafRdMmA4d/YLGFM85+EG4 WSFa/2SHFx7sWEM6U0Pdg8lknY92v9e4FqF99bQ= X-Google-Smtp-Source: AFSGD/VJMe+L+fDMV1QOWtVKFImtMj9oK/7YxzR6l2A9eNAQEZzYbL+cfIIFZCkJvNdmsv3pbmPNnzFZBOYtZg4EhjM= X-Received: by 2002:a2e:b04f:: with SMTP id d15-v6mr28618253ljl.3.1546479678673; Wed, 02 Jan 2019 17:41:18 -0800 (PST) MIME-Version: 1.0 References: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> In-Reply-To: From: Kyle Evans Date: Wed, 2 Jan 2019 19:41:07 -0600 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 [a tested fix included] To: Mark Millard Cc: Sean Bruno , freebsd-emulation@freebsd.org, ports-list freebsd , freebsd-arm Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: BCB5382FBB X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.97 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.97)[-0.969,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-0.998,0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 01:41:21 -0000 On Wed, Jan 2, 2019 at 3:38 AM Mark Millard via freebsd-ports wrote: > > On 2019-Jan-1, at 18:43, Mark Millard wrote: > > > The below showed up for poudiere-devel bulk getting stuck using one FreeBSD > > cpu while building graphics/poppler-qt5 . This is not a kevent hang-up, unlike > > the last hang-up that I analyzed. I do not yet know how repeatable this is > > but the original hang-up and the one experiment the below is from. > > > > From top: > > > > PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME CPU COMMAND > > 12789 root 4 52 0 166M 33M 0 uwait 6 36:06 97.22% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/poppler-qt5/work/poppler-0 > > > > Note: The vast margority of the 36:06 has been stuck in the uwait loop involved. > > > > From ps -auxd: > > > > root 94075 0.0 0.0 12932 3552 1 S+ 10:42 0:01.21 | `-- sh -e /usr/local/share/poudriere/bulk.sh -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > > root 1944 0.0 0.0 12932 3540 1 I+ 10:42 0:00.00 | |-- sh -e /usr/local/share/poudriere/bulk.sh -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > > root 1957 0.0 0.0 12932 3556 1 I 10:42 0:00.04 | |-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: build_pkg (poppler-qt5-0.72.0) (sh) > > root 12328 0.0 0.0 12932 3548 1 I 10:49 0:00.00 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][01]: build_pkg (poppler-qt5-0.72.0) (sh) > > root 12329 0.0 0.0 10328 1756 1 IJ 10:49 0:00.01 | | `-- /usr/bin/make -C /usr/ports/graphics/poppler-qt5 stage > > root 12350 0.0 0.0 9860 1248 1 IJ 10:49 0:00.00 | | `-- /usr/bin/make -f Makefile DESTDIR=/wrkdirs/usr/ports/graphics/poppler-qt5/work/stage install > > root 12353 0.0 0.0 10236 1664 1 IJ 10:49 0:00.05 | | `-- /nxb-bin/usr/bin/make -f CMakeFiles/Makefile2 qt5/all > > root 12787 0.0 0.0 9856 1236 1 IJ 10:50 0:00.00 | | `-- /nxb-bin/usr/bin/make -f qt5/tests/CMakeFiles/check_qt5_attachments_autogen.dir/build.make qt5/test > > root 12789 100.0 0.0 169868 33528 1 IJ 10:50 36:35.26 | | `-- /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/graphics/ > > root 94423 0.0 0.0 12932 3484 1 S+ 10:42 0:12.91 | `-- sh -e /usr/local/share/poudriere/bulk.sh -jFBSDFSSDjailArmV7 -w graphics/poppler-qt5 > > > > > > (gdb) attach 12789 > > Attaching to process 12789 > > Reading symbols from /usr/local/poudriere/data/.m/FBSDFSSDjailArmV7-default/01/usr/local/bin/qemu-arm-static...done. > > [New LWP 101168 of process 12789] > > [New LWP 101178 of process 12789] > > [New LWP 101499 of process 12789] > > [Switching to LWP 100304 of process 12789] > > _umtx_op () at _umtx_op.S:3 > > 3 RSYSCALL(_umtx_op) > > (gdb) info threads > > Id Target Id Frame > > * 1 LWP 100304 of process 12789 _umtx_op () at _umtx_op.S:3 > > 2 LWP 101168 of process 12789 _umtx_op_err () at /usr/src/lib/libthr/arch/amd64/amd64/_umtx_op_err.S:37 > > 3 LWP 101178 of process 12789 _umtx_op () at _umtx_op.S:3 > > 4 LWP 101499 of process 12789 0x0000000060051c26 in atomic_cmpset_int (dst=, expect=, src=536870912) at /usr/include/machine/atomic.h:220 > > (gdb) thread 4 > > [Switching to thread 4 (LWP 101499 of process 12789)] > > #0 0x0000000060051c26 in atomic_cmpset_int (dst=, expect=, src=536870912) at /usr/include/machine/atomic.h:220 > > 220 ATOMIC_CMPSET(int); > > > > (gdb) bt > > #0 0x0000000060051c26 in atomic_cmpset_int (dst=, expect=, src=536870912) at /usr/include/machine/atomic.h:220 > > #1 tcmpset_32 (addr=, a=, b=536870912) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.c:178 > > #2 freebsd_rw_unlock (target_addr=4108246528) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.c:1264 > > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=, op=536870912, val=, uaddr=, target_time=) > > at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.h:474 > > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=0x86159b118, num=454, arg1=, arg2=, arg3=, arg4=0, arg5=0, arg6=-184411592, arg7=-199471616, > > arg8=-1622188640) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/syscall.c:1364 > > #5 0x00000000600392f0 in target_cpu_loop (env=0x86159b118) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/arm/target_arch_cpu.h:207 > > #6 0x0000000060038c99 in cpu_loop (env=0xf4dede80) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/main.c:121 > > #7 0x0000000060050c1a in new_freebsd_thread_start (arg=) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.c:152 > > #8 0x00000000601ad5f6 in thread_start (curthread=0x861571300) at /usr/src/lib/libthr/thread/thr_create.c:291 > > #9 0x0000000000000000 in ?? () > > Backtrace stopped: Cannot access memory at address 0x7fffdfbb3000 > > > > 181 #define ATOMIC_CMPSET(TYPE) \ > > 182 static __inline int \ > > 183 atomic_cmpset_##TYPE(volatile u_##TYPE *dst, u_##TYPE expect, u_##TYPE src) \ > > 184 { \ > > (gdb) > > 185 u_char res; \ > > 186 \ > > 187 __asm __volatile( \ > > 188 " " MPLOCKED " " \ > > 189 " cmpxchg %3,%1 ; " \ > > 190 " sete %0 ; " \ > > 191 "# atomic_cmpset_" #TYPE " " \ > > 192 : "=q" (res), /* 0 */ \ > > 193 "+m" (*dst), /* 1 */ \ > > 194 "+a" (expect) /* 2 */ \ > > (gdb) > > 195 : "r" (src) /* 3 */ \ > > 196 : "memory", "cc"); \ > > 197 return (res); \ > > 198 } \ > > . . . > > 218 ATOMIC_CMPSET(char); > > 219 ATOMIC_CMPSET(short); > > 220 ATOMIC_CMPSET(int); > > 221 ATOMIC_CMPSET(long); > > > > (gdb) up > > #1 tcmpset_32 (addr=, a=, b=536870912) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.c:178 > > 178 return atomic_cmpset_acq_32(addr, current, new); > > (gdb) list > > 173 static int tcmpset_32(uint32_t *addr, uint32_t a, uint32_t b) > > 174 { > > 175 uint32_t current = tswap32(a); > > 176 uint32_t new = tswap32(b); > > 177 > > 178 return atomic_cmpset_acq_32(addr, current, new); > > 179 } > > > > (gdb) up > > #2 freebsd_rw_unlock (target_addr=4108246528) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.c:1264 > > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, (state - 1))) { > > (gdb) list > > 1259 } > > 1260 } > > 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) != 0) { > > 1262 /* decrement reader count */ > > 1263 for (;;) { > > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, (state - 1))) { > > 1265 if (TARGET_URWLOCK_READER_COUNT(state) == 0) { > > 1266 unlock_user_struct(target_urwlock, > > 1267 target_addr, 1); > > 1268 return -TARGET_EPERM; > > (gdb) > > 1269 } > > 1270 } else { > > 1271 break; > > 1272 } > > 1273 } > > 1274 } else { > > 1275 unlock_user_struct(target_urwlock, target_addr, 1); > > 1276 return -TARGET_EPERM; > > 1277 } > > 1278 > > > > The above loop is where the code is stuck looping, using most of the capacity of > > one cpu (as FreeBSD classifies cpus). The value of state is stuck at: > > > > (gdb) print state > > $2 = 536870913 > > > > I'll note that the loop is inside qemu-arm-atatic, not in the cmake that it > > is running. > > > > > > > > To show a little more context before the assembler for the routine that ends up > > containing that loop: > > > > (gdb) up > > #3 0x000000006004ab33 in do_freebsd__umtx_op (obj=, op=536870912, val=, uaddr=, target_time=) > > at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/freebsd/os-thread.h:474 > > 474 ret = freebsd_rw_unlock(obj); > > (gdb) list > > 469 ret = freebsd_rw_wrlock(obj, val, 0, NULL); > > 470 } > > 471 break; > > 472 > > 473 case TARGET_UMTX_OP_RW_UNLOCK: > > 474 ret = freebsd_rw_unlock(obj); > > 475 break; > > 476 > > 477 #if defined(__FreeBSD_version) && __FreeBSD_version > 900000 > > 478 #ifdef UMTX_OP_MUTEX_WAKE2 > > > > (gdb) up > > #4 0x0000000060041b83 in do_freebsd_syscall (cpu_env=0x86159b118, num=454, arg1=, arg2=, arg3=, arg4=0, arg5=0, arg6=-184411592, arg7=-199471616, > > arg8=-1622188640) at /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/bsd-user/syscall.c:1364 > > 1364 ret = do_freebsd__umtx_op(arg1, arg2, arg3, arg4, arg5); > > (gdb) list > > 1359 ret = do_freebsd__umtx_unlock(arg1); > > 1360 break; > > 1361 #endif > > 1362 > > 1363 case TARGET_FREEBSD_NR__umtx_op: /* undocumented */ > > 1364 ret = do_freebsd__umtx_op(arg1, arg2, arg3, arg4, arg5); > > 1365 break; > > 1366 > > 1367 /* > > 1368 * ioctl(2) > > > > As for the assembler level view for the routine containing the > > loop (via inlining and such): > > > > Dump of assembler code for function freebsd_rw_unlock: > > 0x0000000060051bd0 <+0>: push %rbp > > 0x0000000060051bd1 <+1>: mov %rsp,%rbp > > 0x0000000060051bd4 <+4>: push %rbx > > 0x0000000060051bd5 <+5>: push %rax > > 0x0000000060051bd6 <+6>: mov %edi,%ebx > > 0x0000000060051bd8 <+8>: mov $0x20,%esi > > 0x0000000060051bdd <+13>: mov $0x3,%edx > > 0x0000000060051be2 <+18>: callq 0x60036b70 > > 0x0000000060051be7 <+23>: mov %eax,%ecx > > 0x0000000060051be9 <+25>: mov $0xfffffff2,%eax > > 0x0000000060051bee <+30>: test %ecx,%ecx > > 0x0000000060051bf0 <+32>: jne 0x60051c50 > > 0x0000000060051bf2 <+34>: mov %ebx,%edi > > 0x0000000060051bf4 <+36>: add 0x26a6355(%rip),%rdi # 0x626f7f50 > > 0x0000000060051bfb <+43>: je 0x60051c50 > > 0x0000000060051bfd <+45>: mov (%rdi),%ecx > > 0x0000000060051bff <+47>: mov 0x4(%rdi),%edx > > 0x0000000060051c02 <+50>: test %ecx,%ecx > > 0x0000000060051c04 <+52>: js 0x60051c30 > > 0x0000000060051c06 <+54>: test $0x1fffffff,%ecx > > 0x0000000060051c0c <+60>: je 0x60051c4b > > 0x0000000060051c0e <+62>: lea -0x1(%rcx),%esi > > 0x0000000060051c11 <+65>: nopw %cs:0x0(%rax,%rax,1) > > 0x0000000060051c1b <+75>: nopl 0x0(%rax,%rax,1) > > NOTE: loop is below: > > 0x0000000060051c20 <+80>: mov %ecx,%eax > > => 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > > 0x0000000060051c26 <+86>: sete %bl > > 0x0000000060051c29 <+89>: test %bl,%bl > > 0x0000000060051c2b <+91>: je 0x60051c20 > > Note: loop is above > > 0x0000000060051c2d <+93>: jmp 0x60051c57 > > 0x0000000060051c2f <+95>: nop > > 0x0000000060051c30 <+96>: mov %ecx,%esi > > 0x0000000060051c32 <+98>: and $0x7fffffff,%esi > > 0x0000000060051c38 <+104>: mov %ecx,%eax > > 0x0000000060051c3a <+106>: lock cmpxchg %esi,(%rdi) > > 0x0000000060051c3e <+110>: sete %bl > > 0x0000000060051c41 <+113>: test %bl,%bl > > 0x0000000060051c43 <+115>: jne 0x60051c57 > > 0x0000000060051c45 <+117>: mov (%rdi),%ecx > > 0x0000000060051c47 <+119>: test %ecx,%ecx > > 0x0000000060051c49 <+121>: js 0x60051c30 > > 0x0000000060051c4b <+123>: mov $0xffffffff,%eax > > 0x0000000060051c50 <+128>: add $0x8,%rsp > > 0x0000000060051c54 <+132>: pop %rbx > > 0x0000000060051c55 <+133>: pop %rbp > > 0x0000000060051c56 <+134>: retq > > 0x0000000060051c57 <+135>: test $0x2,%dl > > 0x0000000060051c5a <+138>: jne 0x60051c70 > > 0x0000000060051c5c <+140>: test $0x40000000,%ecx > > 0x0000000060051c62 <+146>: jne 0x60051c82 > > 0x0000000060051c64 <+148>: xor %eax,%eax > > 0x0000000060051c66 <+150>: test $0x20000000,%ecx > > 0x0000000060051c6c <+156>: je 0x60051c50 > > 0x0000000060051c6e <+158>: jmp 0x60051c89 > > 0x0000000060051c70 <+160>: test $0x20000000,%ecx > > 0x0000000060051c76 <+166>: jne 0x60051c89 > > 0x0000000060051c78 <+168>: xor %eax,%eax > > 0x0000000060051c7a <+170>: test $0x40000000,%ecx > > 0x0000000060051c80 <+176>: je 0x60051c50 > > 0x0000000060051c82 <+178>: mov $0x1,%edx > > 0x0000000060051c87 <+183>: jmp 0x60051c8e > > 0x0000000060051c89 <+185>: mov $0x7fffffff,%edx > > 0x0000000060051c8e <+190>: mov $0x3,%esi > > 0x0000000060051c93 <+195>: xor %ecx,%ecx > > 0x0000000060051c95 <+197>: xor %r8d,%r8d > > 0x0000000060051c98 <+200>: callq 0x601b5970 <_umtx_op> > > 0x0000000060051c9d <+205>: mov %eax,%edi > > 0x0000000060051c9f <+207>: add $0x8,%rsp > > 0x0000000060051ca3 <+211>: pop %rbx > > 0x0000000060051ca4 <+212>: pop %rbp > > --Type for more, q to quit, c to continue without paging-- > > 0x0000000060051ca5 <+213>: jmpq 0x60040a40 > > End of assembler dump. > > > > For just before the "lock cmpxchg %esi,(%rdi)" in the loop: > > > > rax 0x20000001 536870913 > > rbx 0xf4dede00 4108246528 > > rcx 0x20000001 536870913 > > rdx 0x2 2 > > rsi 0x20000000 536870912 > > rdi 0xf4dede80 4108246656 > > > > (gdb) x 0xf4dede80 > > 0xf4dede80: 0x40000001 > > > > 0x0000000060051c20 <+80>: mov %ecx,%eax > > => 0x0000000060051c22 <+82>: lock cmpxchg %esi,(%rdi) > > 0x0000000060051c26 <+86>: sete %bl > > 0x0000000060051c29 <+89>: test %bl,%bl > > 0x0000000060051c2b <+91>: je 0x60051c20 > > > > > > At this point I do not have interpretation of the details, not even > > a comparison to the source code. > > > Note: The problem was observed in building ports head -r488859 's graphics/poppler-qt5 . > > In the below code I've added a missing statement: > > > 1261 } else if (TARGET_URWLOCK_READER_COUNT(state) != 0) { > > 1262 /* decrement reader count */ > > 1263 for (;;) { > > 1264 if (!tcmpset_32(&target_urwlock->rw_state, state, (state - 1))) { > __get_user(state, &target_urwlock->rw_state); > > 1265 if (TARGET_URWLOCK_READER_COUNT(state) == 0) { > > 1266 unlock_user_struct(target_urwlock, > > 1267 target_addr, 1); > > 1268 return -TARGET_EPERM; > > (gdb) > > 1269 } > > 1270 } else { > > 1271 break; > > 1272 } > > 1273 } > > The lack of the update to 'state' is why it was valid for the > compiler to eliminate the code for: > > > 1265 if (TARGET_URWLOCK_READER_COUNT(state) == 0) { > > 1266 unlock_user_struct(target_urwlock, > > 1267 target_addr, 1); > > 1268 return -TARGET_EPERM; > > (gdb) > > 1269 } > > So (without old line numbers): > > } else if (TARGET_URWLOCK_READER_COUNT(state) != 0) { > /* decrement reader count */ > for (;;) { > if (!tcmpset_32(&target_urwlock->rw_state, state, (state - 1))) { > __get_user(state, &target_urwlock->rw_state); > if (TARGET_URWLOCK_READER_COUNT(state) == 0) { > unlock_user_struct(target_urwlock, > target_addr, 1); > return -TARGET_EPERM; > } > } else { > break; > } > } > > This follows the structure of other tcmpset_32 use in the source file. > > With this change poudriere-devel's bulk worked for graphics/poppler-qt5 > as a amd64->armv7 cross-build (FreeBSD head -r341836 based, under Hyper-V, > with 28 logical-processors assigned): > Ah, thanks for that! I think your analysis is correct, and I've created a pull request [1] for Sean. This should fix the apparent hangs reported by many across armv7/aarch64. [1] https://github.com/seanbruno/qemu-bsd-user/pull/72 From owner-freebsd-emulation@freebsd.org Thu Jan 3 05:30:04 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5243B143F47B for ; Thu, 3 Jan 2019 05:30:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-15.consmr.mail.bf2.yahoo.com (sonic315-15.consmr.mail.bf2.yahoo.com [74.6.134.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8D6138A0E7 for ; Thu, 3 Jan 2019 05:30:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 5da9pNEVM1nXydlrnwMRYrMLkrSpI3886i6txx1jcS59GvMpCkE6rJmWi7oC6FK wnjMslm.uwAMmjrFI3u1VS44qG1_WKKOLSEx8KGCnnUOivxWL1W8wlZ.U.aKaDk4eg1BPNhlr.AD UZMPbD3RJKkNzvbUdPdosQkOjWhA6Pm6NpCeUIo_pNex58yP5.YQqZwSLAvXN40rfcYZNBh.x5J6 U853A1kseLBL7eVVHjvnBvvkGMhKqSir55LEanC1HdXCLPA5vabxMyW0CmSyTXPjAhLqChaoZjAu idGoNcVLJ7tvqZv8neqBu2F0uQ6oLX40zcZNqDgeHPBxQeyyKix4QTKzihJqEYkYkGbavcKUI0Tt YEDCWYzFKwioTBq1AGGax50UZmq_qACx9au9T7bRo7lMCtUB.qWPYi7Eq1mFVaTWKcOXZpGkWYAs _6hXOzHNwtH56Zd2gGS5MNaxfqynLwXC6niq3GMjI_nmDUJLHWpfT92o4X.lYYsmM98niSntI7aw FqnOVOAh1ZgM7A8lcsMjch4P1dB5g8_56NxMtvCmmFY2n5nhS08VYx.vZcl7U5USi2vth4.wbsip CSE1JkJcjxBxDatOZtiaS_0sxgDZdDZTJPGOcrzsC34sNFcap89wLbePrxSqsPOIRVMVtApqu7kX ntvhuuDtCcwApIgwIGczdufKgyEFto83ZNObhjFpY.XgyuygfjQvkF9_osN3Q5v7EJ3wG94ueT0B 0z.T3cnhP_W_ZqfUrw1nVO5T5Rm1ntX_ePiHtO7xokI.IacckmLPeN2nuuvhLVS5d.sXD3T3Ji_d DD5VeUYTFCqq9G9rRtCi3Q3gO2cb_ws0wQ86OsbZXcfo0LSf3nlL2vhHS4jGINN5Esa_SqFc1Imj TUONF.E9jIVTjHTt471mIUScIa_usW11E4l4mFCR6nbRoQYc1jafKrHxAbsZf6lF_nc1XlVUHC6P KzV6lIkjSvBuGAyQRanbfHeuhJzZ4SgDRv5dbDDD3zAcjLJFv4tomYquZU3v_YEmksFTf_OT9PU1 g6V56RSdgrtYlZL75NCvksJFbxDxPqj3vfVaYHlABzHmTBMt3vGyqMXZqQ_dz4Mxe2z4cjbVzLw- - Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.bf2.yahoo.com with HTTP; Thu, 3 Jan 2019 05:29:56 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp411.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 8dd332dbfed0ed5f8c56d879ed05fddf; Thu, 03 Jan 2019 05:29:56 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: qemu-arm-static under amd64: example of stuck looping atomic_cmpset_int while building graphics/poppler-qt5 [a tested fix included] From: Mark Millard In-Reply-To: Date: Wed, 2 Jan 2019 21:29:53 -0800 Cc: Sean Bruno , freebsd-emulation@freebsd.org, ports-list freebsd , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <8EFD9D72-AABD-4AB1-8592-8B78E779F67F@yahoo.com> References: <51834F45-1EB7-449F-A0EC-7F5EC7CBB12F@yahoo.com> To: Kyle Evans X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 8D6138A0E7 X-Spamd-Bar: +++ X-Spamd-Result: default: False [3.07 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.78)[0.781,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.49)[ip: (4.88), ipnet: 74.6.128.0/21(1.49), asn: 26101(1.19), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.72)[0.720,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.58)[0.582,0]; RCVD_IN_DNSWL_NONE(0.00)[125.134.6.74.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[125.134.6.74.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 05:30:04 -0000 On 2019-Jan-2, at 17:41, Kyle Evans wrote: > On Wed, Jan 2, 2019 at 3:38 AM Mark Millard via freebsd-ports > wrote: >>=20 >>> . . . >>=20 >> So (without old line numbers): >>=20 >> } else if (TARGET_URWLOCK_READER_COUNT(state) !=3D 0) { >> /* decrement reader count */ >> for (;;) { >> if (!tcmpset_32(&target_urwlock->rw_state, state, (state = - 1))) { >> __get_user(state, &target_urwlock->rw_state); >> if (TARGET_URWLOCK_READER_COUNT(state) =3D=3D 0) { >> unlock_user_struct(target_urwlock, >> target_addr, 1); >> return -TARGET_EPERM; >> } >> } else { >> break; >> } >> } >>=20 >> This follows the structure of other tcmpset_32 use in the source = file. >>=20 >> With this change poudriere-devel's bulk worked for = graphics/poppler-qt5 >> as a amd64->armv7 cross-build (FreeBSD head -r341836 based, under = Hyper-V, >> with 28 logical-processors assigned): >>=20 >=20 > Ah, thanks for that! I think your analysis is correct, and I've > created a pull request [1] for Sean. This should fix the apparent > hangs reported by many across armv7/aarch64. >=20 > [1] https://github.com/seanbruno/qemu-bsd-user/pull/72 There is also the issue that the __packed use for target_freebsd_kevent and target_freebsd11_kevent cause the wrong size and field offsets for armv7 (and armv6) when translating to or from the host (amd64) struct kevent vs. the target struct kevent. These hangs show up as in the kqread state or other such implying kevent is hung-up, unlike for the above. I'm using the following for now: > struct target_freebsd11_kevent { > abi_ulong ident; > int16_t filter; > uint16_t flags; > uint32_t fflags; > abi_long data; > abi_ulong udata; > } ; // __packed; >=20 > struct target_freebsd_kevent { > abi_ulong ident; > int16_t filter; > uint16_t flags; > uint32_t fflags; > int64_t data; > abi_ulong udata; > uint64_t ext[4]; > } ; // __packed; With these I was finally able to build lumina for armv7 via a cross-build (amd64->armv7). Sean is aware of this. However, I still get other hang-ups for targeting aarch64. I've started trying to gather evidence for the one I currently get. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Thu Jan 3 09:25:34 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BF8B3142203F for ; Thu, 3 Jan 2019 09:25:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-10.consmr.mail.ne1.yahoo.com (sonic308-10.consmr.mail.ne1.yahoo.com [66.163.187.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E32C76BAF4 for ; Thu, 3 Jan 2019 09:25:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: A3.moPAVM1kRZpCBbKh8mEmWkGJygBBJGnS5Y6_9lxYMa5tsRMD9lLTEYaS5G9g QMmOIerjKI8cxpll4aQEOpzqRbFVy4hoZPDYlXhtfeOY4tQgxrhiF4Lrr3U8NoFQLQwxG6pd5pp3 FEDCgiLrd_itW47NZsxDm6p8lqM1IH.cwqE3TT64peQMN6FSEeJNtvRK1CJZf7bO2vc_g8yXbhFz crgOqmYpfV6lAQr3jO7HM2TJBpbY550cS9ex8ZDaxD7Rhs5AOJmXNnyg7Xl7q4vqa0NEJB9guF8Q f8GQQqsu1KmQrybYhezfPrK1jlFmUfE4rN_aT.t90Wd9yLaF1x5sPoUvHWCqZVbsGPQEyH1L.V6A .yUcRK8T6Ko9hEpV6Hgibupe4br26A0IsgiesR.Za.jhkOUnrCfUP0.tT6EwQNmlH8vALt0szP.p 1C4vTGqFYkmzCfbGxLe9f1S8ZcYk.jUO1QDYxpf8wG_wbXITBqaWYddYzy1FtPMDVivTEfvPRW8p JdPn9LS3_Vtg7MEIrsQjx4mBGp5x7gzNAHp1A2veo3PXJWbWOlQu3zETHzNGBmV5WRuSwqIyMf3j adjDzOmdMeZIZ8cPWN_2yF0PRpbDfXket3k20Yd45l0pyJ1D3OzvKMf_OmMOB00HjHeemyPV6jpa MvjokmO4hrfOP6VMllk0jvhy8YBpH6H70D7yW61eF0Cin_SdEJ88g7zXpVeFGSiATpbOrTgSYLMC GxNaXSb9fWgnwQm72cX0Gw.mCVIcMfshVJe4Tms3YN50QMUL.nSxlQuwY7.GcUN3V7Tn9W0HUjUE gjfU3jNowTCg51gJIMnqD0gFlE4KHFaWAHjuFysksJcjTm_lWYuFjq5WEUQeUWgnTftYtIr1KL_v 4SHM1EvZ0AxZcpKVHhK8XDbmEuwEOV2pOCBEe98S_J9Gl6Fa278epFevje2ufJlc0wPAdaWzmC_z I.tcjYm3XbUtSZi.tGt1SiYLXijBSJbDo.Yoh3ccueZwbbFbjD6Jip7aDhWkq9wObvpM8QqZ89Lb dVZH_rVuts_neNipjSmR9hXE2qsTH7A7PXNNP.J5waLqfLgRVc0otlUh_LociA9Ke5TvsIo4vmDe hnsd0Fg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.ne1.yahoo.com with HTTP; Thu, 3 Jan 2019 09:25:27 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp402.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID b8f2f43454d6314b563298e05f0013d4; Thu, 03 Jan 2019 09:25:25 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Under qemu-aarch64-static "wc /dev/null" gets "Unsupported ancillary data: 1/0" from a sendmsg attempt: because of wrong cmsg_len type in target_cmsghdr Message-Id: <22184643-4320-4B7C-86DA-A71DF62D4543@yahoo.com> Date: Thu, 3 Jan 2019 01:25:23 -0800 Cc: freebsd-arm To: Kyle Evans , freebsd-emulation@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: E32C76BAF4 X-Spamd-Bar: + X-Spamd-Result: default: False [2.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.80)[0.801,0]; NEURAL_HAM_LONG(-0.01)[-0.012,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.22)[ip: (4.20), ipnet: 66.163.184.0/21(1.11), asn: 36646(0.88), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.50)[0.497,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[33.187.163.66.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 09:25:35 -0000 [This note follows the investigation sequence, ending with the important conclusions.] My test context here is a poudriere-devel bulk -i for a amd64->aarch64 context. wc /dev/null or wc //dev/null does: # wc /dev/null Unsupported ancillary data: 1/0 that then hangs-up until I ^C to get back to a prompt. Here is what ktrace/kdump shows the process before the hang through when I hit ^C to stop the hang-up: . . . 98475 101033 qemu-aarch64-static 0.000340 CALL = sigprocmask[340](SIG_BLOCK,0x7ffffffe3c80,0x7ffffffe3d80) 98475 101033 qemu-aarch64-static 0.000003 RET sigprocmask[340] 0 98475 101033 qemu-aarch64-static 0.000001 CALL = pselect[522](0x6,0,0x7ffffffe3fb0,0,0,0x7ffffffe3d80) 98475 101033 qemu-aarch64-static 0.000001 RET pselect[522] 1 98475 101033 qemu-aarch64-static 0.000001 CALL = sigprocmask[340](SIG_SETMASK,0x7ffffffe3c80,0) 98475 101033 qemu-aarch64-static 0.000001 RET sigprocmask[340] 0 98475 101033 qemu-aarch64-static 0.000042 CALL = write[4](0x2,0x7ffffffe3480,0x20) 98475 101033 qemu-aarch64-static 0.000036 GIO fd 2 wrote 32 bytes "Unsupported ancillary data: 1/0 " 98475 101033 qemu-aarch64-static 0.000003 RET write[4] 32/0x20 98475 101033 qemu-aarch64-static 0.000001 CALL = sendmsg[28](0x5,0x7ffffffe3c28,0) 98475 101033 qemu-aarch64-static 0.000003 RET sendmsg[28] -1 errno 22 = Invalid argument 98475 101033 qemu-aarch64-static 0.000184 CALL close[6](0x3) 98475 101033 qemu-aarch64-static 0.000040 RET close[6] 0 98475 101033 qemu-aarch64-static 0.000017 CALL close[6](0x7) 98475 101033 qemu-aarch64-static 0.000005 RET close[6] 0 98475 101033 qemu-aarch64-static 0.000002 CALL = sigprocmask[340](SIG_BLOCK,0x7ffffffe3c80,0x7ffffffe3d80) 98475 101033 qemu-aarch64-static 0.000001 RET sigprocmask[340] 0 98475 101033 qemu-aarch64-static 0.000001 CALL = pselect[522](0x6,0x7ffffffe3dd0,0,0,0,0x7ffffffe3d80) 98475 101539 qemu-aarch64-static 0.000089 RET nanosleep[240] 0 98475 101539 qemu-aarch64-static 0.000042 CALL = _umtx_op[454](0x86101f008,UMTX_OP_WAIT_UINT_PRIVATE,0,0,0) 98475 101033 qemu-aarch64-static 15.845396 RET pselect[522] -1 errno = 4 Interrupted system call Note the qemu-aarch64 genrated message and the later: sendmsg[28] -1 errno 22 Invalid argument The qemu-*-static code that wrote the message is from t2h_freebsd_cmsg and is: if ((cmsg->cmsg_level =3D=3D TARGET_SOL_SOCKET) && (cmsg->cmsg_type =3D=3D SCM_RIGHTS)) { int *fd =3D (int *)data; int *target_fd =3D (int *)target_data; int i, numfds =3D len / sizeof(int); for (i =3D 0; i < numfds; i++) { fd[i] =3D tswap32(target_fd[i]); } } else if ((cmsg->cmsg_level =3D=3D TARGET_SOL_SOCKET) && (cmsg->cmsg_type =3D=3D SCM_TIMESTAMP) && (len =3D=3D sizeof(struct timeval))) { /* copy struct timeval to host */ struct timeval *tv =3D (struct timeval *)data; struct target_freebsd_timeval *target_tv =3D (struct target_freebsd_timeval *)target_data; __get_user(tv->tv_sec, &target_tv->tv_sec); __get_user(tv->tv_usec, &target_tv->tv_usec); } else { gemu_log("Unsupported ancillary data: %d/%d\n", cmsg->cmsg_level, cmsg->cmsg_type); memcpy(data, target_data, len); } =20 Well it turns out that qemu_*-static 's code has: struct target_cmsghdr { abi_long cmsg_len; int32_t cmsg_level; int32_t cmsg_type; }; where for amd64 target_cmsghdr has: (gdb) p/d sizeof(struct target_cmsghdr) $2 =3D 16 (gdb) p/d sizeof(((struct target_cmsghdr *)0)->cmsg_len)=20 $5 =3D 8 (gdb) p/d &((struct target_cmsghdr *)0)->cmsg_level $4 =3D 8 (gdb) p/d &((struct target_cmsghdr *)0)->cmsg_type=20 $1 =3D 12 which does not match the amd64 or aarch64 native: struct cmsghdr { socklen_t cmsg_len; /* data byte count, = including hdr */ int cmsg_level; /* originating protocol = */ int cmsg_type; /* protocol-specific = type */ /* followed by u_char cmsg_data[]; */ }; =20 because the cmsghdr's cmsg_len is smaller, even on a 64-bit = architecture: (gdb) p/d sizeof(((struct cmsghdr *)0)->cmsg_len) $6 =3D 4 /usr/include/arpa/inet.h:typedef __socklen_t socklen_t; /usr/include/netinet/in.h:typedef __socklen_t socklen_t; /usr/include/netinet6/in6.h:typedef __socklen_t socklen_t; /usr/include/sys/_types.h:typedef __uint32_t __socklen_t; /usr/include/sys/socket.h:typedef __socklen_t socklen_t; . . . /usr/include/netdb.h:typedef __socklen_t socklen_t; so abi_long does not match socklen_t for 64-bit architectures. So code such as in t2h_freebsd_cmsg: cmsg->cmsg_level =3D tswap32(target_cmsg->cmsg_level); cmsg->cmsg_type =3D tswap32(target_cmsg->cmsg_type); is not using the correct target offsets when aarch64 is the target that it is extracting from (for example). For comparison on a 64-bit architecture: (gdb) p/d sizeof(struct cmsghdr) $1 =3D 12 (gdb) p/d &((struct cmsghdr *)0)->cmsg_level $2 =3D 4 (gdb) p/d &((struct cmsghdr *)0)->cmsg_type=20 $3 =3D 8 I do not yet have a tested change. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Thu Jan 3 10:06:58 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1BF5E14234ED for ; Thu, 3 Jan 2019 10:06:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-3.consmr.mail.bf2.yahoo.com (sonic301-3.consmr.mail.bf2.yahoo.com [74.6.129.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 22D226DCF4 for ; Thu, 3 Jan 2019 10:06:57 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 7ood0GYVM1lSeOFmgC1s1hlM8tzFFMRcYIDJ7P3KPG0CMGHRpi32PWOcUt18enQ dClTYGeNWjl5NxLd.w6sK61tZVKenkajbbhvYmCKhcJw0LKxjdou_QQ6llHg5OpV1z1e8chmkV3A aal1TSp_QzvP6lfpklrk28Wn_Dxzwp6A_QYnq69O2xkNB2bJ3M5p8GMR3hQ1.oPfh3tHr8n8XLbW m6JcjEz9Uhp8IWaFJwcm7Hkv8wz8hyOcXFiMFbcQXKcY.m0QRNnnn.4W2DPKpa6UhzlS6gqV34oS XNQCwJ3yVzpxeHLDrP4XuoolJlIqzNRqIdORGk.0cNMTbNLCNKCNEkf7f7KHWdSv3NW0buz26c56 gxs_oLpdMf6Ons1OS_.O9joaAARO87nwYlx3wH5S05ew40FASH1rMvBuhf9d7fEnWCprTDmLh91y eYgdAZI7Ps9_6pk9zZi5SY5UhbnwrSE5qNxj1NEPranFw1KnSjY8WW6C3ZVOGw.9wAEt0tK7UxVx mWDhhLqGWm5WOetuu2pW62T0e7jK5PA1MFEQTMU0XWfWs3t8lY6rh.HQoIlxlx9ME4FOZoO6LW.q jqIGoREaXin4BlHgbBYEAvQ3vn9qKgAZqhRhdErM4t8tBU4nwi.ZJDdPtq9mPwLrm7b4IlarLzZO Voma1jUuTnHzvwKJIs0pxHNOoL699Qq1fKNUnF8nqH_RabkBOeqgUYY0LzQ8bZWj2Xa6CkGHhH0u joAiN.yj__HBqJN0gZERV4HI3ReBnFsd8TVueNKZcELjfm3GxkCr9Rn73huzBZw4RclHn9mAXzU3 Th0GY3hiK3mv6msSpCTHc0LiOIauwRDDI58eupm5vjiQQVBFA1O7XD_EApfr1AUblFdDcsJSACwG NaLh0hyeUs6KIaDmOW98oOxQV90woD3DBbplOCkYSPUTk7f7r000smD4.0R8G9rNwDBf_9pX9M12 UCja4DyJxNqS4tEbCsLJl2SYbsJB_NzoztV9_MkvcOUSCmMPEOzzIrRhzt203sl4ttt6L8hDqXq0 qu_oGR9qrPohzX77A8evXxTP6CsypwrfQcCgXyrpcYMLoe8wLMKr8LM1pcKQdSjMKfZ7uNzQ_Bu_ sU1dRcQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.bf2.yahoo.com with HTTP; Thu, 3 Jan 2019 10:06:55 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp425.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID e2e1ad36aec9e258eee1043557fc3499; Thu, 03 Jan 2019 10:06:53 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: Under qemu-aarch64-static "wc /dev/null" gets "Unsupported ancillary data: 1/0" from a sendmsg attempt: because of wrong cmsg_len type in target_cmsghdr From: Mark Millard In-Reply-To: <22184643-4320-4B7C-86DA-A71DF62D4543@yahoo.com> Date: Thu, 3 Jan 2019 02:06:51 -0800 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <22184643-4320-4B7C-86DA-A71DF62D4543@yahoo.com> To: Kyle Evans , freebsd-emulation@freebsd.org X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 22D226DCF4 X-Spamd-Bar: ++ X-Spamd-Result: default: False [2.84 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.96)[0.957,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.43)[ip: (4.52), ipnet: 74.6.128.0/21(1.49), asn: 26101(1.19), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.64)[0.643,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.32)[0.322,0]; RCVD_IN_DNSWL_NONE(0.00)[42.129.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 10:06:58 -0000 [Adding a for-reference note.] On 2019-Jan-3, at 01:25, Mark Millard wrote: > [This note follows the investigation sequence, > ending with the important conclusions.] >=20 > My test context here is a poudriere-devel bulk -i for a > amd64->aarch64 context. >=20 > wc /dev/null or wc //dev/null does: >=20 > # wc /dev/null > Unsupported ancillary data: 1/0 >=20 > that then hangs-up until I ^C to get back to a prompt. >=20 >=20 > Here is what ktrace/kdump shows the process before the hang through > when I hit ^C to stop the hang-up: >=20 > . . . > 98475 101033 qemu-aarch64-static 0.000340 CALL = sigprocmask[340](SIG_BLOCK,0x7ffffffe3c80,0x7ffffffe3d80) > 98475 101033 qemu-aarch64-static 0.000003 RET sigprocmask[340] 0 > 98475 101033 qemu-aarch64-static 0.000001 CALL = pselect[522](0x6,0,0x7ffffffe3fb0,0,0,0x7ffffffe3d80) > 98475 101033 qemu-aarch64-static 0.000001 RET pselect[522] 1 > 98475 101033 qemu-aarch64-static 0.000001 CALL = sigprocmask[340](SIG_SETMASK,0x7ffffffe3c80,0) > 98475 101033 qemu-aarch64-static 0.000001 RET sigprocmask[340] 0 > 98475 101033 qemu-aarch64-static 0.000042 CALL = write[4](0x2,0x7ffffffe3480,0x20) > 98475 101033 qemu-aarch64-static 0.000036 GIO fd 2 wrote 32 bytes > "Unsupported ancillary data: 1/0 > " > 98475 101033 qemu-aarch64-static 0.000003 RET write[4] 32/0x20 > 98475 101033 qemu-aarch64-static 0.000001 CALL = sendmsg[28](0x5,0x7ffffffe3c28,0) > 98475 101033 qemu-aarch64-static 0.000003 RET sendmsg[28] -1 errno = 22 Invalid argument > 98475 101033 qemu-aarch64-static 0.000184 CALL close[6](0x3) > 98475 101033 qemu-aarch64-static 0.000040 RET close[6] 0 > 98475 101033 qemu-aarch64-static 0.000017 CALL close[6](0x7) > 98475 101033 qemu-aarch64-static 0.000005 RET close[6] 0 > 98475 101033 qemu-aarch64-static 0.000002 CALL = sigprocmask[340](SIG_BLOCK,0x7ffffffe3c80,0x7ffffffe3d80) > 98475 101033 qemu-aarch64-static 0.000001 RET sigprocmask[340] 0 > 98475 101033 qemu-aarch64-static 0.000001 CALL = pselect[522](0x6,0x7ffffffe3dd0,0,0,0,0x7ffffffe3d80) > 98475 101539 qemu-aarch64-static 0.000089 RET nanosleep[240] 0 > 98475 101539 qemu-aarch64-static 0.000042 CALL = _umtx_op[454](0x86101f008,UMTX_OP_WAIT_UINT_PRIVATE,0,0,0) > 98475 101033 qemu-aarch64-static 15.845396 RET pselect[522] -1 errno = 4 Interrupted system call >=20 > Note the qemu-aarch64 genrated message and the later: > sendmsg[28] -1 errno 22 Invalid argument >=20 > The qemu-*-static code that wrote the message is from > t2h_freebsd_cmsg and is: >=20 > if ((cmsg->cmsg_level =3D=3D TARGET_SOL_SOCKET) && > (cmsg->cmsg_type =3D=3D SCM_RIGHTS)) { > int *fd =3D (int *)data; > int *target_fd =3D (int *)target_data; > int i, numfds =3D len / sizeof(int); >=20 > for (i =3D 0; i < numfds; i++) { > fd[i] =3D tswap32(target_fd[i]); > } > } else if ((cmsg->cmsg_level =3D=3D TARGET_SOL_SOCKET) && > (cmsg->cmsg_type =3D=3D SCM_TIMESTAMP) && > (len =3D=3D sizeof(struct timeval))) { > /* copy struct timeval to host */ > struct timeval *tv =3D (struct timeval *)data; > struct target_freebsd_timeval *target_tv =3D > (struct target_freebsd_timeval *)target_data; > __get_user(tv->tv_sec, &target_tv->tv_sec); > __get_user(tv->tv_usec, &target_tv->tv_usec); > } else { > gemu_log("Unsupported ancillary data: %d/%d\n", > cmsg->cmsg_level, cmsg->cmsg_type); > memcpy(data, target_data, len); > } >=20 > Well it turns out that qemu_*-static 's code has: >=20 > struct target_cmsghdr { > abi_long cmsg_len; > int32_t cmsg_level; > int32_t cmsg_type; > }; >=20 > where for amd64 target_cmsghdr has: >=20 > (gdb) p/d sizeof(struct target_cmsghdr) > $2 =3D 16 > (gdb) p/d sizeof(((struct target_cmsghdr *)0)->cmsg_len)=20 > $5 =3D 8 > (gdb) p/d &((struct target_cmsghdr *)0)->cmsg_level > $4 =3D 8 > (gdb) p/d &((struct target_cmsghdr *)0)->cmsg_type=20 > $1 =3D 12 >=20 > which does not match the amd64 or aarch64 native: >=20 > struct cmsghdr { > socklen_t cmsg_len; /* data byte count, = including hdr */ > int cmsg_level; /* originating protocol = */ > int cmsg_type; /* protocol-specific = type */ > /* followed by u_char cmsg_data[]; */ > }; =20 >=20 > because the cmsghdr's cmsg_len is smaller, even on a 64-bit = architecture: >=20 > (gdb) p/d sizeof(((struct cmsghdr *)0)->cmsg_len) > $6 =3D 4 >=20 > /usr/include/arpa/inet.h:typedef __socklen_t socklen_t; > /usr/include/netinet/in.h:typedef __socklen_t socklen_t; > /usr/include/netinet6/in6.h:typedef __socklen_t socklen_t; > /usr/include/sys/_types.h:typedef __uint32_t __socklen_t; > /usr/include/sys/socket.h:typedef __socklen_t socklen_t; > . . . > /usr/include/netdb.h:typedef __socklen_t socklen_t; >=20 > so abi_long does not match socklen_t for 64-bit architectures. >=20 > So code such as in t2h_freebsd_cmsg: >=20 > cmsg->cmsg_level =3D tswap32(target_cmsg->cmsg_level); > cmsg->cmsg_type =3D tswap32(target_cmsg->cmsg_type); >=20 > is not using the correct target offsets when aarch64 is the target > that it is extracting from (for example). >=20 > For comparison on a 64-bit architecture: >=20 > (gdb) p/d sizeof(struct cmsghdr) > $1 =3D 12 > (gdb) p/d &((struct cmsghdr *)0)->cmsg_level > $2 =3D 4 > (gdb) p/d &((struct cmsghdr *)0)->cmsg_type=20 > $3 =3D 8 >=20 >=20 > I do not yet have a tested change. >=20 On aarch64 (like on amd64): # more cmsghdr_size_offsets.c=20 #include "/usr/include/sys/socket.h" // cmsghdr #include // offsetof #include // printf int main() { printf("%lu\n", (unsigned long) sizeof(struct cmsghdr)); printf("cmsg_len %lu\n", (unsigned long) offsetof(struct = cmsghdr, cmsg_len)); printf("cmsg_level %lu\n", (unsigned long) offsetof(struct = cmsghdr, cmsg_level)); printf("cmsg_type %lu\n", (unsigned long) offsetof(struct = cmsghdr, cmsg_type)); return 0; } produces: # ./a.out 12 cmsg_len 0 cmsg_level 4 cmsg_type 8 which qemu-aarch64-static 's target_cmsghdr definitely does not match. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Thu Jan 3 10:30:40 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CC29D142429E for ; Thu, 3 Jan 2019 10:30:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4C1176EC2F for ; Thu, 3 Jan 2019 10:30:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0FBE9142429D; Thu, 3 Jan 2019 10:30:40 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C8E31142429C for ; Thu, 3 Jan 2019 10:30:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 713D06EB31 for ; Thu, 3 Jan 2019 10:30:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 43CD016187; Thu, 3 Jan 2019 10:30:39 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 3FE1B16186 for ; Thu, 3 Jan 2019 10:30:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 071CA6EB2C for ; Thu, 3 Jan 2019 10:30:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 2F5081ED87 for ; Thu, 3 Jan 2019 10:30:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x03AUckI090236 for ; Thu, 3 Jan 2019 10:30:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x03AUcYD090234 for vbox@FreeBSD.org; Thu, 3 Jan 2019 10:30:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 234520] emulators/virtualbox-ose: NFS over bridged network adapter extremely slow; FreeBSD 12.0 Date: Thu, 03 Jan 2019 10:30:38 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 713D06EB31 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; NEURAL_HAM_SHORT(-0.99)[-0.990,0]; ASN(0.00)[asn:11403, ipnet:96.47.64.0/20, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Thu, 03 Jan 2019 11:33:40 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 10:30:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234520 --- Comment #2 from Martin Birgmeier --- It seems that also when the client is Linux, NFS performance is very poor. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Thu Jan 3 17:03:35 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5AAEA143058A for ; Thu, 3 Jan 2019 17:03:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id CD25C855D2 for ; Thu, 3 Jan 2019 17:03:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8E07C1430587; Thu, 3 Jan 2019 17:03:34 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B8D91430586 for ; Thu, 3 Jan 2019 17:03:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A0FC855CF for ; Thu, 3 Jan 2019 17:03:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 60F5727FE for ; Thu, 3 Jan 2019 17:03:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x03H3Xj3042529 for ; Thu, 3 Jan 2019 17:03:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x03H3XM6042528 for emulation@FreeBSD.org; Thu, 3 Jan 2019 17:03:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Thu, 03 Jan 2019 17:03:32 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sterum77@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ports-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter cc attachments.mimetype attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 03 Jan 2019 17:03:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 Bug ID: 234596 Summary: graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Product: Ports & Packages Version: Latest Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: Individual Port(s) Assignee: ports-bugs@FreeBSD.org Reporter: sterum77@gmail.com CC: emulation@FreeBSD.org, jmd@freebsd.org CC: emulation@FreeBSD.org, jmd@freebsd.org Attachment #200742 text/plain mime type: Created attachment 200742 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D200742&action= =3Dedit Output of the games I tried to run some Linux games with my AMD Radeon RX560 but they are all failing. I tried games/linux-doom3 and the Linux Version of Unreal. Both run fine wi= th NVIDA Hardware and the proprietary driver but with the AMD Hardware the scr= een goes black and then there are some messages on the console. I have tried with linux-c6 and linux-c7 ports. Perhaps the errors come from= the linux-mesa stuff because NVIDIA installs its own OpenGL stuff then this PR should go tho the maintainer of the emulators/linux_base ports. In the attachements are the outputs of linux-doom3 with linux_base-c6 and w= ith linux-c7 Also at the End of the file there is the output from Unreal on linux_base-c6 and linux_base-c7 Interesting is that linux-c6 tries to load the amdgpu_dri.so while linux-c7 tries to load radeonsi_dri.so. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 02:07:06 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 88244143EADC for ; Fri, 4 Jan 2019 02:07:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 228F173460 for ; Fri, 4 Jan 2019 02:07:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id D62D6143EAD9; Fri, 4 Jan 2019 02:07:05 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C2FC1143EAD8 for ; Fri, 4 Jan 2019 02:07:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5623E7345E for ; Fri, 4 Jan 2019 02:07:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 9518A78EE for ; Fri, 4 Jan 2019 02:07:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x04274p8032192 for ; Fri, 4 Jan 2019 02:07:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x04274qt032191 for emulation@FreeBSD.org; Fri, 4 Jan 2019 02:07:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Fri, 04 Jan 2019 02:07:04 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: jmd@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Rejected X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ports-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 02:07:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 Johannes M Dieterich changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |Rejected Status|New |Closed --- Comment #1 from Johannes M Dieterich --- If I recall correctly, we've seen this issue and there may be a fix for it. Could you open an issue with 'upstream' (as this is not a problem with the = port but the DRM itself)? Here: https://github.com/FreeBSDDesktop/kms-drm . Tha= nk you! --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 02:37:38 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71BB9143F7BA for ; Fri, 4 Jan 2019 02:37:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id F2682749C2 for ; Fri, 4 Jan 2019 02:37:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id ACB70143F7B7; Fri, 4 Jan 2019 02:37:37 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 97D93143F7B6 for ; Fri, 4 Jan 2019 02:37:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1D2D2749BE for ; Fri, 4 Jan 2019 02:37:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 505617D91 for ; Fri, 4 Jan 2019 02:37:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x042barH042703 for ; Fri, 4 Jan 2019 02:37:36 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x042baCH042698 for emulation@FreeBSD.org; Fri, 4 Jan 2019 02:37:36 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Fri, 04 Jan 2019 02:37:36 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: koobs@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Rejected X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jmd@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 02:37:38 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 Kubilay Kocak changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|ports-bugs@FreeBSD.org |jmd@freebsd.org --- Comment #2 from Kubilay Kocak --- Assign to committer (maintainer) that resolved --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 12:46:22 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E5540142A413 for ; Fri, 4 Jan 2019 12:46:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8059E8E5C2 for ; Fri, 4 Jan 2019 12:46:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 433D1142A410; Fri, 4 Jan 2019 12:46:21 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 317F1142A40F for ; Fri, 4 Jan 2019 12:46:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AF7648E5BF for ; Fri, 4 Jan 2019 12:46:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id CD4A9D86E for ; Fri, 4 Jan 2019 12:46:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x04CkJp5097948 for ; Fri, 4 Jan 2019 12:46:19 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x04CkJTe097943 for emulation@FreeBSD.org; Fri, 4 Jan 2019 12:46:19 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Fri, 04 Jan 2019 12:46:19 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pkubaj@anongoth.pl X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Rejected X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jmd@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 12:46:22 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 Piotr Kubaj changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pkubaj@anongoth.pl --- Comment #3 from Piotr Kubaj --- You could just use games/dhewm3. It's an open source reimplementation of Doom 3's engine with fixes for some issues that are not in the proprietary port. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 14:15:01 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 08C67142CBC7 for ; Fri, 4 Jan 2019 14:15:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 8E0BB6AD95 for ; Fri, 4 Jan 2019 14:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 519B2142CBC4; Fri, 4 Jan 2019 14:15:00 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13FC2142CBC3 for ; Fri, 4 Jan 2019 14:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AABA86AD90 for ; Fri, 4 Jan 2019 14:14:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 8124CB1A4; Fri, 4 Jan 2019 14:14:59 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 6429DB1A3 for ; Fri, 4 Jan 2019 14:14:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2BC286AD8E for ; Fri, 4 Jan 2019 14:14:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 69F11E5BA for ; Fri, 4 Jan 2019 14:14:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x04EEwaQ078269 for ; Fri, 4 Jan 2019 14:14:58 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x04EEwtM078266 for vbox@FreeBSD.org; Fri, 4 Jan 2019 14:14:58 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 232969] emulators/virtualbox-ose: link error while linking the RDP client Date: Fri, 04 Jan 2019 14:14:58 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: Trond.Endrestol@ximalas.info X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: AABA86AD90 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Fri, 04 Jan 2019 14:55:16 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 14:15:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D232969 --- Comment #17 from Trond.Endrestol@ximalas.info --- (In reply to Matthias Apitz from comment #14) Being back at $WORK, I created a VM running the 13.0-CURRENT snapshot from Boxing Day, r342541. Nothing fancy this time, only base on UFS. I did roughly this: mkdir -p /var/spool/workdirs [I edited /etc/make.conf adding WRKDIRPREFIX=3D/var/spool/workdirs] cd /usr svnlite co svn://svn.FQDN/freebsd/base/head src # I have an unofficial svn mirror at $WORK, base and ports resides in a (sub)directory called freebsd mkdir ports svnlite co svn://svn.FQDN/freebsd/ports/head ports cd ports/ports-mgmt/pkg make install [this also pulled in ports-mgmt/dialog4ports] cd ../dialog4ports make package [just to make sure I have a package of it for future reference] cd ../../emulators/virtualbox-ose make config-recursive [I could have defined BATCH, but I went ahead and accepted the defaults] make package && make install && make package-recursive [at some point graphics/mesa-libs complained about Python being 3.6, but wanting 2.7] pushd ../../lang/python make package && make install cd ../python2 make package && make install cd ../python3 make package && make install popd make package && make install && make package-recursive After 4 hours had passed, emulators/virtualbox-ose was not only compiled successfully, but also installed and ready to rock and/or roll. Q.E.D. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 19:03:08 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 50BB81435B57 for ; Fri, 4 Jan 2019 19:03:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id DCB0476D03 for ; Fri, 4 Jan 2019 19:03:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id A07F61435B56; Fri, 4 Jan 2019 19:03:07 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8F1281435B55 for ; Fri, 4 Jan 2019 19:03:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2D0BA76CFE for ; Fri, 4 Jan 2019 19:03:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 585E5110A1 for ; Fri, 4 Jan 2019 19:03:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x04J36AC058978 for ; Fri, 4 Jan 2019 19:03:06 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x04J36BH058977 for emulation@FreeBSD.org; Fri, 4 Jan 2019 19:03:06 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Fri, 04 Jan 2019 19:03:06 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: sterum77@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Rejected X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jmd@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 19:03:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 --- Comment #4 from Stefan Rumetshofer --- I know, dhewm runs fine with AMD Radeon. I reported this because there are (OpenGL-)Problems with Linux Programs. linux-doom3 was just an Example. (I have the Original DVD to test the game). linux-quake4 is'nt working too. As suggested above i will report an issue upstream. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Fri Jan 4 19:56:54 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C3F981437DAC for ; Fri, 4 Jan 2019 19:56:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 5232E8182E for ; Fri, 4 Jan 2019 19:56:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 0CCA61437DAB; Fri, 4 Jan 2019 19:56:54 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EE0CB1437DAA for ; Fri, 4 Jan 2019 19:56:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 88B148182A for ; Fri, 4 Jan 2019 19:56:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A477E11800 for ; Fri, 4 Jan 2019 19:56:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x04JuqOt063412 for ; Fri, 4 Jan 2019 19:56:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x04Juq2q063411 for emulation@FreeBSD.org; Fri, 4 Jan 2019 19:56:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: emulation@FreeBSD.org Subject: [Bug 234596] graphics/drm-kmod OpenGL emulators/linux_base-c6 games/linux-doom3 AMD Hardware not working with Linux binaries Date: Fri, 04 Jan 2019 19:56:52 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tijl@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Rejected X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: jmd@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Jan 2019 19:56:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D234596 Tijl Coosemans changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |tijl@FreeBSD.org --- Comment #5 from Tijl Coosemans --- Make sure you have linprocfs and linsysfs mounted. Also try running with "= env LIBGL_DRI3_DISABLE=3Dtrue linux-doom3". If linux-c6 tries to load amdgpu_d= ri.so it's probably too old for your graphics card and you'll have to use linux-c= 7. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-emulation@freebsd.org Sat Jan 5 03:06:37 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 56F9D1485BA9 for ; Sat, 5 Jan 2019 03:06:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-9.consmr.mail.gq1.yahoo.com (sonic316-9.consmr.mail.gq1.yahoo.com [98.137.69.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 69D0592B3E for ; Sat, 5 Jan 2019 03:06:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: ZBNYFxYVM1kY0H2XQ12iDf5aTKwoctGg1MU2oq0amRAF7vza70R671EdJMvISIF N6FMlQ5F7RqI9PVcoLTb9gbG4vMoT0t2gmlNx0GKQxB11_zc.osbvr3UdqC7akmdsIBz_g0tCTOI l.EuhErSb55eoLFE8zPfI8aRuAe61I1a6QUWqf1ZWICsqgdfOHdJIucAKnRr7s68J0v1YQ1pRhYl fz.V08ig_X4fwH1L6hu.7vhixFLU9eLuTQoBytZGWjonQBElwMG9JU82ryVb4oivke87HCgfhz6T LGI02ITPZ4e4IEPzPTk0zrqMSPIub86ayLAT8COzHqLjwZE2EnRdBjq61pncijrn8ulHVrOHbZKq tNRtWfKFQ9B9VU6Uf_Xje40Q_BmwDcdNDhB.lxlVH5wV7AOMrc.OX7OqZtkY1b0dNsxHUfEYEdD_ GFzxu1loJ3XDhQqMNEK270O.T6hvPkxcRSp.7H3WofdLgO.qOi7A8yT_0CcsHuHIXE6r4UrpoRig _PXy7GSaL9jisDNB0HKkFHHHyTXNRmFQXDwyYJUHslPCD_rgACObRnd_NskG2j1nQhiwFdS2iiSU fuAuWRKqAPkO_LAyeiOsVDmU9uVXC3KixXRDxq9BlLXLIJHZFqX7.8CxRDsexX0QGCykWnkbLAah eEamspl4ySRUk9Zk_SMs7VMMeo91sNRd4IrEE8tE1t4KkQjaCpT54XzENlrjpRXzeVv1wBqNsLov TdLgkjHcGBQhEhk8Z0XxmF3AM4_W7Vi.IVUjDIT1zRyRXnykOwhGNXD5MmdqxgfsU7V7UIlLmRv4 gyWsZsPJP0xC.e23ozJQ6n7YJ8_94uJmkqtv3OJpvpgIkdDzUm_XvKygYEDgkn_g3wm7g8TGRarB 7Qcaq.yXURs6lyGT_ex1ECURJWTf_KQawGwcRuvrLnbAWAA1xDJGFad.WdpymWoJ2Fc3_odribNm 3dwPIATZ5gJjsrU2R3Qh_XFloWPuO1xcl4V56JuDuZwWOqjgZ2_dWiGIKIlTgJAPhVYm5tDo5..K lrN_j3ZuRBwoCdQ79s.PapvjddC2Xn.eIKrpK_btrzJM6W.ZlIVixHGYmuMFFtJn1Xk2zrLZIS2e xiA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sat, 5 Jan 2019 03:06:34 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp420.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 52894f72f312c5ee1cbab0101d6ea204; Sat, 05 Jan 2019 03:06:33 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: qemu-x86_64-static has target_msghdr's msg_controllen field with the wrong size so its msg_flags is at the wrong offset and target_msghdr is too large Message-Id: <1A600189-EBEB-49A3-AAF0-C188D39286FE@yahoo.com> Date: Fri, 4 Jan 2019 19:06:32 -0800 Cc: Sean Bruno To: Kyle Evans , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 69D0592B3E X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.73 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.88)[-0.878,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.35)[ip: (-2.74), ipnet: 98.137.64.0/21(0.61), asn: 36647(0.49), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[33.69.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 03:06:37 -0000 [qemu-aarch64-static has the same problem but qemu-armv7-sstatic does = not. The context here is FreeBSD head -r341836 based and ports head -r488859 based.] Note: I assume that "struct target_msghdr" is meant to match the memory = layout of the target's native "struct msghdr". Otherwise the reported = differences below could be irrelevant. For amd64 and aarch64 the following code: printf("sizeof(struct msghdr) =3D %lu\n", (unsigned long) = sizeof(struct msghdr)); printf("msg_name %lu\n", (unsigned long) offsetof(struct msghdr, = msg_name)); printf("msg_namelen %lu\n", (unsigned long) offsetof(struct = msghdr, msg_namelen)); printf("msg_iov %lu\n", (unsigned long) offsetof(struct msghdr, = msg_iov)); printf("msg_iovlen %lu\n", (unsigned long) offsetof(struct = msghdr, msg_iovlen)); printf("msg_control %lu\n", (unsigned long) offsetof(struct = msghdr, msg_control)); printf("msg_controllen %lu\n", (unsigned long) offsetof(struct = msghdr, msg_controllen)); printf("msg_flags %lu\n", (unsigned long) offsetof(struct = msghdr, msg_flags)); produces: sizeof(struct msghdr) =3D 48 msg_name 0 msg_namelen 8 msg_iov 16 msg_iovlen 24 msg_control 32 msg_controllen 40 msg_flags 44 Note: msg_controllen was apparently 4 bytes wide on these 64-bit = architectures. However gdb reports for qemu-x86_64-static and qemu-aarch64-static: (gdb) p/d sizeof(struct target_msghdr) $1 =3D 56 (gdb) p/d &((struct target_msghdr *)0)->msg_name=20 $2 =3D 0 (gdb) p/d &((struct target_msghdr *)0)->msg_namelen $3 =3D 8 (gdb) p/d &((struct target_msghdr *)0)->msg_iov =20 $4 =3D 16 (gdb) p/d &((struct target_msghdr *)0)->msg_iovlen $5 =3D 24 (gdb) p/d &((struct target_msghdr *)0)->msg_control $6 =3D 32 (gdb) p/d &((struct target_msghdr *)0)->msg_controllen $7 =3D 40 (gdb) p/d &((struct target_msghdr *)0)->msg_flags =20 $8 =3D 48 Note the larger size (56 instead of 48) and that msg_controllen 's size puts msg_flags at the wrong offset. Notably for armv7, gdb's information for armv7 agrees with: sizeof(struct msghdr) =3D 28 msg_name 0 msg_namelen 4 msg_iov 8 msg_iovlen 12 msg_control 16 msg_controllen 20 msg_flags 24 Apparently msg_controllen should always be 4 bytes wide, even on 64-bit architectures instead of tracking the 64-bit vs. 32-bit status for the architecture. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Sat Jan 5 03:40:06 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BB38D1486CF7 for ; Sat, 5 Jan 2019 03:40:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-4.consmr.mail.bf2.yahoo.com (sonic307-4.consmr.mail.bf2.yahoo.com [74.6.134.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AD07193A83 for ; Sat, 5 Jan 2019 03:40:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: wsCSi_AVM1lH5G0laNpexMcIWfrTm5zzjwmcAPD.a0b6oK8s9W1OhBIWs6h_1Ph Ceg9aT2tQDkhde9i9O5IGuR8H0Au9asqOSqvEn28lTJFWWUA16vWnCfn_4KRhXz0irxkXdBMaVsC mmrYnZ9LlK_0z26nTsJqRgHslTcOTUDjen7WotJVCusjnUdPhTx6Bd41RqAs8vD2pZfLteWsjO5Q GJDqoy2RCWYGRDYWHqVC0X_nEocCRgYJZyJxXkQ_QEx5Bp3XDnXY7DK2xjPnbGROpB6j_fOw.T_J q_dpMvHtj.bVH60HJux18TUnGF5QZ8HjcBvCM9hNgRWb.A2aglZfXPo1Lozd9s1Q_6ZDOI8RGQol e60v5YiBdIqBRc_j5Wj1kShwH9hKJ5Q4FYATuslL4h8pltuOegFl2hfsylPtYOuqZPsMElRyrRcx 8EBfF80xjm4iTE5OPWjpRr.79po3XPpMVvsPEGpmUVfLu7aSbdhj7h9MTvZLFv7v2u.K0oO6BC1c yBDTZEwckGBLKkeAY0t2M0WW3M887ebXShFSLIuYaagpfGDrfMwszgOmExu4GpwG.HsQ2eU2sTZv d32lDfkMd0ck4C5ysb7uE_GLPJmNWkYoJol7RYoCq1XSdXGujjMiYOpdY322VrvdsmySKfmf.b6C EAtueOPpNUNqvtYGcAT5lj3AJsDY6OmASPja7kPFQol1_z50xA4CmjpzUR0WUJ194PLvSncCCf8W UO0XETF99Z3zOi1X_g7CtIA2b.hmxX4ZFn0J7IFSgZXblxAe391NCrHQaIDRKtWKPEhpWIVPG0vN 6Ln.IWfdzoAQtdh9unYSLkSxM26xIYuTHQA2gLNMZ.BPyPJwzzZNRpedQTws_6hCxpYWODvMzfPE _Ewo8e0f_GC_SpA.EZfoQ2Og57o4k2CfJJzRVTZtqGTaHzQKK80H8LUHYOZ14pdGLDbgvRY.fVYm nCOxaY.C6If1bY2y5Aye5Ij3kit02LmlZQzU.V4X0iQq1xt4eFNWnGtpTXxYWSztdpRWsyr3mefC 9usKS1CwK1Je1ZM9SXKg1x2BOrQFhmaYTaAAVbWhxjJLRMEeoiyFTHIR8PCn4sM0xEYThVef4yu8 GvHk9 Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.bf2.yahoo.com with HTTP; Sat, 5 Jan 2019 03:39:58 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp422.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 0c25ded08e83581e60d16ab4a68d0580; Sat, 05 Jan 2019 03:29:54 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: qemu-x86_64-static has target_freebsd_flock being too large (__packed use issue) Message-Id: <1139EAD0-FED3-428C-AA0E-00ABB8BD111D@yahoo.com> Date: Fri, 4 Jan 2019 19:29:51 -0800 Cc: Sean Bruno To: Kyle Evans , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: AD07193A83 X-Spamd-Bar: ++ X-Spamd-Result: default: False [2.59 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.90)[0.898,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.36)[ip: (4.24), ipnet: 74.6.128.0/21(1.47), asn: 26101(1.17), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.46)[0.464,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_SPAM_LONG(0.38)[0.375,0]; RCVD_IN_DNSWL_NONE(0.00)[43.134.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 03:40:06 -0000 [qemu-aarch64-static has the same problem but qemu-armv7-sstatic does = not. The context here is FreeBSD head -r341836 based and ports head -r488859 based.] Note: I assume that "struct target_freebsd_flock" is meant to match the = memory layout of the target's native "struct flock". Otherwise the reported = differences below could be irrelevant. For amd64 and aarch64 the following code: printf("sizeof(struct flock) =3D %lu\n", (unsigned long) = sizeof(struct flock)); printf("l_start %lu\n", (unsigned long) offsetof(struct flock, = l_start)); printf("l_len %lu\n", (unsigned long) offsetof(struct flock, = l_len)); printf("l_pid %lu\n", (unsigned long) offsetof(struct flock, = l_pid)); printf("l_type %lu\n", (unsigned long) offsetof(struct flock, = l_type)); printf("l_whence %lu\n", (unsigned long) offsetof(struct flock, = l_whence)); printf("l_sysid %lu\n", (unsigned long) offsetof(struct flock, = l_sysid)); =20 produces: sizeof(struct flock) =3D 32 l_start 0 l_len 8 l_pid 16 l_type 20 l_whence 22 l_sysid 24 However gdb reports for qemu-x86_64-static and qemu-aarch64-static and qemu-arm-static: (gdb) p/d sizeof(struct target_freebsd_flock) $10 =3D 28 (gdb) p/d &((struct target_freebsd_flock *)0)->l_start =20 $11 =3D 0 (gdb) p/d &((struct target_freebsd_flock *)0)->l_len =20 $12 =3D 8 (gdb) p/d &((struct target_freebsd_flock *)0)->l_pid $13 =3D 16 (gdb) p/d &((struct target_freebsd_flock *)0)->l_type $14 =3D 20 (gdb) p/d &((struct target_freebsd_flock *)0)->l_whence $15 =3D 22 (gdb) p/d &((struct target_freebsd_flock *)0)->l_sysid=20 $16 =3D 24 So only the overall size is different for this information. But: struct target_freebsd_flock { int64_t l_start; int64_t l_len; int32_t l_pid; int16_t l_type; int16_t l_whence; int32_t l_sysid; } QEMU_PACKED; with a potential packed vs. /usr/include/sys/fcntl.h : struct flock { off_t l_start; /* starting offset */ off_t l_len; /* len =3D 0 means until end of file */ pid_t l_pid; /* lock owner */ short l_type; /* lock type: read/write, etc. */ short l_whence; /* type of l_start */ int l_sysid; /* remote system id or zero for local */ }; with no potential __packed. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Sat Jan 5 04:51:52 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2902E148A12E for ; Sat, 5 Jan 2019 04:51:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic306-4.consmr.mail.bf2.yahoo.com (sonic306-4.consmr.mail.bf2.yahoo.com [74.6.132.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BB74F97563 for ; Sat, 5 Jan 2019 04:51:50 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 5EEnYjoVM1lcW0_6Vd0_vnRyjZ0A1GWnCp8cxHhvdqhMJosdb5gc5Z3xlqmyeh_ doNpfTebbEl9a_2V_1aV6FcAu4ndI8a49MnHO4ClnAWWCvIa6oMvQTs.oWlbxrRzBpzETG.32C.N vjpVsq4o7Qp9cf1HISuk.4DAtcSdunxf8PpIuCPPRIfhYBFvILEXkuagYpnu.uiVo.Em2ur8SbST kA3DBUBRkkg0VYG5oOLtD6AxcPLoD4ojNOdiYFL5UUODjnhQy1NInxrBypFerX163ZtPplyUshF_ 2J1_gwynOJSuCh8R1Tt8bQi8EmvDvIesH67xhRpfjIKbAOquLdQGpn.bzR.rUUAr5Pb0ga019wfB vKALVjpabQHgdC0GGkkR5lNiYEdZh5IuFeHr7Mh7OVkG9vepqsCCfj44Zn.qEelv_j6kTqbr7xY3 Xazw6wTEZB5FyusTQRGLa7xRqjubTsmgOPeh3YPguTWiYqTE1esxalFwBj6zn9W9Vc3dOHMsjNvJ iD2gF.iHS4hOZ4otcEzgCe9k2lae_h9SK0_rRxb_pD5f_0XWx.PlX4izaZJn0z6DvzdVYszrJjby eyHQfUANcDMO814d7dR4DptDfjxbX52_ZNrbzThtEbI7VxameJw8yZ4PbLpTJOfHp9tL6TWMKU.d yocXvTk8bD2MMiYXp08ssmZ_QWFh_.K.29HB4bQbdpqXMsKOXxhHsWfHrpBjAcjITHXF.fLG7Eqw I95yxI_X980.75YKqlxVHJCbanpFwi3a3QqN1XsE0Cu2_CE0dbUTM_dDUDjh4gyZ1h9r1dyFrfx_ 6_H14DQkLe6GE4mdsI1ZTX6RE8nqrgwV4KlU8pu88lNiYkoDdp_ZZ_dMefAEdzYpbCHXKa5n1wO1 bLNLDDs8WIQLxDA9wt3Ta.GpKz9I_iLiQurKlEXw.x.VOIx0Iq3xF5dV_8Bop2WeDSFeO0IK3qSc YJs5852GsYWrx9JGVnxnaVuxMnMLO_Ve55aZ753Rb4VXMfFTGDh0OstoW7.D4Ob__evkQrCcKHYn AQsXUyWT2Mm3Rx6RFJh7PX3ssQu4b4XyP4gVj5YPwsu0nQAUp5PtYdzTmkwUDx2gSkD_kWQnJiV0 .RBo5Cw-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic306.consmr.mail.bf2.yahoo.com with HTTP; Sat, 5 Jan 2019 04:51:49 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp425.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 5bf61e0d685139587818b98ba0a82985; Sat, 05 Jan 2019 04:51:48 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: qemu-x86_64-static has target_freebsd_flock being too small (__packed use issue) [subject correction: fixed to be "too small"] From: Mark Millard In-Reply-To: <1139EAD0-FED3-428C-AA0E-00ABB8BD111D@yahoo.com> Date: Fri, 4 Jan 2019 20:51:46 -0800 Cc: Sean Bruno Content-Transfer-Encoding: quoted-printable Message-Id: References: <1139EAD0-FED3-428C-AA0E-00ABB8BD111D@yahoo.com> To: Kyle Evans , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: BB74F97563 X-Spamd-Bar: + X-Spamd-Result: default: False [1.46 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_SPAM_SHORT(0.78)[0.780,0]; NEURAL_HAM_LONG(-0.32)[-0.321,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.31)[ip: (3.98), ipnet: 74.6.128.0/21(1.47), asn: 26101(1.17), country: US(-0.08)]; NEURAL_SPAM_MEDIUM(0.21)[0.207,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[43.132.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 04:51:52 -0000 [Just correcting the "larger" to be "smaller".] On 2019-Jan-4, at 19:29, Mark Millard wrote: [qemu-aarch64-static has the same problem but qemu-armv7-sstatic does = not. The context here is FreeBSD head -r341836 based and ports head -r488859 based.] Note: I assume that "struct target_freebsd_flock" is meant to match the = memory layout of the target's native "struct flock". Otherwise the reported = differences below could be irrelevant. For amd64 and aarch64 the following code: printf("sizeof(struct flock) =3D %lu\n", (unsigned long) = sizeof(struct flock)); printf("l_start %lu\n", (unsigned long) offsetof(struct flock, = l_start)); printf("l_len %lu\n", (unsigned long) offsetof(struct flock, = l_len)); printf("l_pid %lu\n", (unsigned long) offsetof(struct flock, = l_pid)); printf("l_type %lu\n", (unsigned long) offsetof(struct flock, = l_type)); printf("l_whence %lu\n", (unsigned long) offsetof(struct flock, = l_whence)); printf("l_sysid %lu\n", (unsigned long) offsetof(struct flock, = l_sysid)); produces: sizeof(struct flock) =3D 32 l_start 0 l_len 8 l_pid 16 l_type 20 l_whence 22 l_sysid 24 However gdb reports for qemu-x86_64-static and qemu-aarch64-static and qemu-arm-static: (gdb) p/d sizeof(struct target_freebsd_flock) $10 =3D 28 (gdb) p/d &((struct target_freebsd_flock *)0)->l_start =20 $11 =3D 0 (gdb) p/d &((struct target_freebsd_flock *)0)->l_len =20 $12 =3D 8 (gdb) p/d &((struct target_freebsd_flock *)0)->l_pid $13 =3D 16 (gdb) p/d &((struct target_freebsd_flock *)0)->l_type $14 =3D 20 (gdb) p/d &((struct target_freebsd_flock *)0)->l_whence $15 =3D 22 (gdb) p/d &((struct target_freebsd_flock *)0)->l_sysid=20 $16 =3D 24 So only the overall size is different for this information. But: struct target_freebsd_flock { int64_t l_start; int64_t l_len; int32_t l_pid; int16_t l_type; int16_t l_whence; int32_t l_sysid; } QEMU_PACKED; with a potential packed vs. /usr/include/sys/fcntl.h : struct flock { off_t l_start; /* starting offset */ off_t l_len; /* len =3D 0 means until end of file */ pid_t l_pid; /* lock owner */ short l_type; /* lock type: read/write, etc. */ short l_whence; /* type of l_start */ int l_sysid; /* remote system id or zero for local */ }; with no potential __packed. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Sat Jan 5 12:28:57 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BDBD51499D77 for ; Sat, 5 Jan 2019 12:28:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 3A5F38085C for ; Sat, 5 Jan 2019 12:28:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id ED4C91499D76; Sat, 5 Jan 2019 12:28:56 +0000 (UTC) Delivered-To: emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0E661499D75 for ; Sat, 5 Jan 2019 12:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 558F380855 for ; Sat, 5 Jan 2019 12:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by freefall.freebsd.org (Postfix) id 2EA911FAF9; Sat, 5 Jan 2019 12:28:56 +0000 (UTC) Delivered-To: vbox@localmail.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [96.47.72.80]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) (Client CN "mx1.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by freefall.freebsd.org (Postfix) with ESMTPS id 2B72B1FAF8 for ; Sat, 5 Jan 2019 12:28:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E87EA80852 for ; Sat, 5 Jan 2019 12:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 468551A845 for ; Sat, 5 Jan 2019 12:28:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x05CStr7058738 for ; Sat, 5 Jan 2019 12:28:55 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x05CStB0058737 for vbox@FreeBSD.org; Sat, 5 Jan 2019 12:28:55 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: vbox@FreeBSD.org Subject: [Bug 228219] emulators/virtualbox-ose: Stop linking programs statically and fix build with LibreSSL Date: Sat, 05 Jan 2019 12:28:55 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: needs-qa, patch X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: tobik@freebsd.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: Feedback Timeout X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: vbox@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-Rspamd-Queue-Id: 558F380855 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.99 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; ASN(0.00)[asn:11403, ipnet:2610:1c1:1::/48, country:US]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-Mailman-Approved-At: Sat, 05 Jan 2019 16:58:33 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 12:28:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D228219 Tobias Kortkamp changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |Feedback Timeout --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.= From owner-freebsd-emulation@freebsd.org Sat Jan 5 23:22:16 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 41D9E1426F91 for ; Sat, 5 Jan 2019 23:22:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-23.consmr.mail.gq1.yahoo.com (sonic303-23.consmr.mail.gq1.yahoo.com [98.137.64.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AC7E772AF8 for ; Sat, 5 Jan 2019 23:22:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: x_hhgiUVM1n7.8ORVUk.xGwm4Pi5FVhYB7JI1.m0NA5u9h9BMZU7Mj9qZoGcoIN dR4SjCZm7ZAOsZbG8aArzp7uY1fK6FzVUQxyGNrCFL0RVCvkyAn2Mc0U5AL1vSpJBmMBklieh90k aDtJwdI14PdVaA6tHDBuKswHyfrWLtzLdpYUYQPTzRBBowk61JYT63LK.CB2UkxOIaXaO584k9aj VYjgvhXfZodm9YGVjpBZ6ZHRuOtfpjDj2UaIdn.01M6xjAGGZGVoz9vTmxVw7FopWYCJbHKExQeX DV_BfFuhRzZeUQp0jiH3jl0oArvgE8sVKtU6BkmM3sph5L13tErVY1EPWQkU81T7qjpcwclzz6S5 ZUV50ohn7CT9OyMvvA7VkcyynvQdXMJ5XTbOn1p41..rRGrnnyk893gh82z5F7KpVbvKaeZxuAWd X08asRNc78UhnSONZaSdvIae_hUXgEl7nEQbsrLLwkBXs8w7l8l89R9fwvwGtF14lQJ2xK9A2Z9H X7.nnrz6TaQfniuBbCHr9sjR69IaSiJ6HLrPuy4vczuAKLR9SQZXGIo9kZIzk2wJThcMobHrhrub 921XO.bLnK.Ii1Dgzy2PLkpSVX.Rl31DZo02F4rL3hyaZjeyERvPZtYMPy1BM3xNT9LecqQtdKFS z0StWI67vcQBzLe6ZVdNbnDXeuEmdBVBVhZxRMElEIavFL3.9uujticdsiplNUpLBv9MbHIp4FgD XhwuD.YOBMsYfzzqEFZGEdASEN8CuAFB7E8JodHkDjcJNhDYoVY2oujESYmQUSGsfU0XE8tMCnld Tohf9rJv9vLYLge85WuUYS244754rCRDeYuOd.5bN8UM7_uN6vQ53fpq424SwRRvtmTEjCrbPQZp j8GOED0TumC50UzHL25OXHZgSIdNdgsGa1DyfqOX.N9w.ySxfnlRNnk.JbtlRN2amFY4o3y0sArN SzPiQYnewN6riKnVaZiXCwCa6olOcYYID_j0aDT9xYckwrHcurib8Ia66CCUJlBoVE4daRpe.5kH l6m23l3W9EvFMXY_fiLwSj8y3CU.pRc1g73sR.PgDNyW3YtHq.A8BhExZoNUBAn2Fgjxn02JZjKB a68c- Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Sat, 5 Jan 2019 23:22:05 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp402.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 27714f34376999a592f1bb6b408ac852; Sat, 05 Jan 2019 23:22:01 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: qemu-arm-static has target_sigframe missing sf_fvp field so target_sigframe is too small Message-Id: <693D6101-25B5-4D88-BD5F-1F8BD34AEA1D@yahoo.com> Date: Sat, 5 Jan 2019 15:22:00 -0800 Cc: Sean Bruno To: Kyle Evans , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: AC7E772AF8 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.69 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.77)[-0.772,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-0.40)[ip: (-3.03), ipnet: 98.137.64.0/21(0.60), asn: 36647(0.48), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[204.64.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 23:22:16 -0000 [The context here is FreeBSD head -r341836 based and ports head -r488859 = based.] Note: I assume that "struct target_sigframe" is meant to match the = memory layout of the target's native "struct sigframe". Otherwise the reported = differences below could be irrelevant. For armv7 (and likely armv6) the following code: printf("sizeof(struct sigframe) =3D %lu\n", (unsigned long) = sizeof(struct sigframe)); // arm: printf("sf_si %lu\n", (unsigned long) offsetof(struct sigframe, = sf_si)); printf("sf_uc %lu\n", (unsigned long) offsetof(struct sigframe, = sf_uc)); printf("sf_vfp %lu\n", (unsigned long) offsetof(struct sigframe, = sf_vfp)); produces: sizeof(struct sigframe) =3D 592 sf_si 0 sf_uc 64 sf_vfp 328 However gdb reports for qemu-arm-static (on amd64): (gdb) p/d sizeof(struct target_sigframe) $3 =3D 324 (gdb) p/d &((struct target_sigframe *)0)->sf_si $4 =3D 0 (gdb) p/d &((struct target_sigframe *)0)->sf_uc $5 =3D 64 (gdb) p/d &((struct target_sigframe *)0)->sf_vfp There is no member named sf_vfp. So the first two fields have matching offsets. But note: sf_vfp is at 328, after the size of target_sigframe (324). It looks like both contexts have 260 for the size of sf_uc so the difference is padding before sf_vfp . /usr/include/machine/frame.h has: struct sigframe { siginfo_t sf_si; /* actual saved siginfo */ ucontext_t sf_uc; /* actual saved ucontext */ mcontext_vfp_t sf_vfp; /* actual saved VFP context */ }; sf_vfp was added in -r315947 (2017-Mar-26) and is in 11.2 . = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/arm/target_arch_signal.h has: struct target_sigframe { target_siginfo_t sf_si; /* saved siginfo */ target_ucontext_t sf_uc; /* saved ucontext */ }; =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar) From owner-freebsd-emulation@freebsd.org Sat Jan 5 23:48:55 2019 Return-Path: Delivered-To: freebsd-emulation@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A0B8A1427CC6 for ; Sat, 5 Jan 2019 23:48:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CF35673B15 for ; Sat, 5 Jan 2019 23:48:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 440pLakVM1mwTNukkh8Z3zTk4n8ZbzYHbRWBi53CvaYoNBiPLvrdRyWxfygZvFW zDQ4CSAsjGdujTnrkS9QxF5qMDTXgc9sLWo_M6z4XwYBuVD3oiFTYfVaOSW0YLY3LaB27_jt2fGp qPDtJ9mE2KpSVXWSYg_seEq0j1snwTk5ddMYNvOn75DwFNT_f5d7zT_8NxA1ngYoNI3riwGQXDt4 WzhQ16SZGXHpsj.XlhGmJeH52j6bQr1SI8iiV357YzwFI7XQQwk_MFJ1EF0yHZAoRDwYbrQpt0Iu eZPAb.deK5cmJfAn2_gj74.ZOb1MAGlFdkSqH3LFjlyYTIoAjbokbJqqx_pPpUnxGG85.CLE_RGm VuuqaluYblFO.p80yiTWwfDT439V.t_e869IHoahlaVhqRmbm_8Nwh2ZWKLn3VonVWvHGfT3AZ6s KWodahIsu3h7WvRlydD1ANgrklJ3NPjV0bfLNCBLUcuyJvvVRtkNt5NIXj6FmBB2SqlxreEDmyRb lN6FSHF1l5GP889IDaImmtGqtCAlqI3N3_tX4RzVe.uRpWeHt0qIurJFJhGJ8cIGSJqQKGMoh8jO bp8zYQoHzey32.Dt69PK_.t8ER9Mf_UeDcQ95HimwkDDeVlNrydhVCWamhsEYxn5tCr.yK99Y8Ap zjjQg60Ywm0e0LwUTmbTCHc1s.c_DjhXyY8be4k5REFW3loowpY16fkUVbZ22PCeUuhikkp3N6sz R1Je6j2B1XAS46yFKgLR1AwhmX.HJvA3bIMbXaXpMRfu54LQcY7dsaQ8joazU1lxbyWfS1poPfwo yQNFoALydphA6k7Gf6pd1ChU9G3gnJotV7rcXVrukE_jNLmAgu.OKlvq.ulkJQnHiciAO9Lc3pZg S2T9Uq2WkWP7eFEhjCzefJxJxLpXnd_Uikyi63efnz7gFK3QNgWFfH3ZEd1fUwi1fA9FP0qS2FJc SN32RCqXekFitAdgeAmIa3rEO9hE_9viQUaCw8DbRT33.LEvYWyx9jNsg903k8XlyYHO6WGGMRtE RygYLm5tBMUptmVT0FQiPJRC0ITGIRKjRJjMnYmEjwC4G7sx_X2eny7d8e5qKIIpP2MFXVpUx7sv FBQ-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sat, 5 Jan 2019 23:48:47 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp402.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 00b4e2a428433f4617b80ddce139b2f3; Sat, 05 Jan 2019 23:48:47 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: qemu-arm-static has target_prpsinfo missing pr_pid field so target_prpsinfo is too small Message-Id: <5C2E8937-23A5-4899-B3CE-8468697D8923@yahoo.com> Date: Sat, 5 Jan 2019 15:48:46 -0800 Cc: Sean Bruno , freebsd-arm To: Kyle Evans , freebsd-emulation@freebsd.org, ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: CF35673B15 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.96 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.97)[-0.973,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(-1.48)[ip: (-8.39), ipnet: 98.137.64.0/21(0.60), asn: 36647(0.48), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.69.137.98.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 Jan 2019 23:48:55 -0000 [The context here is FreeBSD head -r341836 based and ports head -r488859 = based.] Note: I assume that "struct target_prpsinfo" is meant to match the = memory layout of the target's native "struct prpsinfo". Otherwise the reported = differences below could be irrelevant. Note: struct target_prpsinfo is in (for my context): = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/elfload.c For armv7 (and likely armv6) the following code: printf("sizeof(struct prpsinfo) =3D %lu\n", (unsigned long) = sizeof(struct prpsinfo)); printf("pr_version %lu\n", (unsigned long) offsetof(struct = prpsinfo, pr_version)); printf("pr_psinfosz %lu\n", (unsigned long) offsetof(struct = prpsinfo, pr_psinfosz)); printf("pr_fname %lu\n", (unsigned long) offsetof(struct = prpsinfo, pr_fname)); printf("pr_psargs %lu\n", (unsigned long) offsetof(struct = prpsinfo, pr_psargs)); printf("pr_pid %lu\n", (unsigned long) offsetof(struct prpsinfo, = pr_pid)); produces: sizeof(struct prpsinfo) =3D 112 pr_version 0 pr_psinfosz 4 pr_fname 8 pr_psargs 25 pr_pid 108 However gdb reports for qemu-arm-static (on amd64): (gdb) p/d sizeof(struct target_prpsinfo) $7 =3D 108 (gdb) p/d &((struct target_prpsinfo *)0)->pr_version $8 =3D 0 (gdb) p/d &((struct target_prpsinfo *)0)->pr_psinfosz $9 =3D 4 (gdb) p/d &((struct target_prpsinfo *)0)->pr_fname =20 $10 =3D 8 (gdb) p/d &((struct target_prpsinfo *)0)->pr_psargs $11 =3D 25 (gdb) p/d &((struct target_prpsinfo *)0)->pr_pid =20 There is no member named pr_pid. So the fields prior to pr_pid have matching offsets and there is no extra padding added before pr_pid for native armv7. /usr/include/sys/procinfo.h has: typedef struct prpsinfo { int pr_version; /* Version number of struct (1) */ size_t pr_psinfosz; /* sizeof(prpsinfo_t) (1) */ char pr_fname[PRFNAMESZ+1]; /* Command name, null terminated = (1) */ char pr_psargs[PRARGSZ+1]; /* Arguments, null terminated = (1) */ pid_t pr_pid; /* Process ID (1a) */ } prpsinfo_t; pr_pid was added in -r308009 (2016-oct-28) and is in 11.2 . = /wrkdirs/usr/ports/emulators/qemu-user-static/work/qemu-bsd-user-4ef7d07/b= sd-user/elfload.c has: typedef struct target_prpsinfo { int32_t pr_version; /* Version number of struct (1) */ abi_ulong pr_psinfosz; /* sizeof(prpsinfo_t) (1) */ char pr_fname[TARGET_PRFNAMESZ+1]; /* Command name + NULL (1) = */ char pr_psargs[TARGET_PRARGSZ+1]; /* Arguments + NULL (1) */ } target_prpsinfo_t; =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)