From owner-freebsd-amd64@freebsd.org Sun Feb 19 02:18:54 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 27972CDBF95 for ; Sun, 19 Feb 2017 02:18:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 095051199 for ; Sun, 19 Feb 2017 02:18:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1J2IrwI070113 for ; Sun, 19 Feb 2017 02:18:53 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313783 sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Sun, 19 Feb 2017 02:18:54 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: rep_platform cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Feb 2017 02:18:54 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 Mark Millard changed: What |Removed |Added ---------------------------------------------------------------------------- Hardware|amd64 |arm64 CC| |freebsd-arm@FreeBSD.org --- Comment #5 from Mark Millard --- [Note: the kernels after -r313266 are messed up for at least PowerMac so-called "Quad-Core"s so the below is based on a -r313864 buildworld and a -r313266 buildkernel because I had to revert the kernel to about the last that would avoid randomly timed panics.] I did a buildworld of -r313864 for powerpc64 without having MALLOC_PRODUCTION defined and installed and booted with it in order to see if powerpc64 had the same sort of problem that aarch64 is having with jemalloc, in particular during self-hosted buildworld buildkernel activity (my test case). powerpc64 worked fine with no aborts. So. . . include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" seems to be aarch64 (arm64) specific in some way. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Sun Feb 19 02:23:53 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9BA7CDB364 for ; Sun, 19 Feb 2017 02:23:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9889215B9 for ; Sun, 19 Feb 2017 02:23:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1J2Nr5F071669 for ; Sun, 19 Feb 2017 02:23:53 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313864 for arm64: sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Sun, 19 Feb 2017 02:23:53 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: short_desc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Feb 2017 02:23:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 Mark Millard changed: What |Removed |Added ---------------------------------------------------------------------------- Summary|head (e.g.) -r313783 sh vs. |head (e.g.) -r313864 for |jemalloc asserts: |arm64: sh vs. jemalloc |include/jemalloc/internal/t |asserts: |sd.h:687: Failed assertion: |include/jemalloc/internal/t |"tsd_booted" |sd.h:687: Failed assertion: | |"tsd_booted" --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Sun Feb 19 02:35:33 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B69C7CDB899 for ; Sun, 19 Feb 2017 02:35:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A65C31F44 for ; Sun, 19 Feb 2017 02:35:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1J2ZXEp050693 for ; Sun, 19 Feb 2017 02:35:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217156] Kernel panic using Netmap with selected NIC queue Date: Sun, 19 Feb 2017 02:35:33 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Feb 2017 02:35:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217156 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-bugs@FreeBSD.org |freebsd-net@FreeBSD.org CC|freebsd-amd64@FreeBSD.org | --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Sun Feb 19 02:38:08 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7AFF7CDBAFB for ; Sun, 19 Feb 2017 02:38:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 6B05C1B7 for ; Sun, 19 Feb 2017 02:38:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1J2c8ps021339 for ; Sun, 19 Feb 2017 02:38:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217115] bsdiff stops with SIGBUS in some cases Date: Sun, 19 Feb 2017 02:38:08 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Feb 2017 02:38:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217115 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- CC|freebsd-amd64@FreeBSD.org | --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Sun Feb 19 22:23:08 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A4CB6CE515C for ; Sun, 19 Feb 2017 22:23:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9410ABEB for ; Sun, 19 Feb 2017 22:23:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1JMN8Tw081624 for ; Sun, 19 Feb 2017 22:23:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313864 for arm64: sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Sun, 19 Feb 2017 22:23:08 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Feb 2017 22:23:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 --- Comment #6 from Mark Millard --- See also bugzilla 217239 for another type of arm64 specific problem with jemalloc without MALLOC_PRODUCTION. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Thu Feb 23 21:59:31 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0FB5CEB8D9 for ; Thu, 23 Feb 2017 21:59:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9F11CDEF for ; Thu, 23 Feb 2017 21:59:31 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1NLxVrc063049 for ; Thu, 23 Feb 2017 21:59:31 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313864 for arm64: sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Thu, 23 Feb 2017 21:59:31 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2017 21:59:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 --- Comment #7 from Mark Millard --- The following describes a reproducible sequence in my context, unfortunately involving hours of buildworld activity. It fails every time that I have tried it and at the same places each time. I give a contrast to a working context as well. Context: doing buildworld buidlkernel on a pine64+ with 2 GiBytes of RAM. Multiple head revisions, most recently: # uname -apKU FreeBSD pine64 12.0-CURRENT FreeBSD 12.0-CURRENT r313999M arm64 aarch64 1200021 1200021 The pine64 is running what was a cross build that had MALLOC_PRODUCTION not defined. (Unlike my usual way of building.) Problem: sh core dumps via failing an assert. (script core dumps as well for other reasons for one stage but I'm focused on the earliest failures for now: sh failures.) The following happens when I buildworld buildkernel on the pine64+ using: WITH_CLANG=3D WITH_CLANG_IS_CC=3D WITH_CLANG_FULL=3D WITH_CLANG_EXTRAS=3D WITH_LLD=3D WITH_LLDB=3D but not when using: WITHOUT_CLANG=3D WITHOUT_CLANG_IS_CC=3D WITHOUT_CLANG_FULL=3D WITHOUT_CLANG_EXTRAS=3D WITHOUT_LLD=3D WITHOUT_LLDB=3D (The rest being the same, starting after using cleanworld in both cases.) But note that the first failures happen long after the those have built what they contribute to the _generic_libs stage. (I have not yet tried isolating subsets.) Similarly for the later 2nd stage: well after "everything" did its llvm related activity. I've tried the failing case under both: 2 GiBytes RAM + 3 GiBytes swap and: 2 GiBytes RAM + 6 GiBytes swap It made no difference and there have been no messages about running out of swap space or other forms of resource limitation based process killing or the like. >From sysutils/DTraceToolkit 's /usr/local/share/dtrace-toolkit/execsnoop : . . . 2017 Feb 22 16:37:02 0 61019 61018 make install DIRPRFX=3Dlib/libusb/= \0 2017 Feb 22 16:37:02 0 61020 61019 sh -e\0 2017 Feb 22 16:37:02 0 61021 61019 sh -e\0 2017 Feb 22 16:37:02 0 61022 61019 sh -e\0 2017 Feb 22 16:37:02 0 61023 61020 sh /usr/src/tools/install.sh -C -o root -g wheel -m 444 libusb.a /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61024 61021 sh /usr/src/tools/install.sh -o ro= ot -g wheel -m 444 /usr/src/lib/libusb/libusb-0.1.pc /usr/src/lib/libusb/libusb-1.0.pc /usr/src/lib/libusb/libusb-2.0.pc /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/libdata/pkgconfig/\0 2017 Feb 22 16:37:02 0 61025 61022 sh /usr/src/tools/install.sh -C -o root -g wheel -m 444 /usr/src/lib/libusb/libusb20.h /usr/src/lib/libusb/libusb20_desc.h /usr/src/lib/libusb/usb.h /usr/src/lib/libusb/libusb.h /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/include/\0 2017 Feb 22 16:37:02 0 61023 61020 sh /usr/src/tools/install.sh -C -o root -g wheel -m 444 libusb.a /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61023 61020 install -p libusb.a /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61024 61021 sh /usr/src/tools/install.sh -o ro= ot -g wheel -m 444 /usr/src/lib/libusb/libusb-0.1.pc /usr/src/lib/libusb/libusb-1.0.pc /usr/src/lib/libusb/libusb-2.0.pc /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/libdata/pkgconfig/\0 2017 Feb 22 16:37:02 0 61025 61022 sh /usr/src/tools/install.sh -C -o root -g wheel -m 444 /usr/src/lib/libusb/libusb20.h /usr/src/lib/libusb/libusb20_desc.h /usr/src/lib/libusb/usb.h /usr/src/lib/libusb/libusb.h /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/include/\0 2017 Feb 22 16:37:02 0 61024 61021 install -p /usr/src/lib/libusb/libusb-0.1.pc /usr/src/lib/libusb/libusb-1.0.pc /usr/src/lib/libusb/libusb-2.0.pc /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/libdata/pkgconfig/\0 2017 Feb 22 16:37:02 0 61025 61022 install -p /usr/src/lib/libusb/libusb20.h /usr/src/lib/libusb/libusb20_desc.h /usr/src/lib/libusb/usb.h /usr/src/lib/libusb/libusb.h /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/include/\0 2017 Feb 22 16:37:02 0 61026 61020 sh /usr/src/tools/install.sh -s -o root -g wheel -m 444 libusb.so.3 /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61026 61020 sh /usr/src/tools/install.sh -s -o root -g wheel -m 444 libusb.so.3 /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61026 61020 install -p libusb.so.3 /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/\0 2017 Feb 22 16:37:02 0 61027 61020 sh /usr/src/tools/install.sh -o ro= ot -g wheel -m 444 libusb.so.3.debug /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/debug/usr/lib/\0 2017 Feb 22 16:37:02 0 61027 61020 sh /usr/src/tools/install.sh -o ro= ot -g wheel -m 444 libusb.so.3.debug /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/debug/usr/lib/\0 2017 Feb 22 16:37:02 0 61027 61020 install -p libusb.so.3.debug /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/debug/usr/lib/\0 2017 Feb 22 16:37:02 0 61028 61020 sh /usr/src/tools/install.sh -l rs libusb.so.3 /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/libusb.= so\0 2017 Feb 22 16:37:02 0 61029 61028 ln -fsn libusb.so.3 /usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp/usr/lib/libusb.so\0 (That last was it for the build.) That is the end of the exec activity for the _generic_libs part of the build (and since the build stops: the last for the build overall). (The below ps -daux output is from some time before the problem happened but with later, related core files listed as well.) root 91353 0.0 0.1 6856 1500 u0 I+ 10:28 0:00.02 `-- /bi= n/sh /root/sys_build_scripts.pine64-host/make_pine64_nodebug_clang_bootstrap-pin= e64-host.sh -j 4 buildworld buildkernel root 91356 0.0 0.1 6204 1560 u0 S+ 10:28 0:06.59 `-- script /root/sys_typescripts/typescript_make_pine64_nodebug_clang_bootstrap-pine64= -host-2017-02-22:10:28:28 env __MAKE_CONF=3D/ -rw------- 1 root wheel 4657152 Feb 22 16:37:04 2017 script.91356.core (from: ls -ltTU) root 91357 0.0 0.0 4948 204 1 Ss+ 10:28 0:01.87 `-- make -j 4 buildworld buildkernel root 91373 0.0 0.1 6856 1500 1 I 10:28 0:00.01 `= -- sh -ev -rw------- 1 root wheel 4702208 Feb 22 16:37:03 2017 sh.91373.core (from: ls -ltTU) root 91374 0.0 0.0 4948 204 1 S 10:28 0:01.69 = `-- make -m /usr/src/share/mk -f Makefile.inc1 TARGET=3Darm64 TARGET_ARCH=3Daar= ch64 buildworld root 10803 0.0 0.1 6856 1500 1 I 10:43 0:00.01=20=20=20=20= =20=20=20=20=20=20=20=20=20=20 `-- sh -ev -rw------- 1 root wheel 4702208 Feb 22 16:37:02 2017 sh.10803.core (from: ls -ltTU) root 10804 0.0 0.0 4948 200 1 S 10:43 3:00.18=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 `-- make -f Makefile.inc1 DESTDIR=3D/usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp -DNO_FSCHG MK_HTM= L=3Dno -DNO_LINT MK_MA root 10811 0.0 0.1 6856 1500 1 I 10:43 0:00.01=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 `-- sh -ev root 38075 0.0 0.0 4948 204 1 S 11:14 0:00.75=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 `-- make -f Makefile.inc1 _generic_libs root 38085 0.0 0.1 6856 1500 1 I 11:14 0:00.01=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 `-- sh -ev . . . "shutdown -r now" here makes no difference to the below when done after the reboot. (Of course there is some llvm related build activity during the "everything" stage below.) Doing another buildworld buildkernel to continue the build results in: . . . 2017 Feb 22 18:48:46 0 51772 51454 sh -e\0 2017 Feb 22 18:48:46 0 51773 51772 sed -E s,(^| |B|`)svn,\\1svnlite,g /usr/src/contrib/subversion/subversion/svn/svn.1\0 2017 Feb 22 18:48:46 0 51774 51454 sh -e\0 2017 Feb 22 18:48:46 0 51775 51774 gzip -cn svnlite.1\0 2017 Feb 22 18:48:48 0 51776 51454 sh -e\0 2017 Feb 22 18:48:48 0 51777 51776 \0 2017 Feb 22 18:48:48 0 51778 51777 \0 2017 Feb 22 18:48:49 0 51779 51454 sh -e\0 2017 Feb 22 18:48:49 0 51780 51779 /usr/local/aarch64-freebsd/bin/obj= copy --only-keep-debug svnlite.full svnlite.debug\0 2017 Feb 22 18:48:50 0 51781 51454 sh -e\0 2017 Feb 22 18:48:50 0 51782 51781 /usr/local/aarch64-freebsd/bin/obj= copy --strip-debug --add-gnu-debuglink=3Dsvnlite.debug svnlite.full svnlite\0 The above is the end of the "everything" exec activity but before the buildworld_epilogue (that does not happen). Again it is the last exec activity for the build because the build stops. (Again ps -daux from sometime before the failure mixed with core file ls -ltTU information below:) root 61122 0.0 0.1 6856 1500 u0 I+ 17:13 0:00.01 `-- /bin/sh /root/sys_build_scripts.pine64-host/make_pine64_nodebug_clang_bootstrap-pin= e64-host.sh -j 4 buildworld buildkernel root 61125 0.0 0.1 6204 1560 u0 S+ 17:13 0:09.56 `-- script /root/sys_typescripts/typescript_make_pine64_nodebug_clang_bootstrap-pine64= -host-2017-02-22:17:13:45 env __MAKE_CONF=3D root 61126 0.0 0.0 4948 204 1 Ss+ 17:13 0:02.36 `-- make -j 4 buildworld buildkernel root 61142 0.0 0.1 6856 1500 1 I 17:13 0:00.01 = `-- sh -ev -rw------- 1 root wheel 4702208 Feb 22 18:48:51 2017 sh.61142.core root 61143 0.0 0.0 4948 204 1 S 17:13 0:02.08=20=20=20= =20=20=20=20=20=20=20=20=20 `-- make -m /usr/src/share/mk -f Makefile.inc1 TARGET=3Darm64 TARGET_ARCH= =3Daarch64 buildworld root 81104 0.0 0.1 6856 1500 1 I 17:19 0:00.01=20=20=20= =20=20=20=20=20=20=20=20=20=20=20 `-- sh -ev -rw------- 1 root wheel 4702208 Feb 22 18:48:50 2017 sh.81104.core root 81105 0.0 0.0 4948 220 1 S 17:19 0:02.57=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 `-- make -f Makefile.inc1 DESTDIR=3D/usr/obj/pine64_clang/arm64.aarch64/usr/src/tmp all root 13358 0.0 0.1 6856 1500 1 I 17:49 0:00.01=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20 |-- sh -e . . . (Yep: script does not core dump for this 2nd stage context.) A 3rd buildworld buildkernel finishes the build, with buildworld being essentially a large no-op and then doing the buildkernel. Context details: # more ~/src.configs/make.conf CFLAGS.gcc+=3D -v (But this was not a gcc based build.) # more ~/src.configs/src.conf.pine64-clang-bootstrap.pine64-host=20 TO_TYPE=3Daarch64 TOOLS_TO_TYPE=3D${TO_TYPE} # KERNCONF=3DGENERIC-NODBG TARGET=3Darm64 .if ${.MAKE.LEVEL} =3D=3D 0 TARGET_ARCH=3D${TO_TYPE} .export TARGET_ARCH .endif # #WITH_CROSS_COMPILER=3D WITH_SYSTEM_COMPILER=3D # #CPUTYPE=3Dsoft WITH_LIBCPLUSPLUS=3D WITHOUT_BINUTILS_BOOTSTRAP=3D WITHOUT_ELFTOOLCHAIN_BOOTSTRAP=3D #WITHOUT_CLANG_BOOTSTRAP=3D WITH_CLANG=3D WITH_CLANG_IS_CC=3D WITH_CLANG_FULL=3D WITH_CLANG_EXTRAS=3D WITH_LLD=3D WITH_LLDB=3D # WITH_BOOT=3D WITHOUT_LIB32=3D WITHOUT_LIBSOFT=3D # WITHOUT_GCC_BOOTSTRAP=3D WITHOUT_GCC=3D WITHOUT_GCC_IS_CC=3D WITHOUT_GNUCXX=3D # NO_WERROR=3D #WERROR=3D MALLOC_PRODUCTION=3D # WITH_REPRODUCIBLE_BUILD=3D WITH_DEBUG_FILES=3D # CROSS_BINUTILS_PREFIX=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/ AS=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/as AR=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/ar LD=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/ld NM=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/nm OBJCOPY=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/objcopy OBJDUMP=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/objdump RANLIB=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/ranlib SIZE=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/size STRINGS=3D/usr/local/${TOOLS_TO_TYPE}-freebsd/bin/strings .export AS .export AR .export LD .export NM .export OBJCOPY .export OBJDUMP .export RANLIB .export SIZE .export STRINGS # svnlite status /usr/src/ | sort ? /usr/src/sys/amd64/conf/GENERIC-DBG ? /usr/src/sys/amd64/conf/GENERIC-NODBG ? /usr/src/sys/arm/conf/BPIM3-DBG ? /usr/src/sys/arm/conf/BPIM3-NODBG ? /usr/src/sys/arm/conf/RPI2-DBG ? /usr/src/sys/arm/conf/RPI2-NODBG ? /usr/src/sys/arm64/conf/GENERIC-DBG ? /usr/src/sys/arm64/conf/GENERIC-NODBG ? /usr/src/sys/powerpc/conf/GENERIC64vtsc-DBG ? /usr/src/sys/powerpc/conf/GENERIC64vtsc-NODBG ? /usr/src/sys/powerpc/conf/GENERICvtsc-DBG ? /usr/src/sys/powerpc/conf/GENERICvtsc-NODBG M /usr/src/bin/sh/jobs.c M /usr/src/bin/sh/miscbltin.c M /usr/src/contrib/llvm/lib/Target/PowerPC/PPCInstrInfo.td M /usr/src/contrib/llvm/tools/lld/ELF/Target.cpp M /usr/src/lib/csu/powerpc64/Makefile M /usr/src/libexec/rtld-elf/Makefile M /usr/src/sys/arm/arm/gic.c M /usr/src/sys/boot/ofw/Makefile.inc M /usr/src/sys/boot/powerpc/Makefile.inc M /usr/src/sys/boot/powerpc/kboot/Makefile M /usr/src/sys/boot/uboot/Makefile.inc M /usr/src/sys/conf/Makefile.powerpc M /usr/src/sys/conf/kmod.mk M /usr/src/sys/ddb/db_main.c M /usr/src/sys/ddb/db_script.c M /usr/src/sys/powerpc/ofw/ofw_machdep.c The . . ./conf/*-*DBG files include the standard files and then make adjustments to have a production style kernel build, including the arm64 case. Below the first two files are as they were used to isolate forks' original lack of preserving the sp value for the child process side when interrupts happen. (Since fixed in head but not in stable/11 last I looked.) # svnlite diff /usr/src/bin/sh/jobs.c /usr/src/bin/sh/miscbltin.c /usr/src/sys/arm/arm/gic.c Index: /usr/src/bin/sh/jobs.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/src/bin/sh/jobs.c (revision 313999) +++ /usr/src/bin/sh/jobs.c (working copy) @@ -51,6 +51,9 @@ #include #include +/* JUST FOR TESTING */ +#include + #include "shell.h" #if JOBS #include @@ -833,6 +836,13 @@ * in a pipeline). */ +extern uintptr_t example_stack_address(void); + +uintptr_t stack_address_before_fork =3D 0; +uintptr_t stack_address_after_fork =3D 0; + +pid_t pid_from_fork =3D -1; + pid_t forkshell(struct job *jp, union node *n, int mode) { @@ -845,7 +855,10 @@ if (mode =3D=3D FORK_BG && (jp =3D=3D NULL || jp->nprocs =3D=3D 0)) checkzombies(); flushall(); - pid =3D fork(); + stack_address_before_fork =3D example_stack_address(); + pid_from_fork =3D pid =3D fork(); + stack_address_after_fork =3D example_stack_address(); + if (stack_address_after_fork !=3D stack_address_before_fork) abort(= ); if (pid =3D=3D -1) { TRACE(("Fork failed, errno=3D%d\n", errno)); INTON; @@ -946,7 +959,6 @@ return pid; } - pid_t vforkexecshell(struct job *jp, char **argv, char **envp, const char *path,= int idx, int pip[2]) { Index: /usr/src/bin/sh/miscbltin.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/src/bin/sh/miscbltin.c (revision 313999) +++ /usr/src/bin/sh/miscbltin.c (working copy) @@ -64,6 +64,15 @@ #undef eflag + +/* JUST FOR TESTING */ +uintptr_t example_stack_address(void) +{ + volatile uintptr_t test =3D 0; + return (uintptr_t)(void*)&test; +} + + int readcmd(int, char **); int umaskcmd(int, char **); int ulimitcmd(int, char **); Index: /usr/src/sys/arm/arm/gic.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D --- /usr/src/sys/arm/arm/gic.c (revision 313999) +++ /usr/src/sys/arm/arm/gic.c (working copy) @@ -672,9 +672,13 @@ if (irq >=3D sc->nirqs) { #ifdef GIC_DEBUG_SPURIOUS +#define EXPECTED_SPURIOUS_IRQ 1023 + if (irq !=3D EXPECTED_SPURIOUS_IRQ) { device_printf(sc->gic_dev, - "Spurious interrupt detected: last irq: %d on CPU%d\n", + "Spurious interrupt %d detected of %d: last irq: %d on CPU%d\n", + irq, sc->nirqs, sc->last_irq[PCPU_GET(cpuid)], PCPU_GET(cpuid)); + } #endif return (FILTER_HANDLED); } @@ -720,6 +724,16 @@ if (irq < sc->nirqs) goto dispatch_irq; + if (irq !=3D EXPECTED_SPURIOUS_IRQ) { +#undef EXPECTED_SPURIOUS_IRQ +#ifdef GIC_DEBUG_SPURIOUS + device_printf(sc->gic_dev, + "Spurious end interrupt %d detected of %d: last irq: %d= on CPU%d\n", + irq, sc->nirqs, + sc->last_irq[PCPU_GET(cpuid)], PCPU_GET(cpuid)); +#endif + } + return (FILTER_HANDLED); } The gic.c change just avoids getting uninteresting spurious interrupt messages on the console. Other changes are generally tied to my powerpc64 and powerpc investigations. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Fri Feb 24 03:22:21 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 545CFCEAAF6 for ; Fri, 24 Feb 2017 03:22:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3C9A9F62 for ; Fri, 24 Feb 2017 03:22:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1O3MKIF079830 for ; Fri, 24 Feb 2017 03:22:21 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313864 for arm64: sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Fri, 24 Feb 2017 03:22:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 03:22:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 --- Comment #8 from Mark Millard --- (In reply to Mark Millard from comment #7) I should have explicitly mentioned that the processes that get the failures were created and initialized long before the clang/llvm related parts of the build occur, even though the failures occur after some of the potential clang/llvm build activity. --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-amd64@freebsd.org Fri Feb 24 03:35:21 2017 Return-Path: Delivered-To: freebsd-amd64@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 76285CEAEBF for ; Fri, 24 Feb 2017 03:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5779414D1 for ; Fri, 24 Feb 2017 03:35:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1O3ZLkk097006 for ; Fri, 24 Feb 2017 03:35:21 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 217138] head (e.g.) -r313864 for arm64: sh vs. jemalloc asserts: include/jemalloc/internal/tsd.h:687: Failed assertion: "tsd_booted" Date: Fri, 24 Feb 2017 03:35:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markmi@dsl-only.net X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 03:35:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D217138 --- Comment #9 from Mark Millard --- (In reply to Mark Millard from comment #8) A note on script failures: I'll note that the script failures are part of the activity reported in bugzilla 217239, where for script the failures look in some respects like the powerd and su failures reported there: they are not td_booted asserts like reported here. Still there might be a common cause since the script failures are repeatable as reported here in 217138. --=20 You are receiving this mail because: You are on the CC list for the bug.=