Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 5 May 2021 06:09:59 -0700
From:      Mark Millard <marklmi@yahoo.com>
To:        Ed Maste <emaste@freebsd.org>
Cc:        FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>, freebsd-current <freebsd-current@freebsd.org>
Subject:   Re: FYI: WITH_REPRODUCIBLE_BUILD= problem for some files? [aarch64 test did not reproduce the issue]
Message-ID:  <BD2F0EDC-9F3A-4D9C-89D5-A9A2DAC341F0@yahoo.com>
In-Reply-To: <D50F7EA6-D9FE-4D47-8333-A41B73CF48AE@yahoo.com>
References:  <35482701-95A3-48B2-9A8E-B7E0092119B1.ref@yahoo.com> <35482701-95A3-48B2-9A8E-B7E0092119B1@yahoo.com> <CAPyFy2DQRn1CeiF=yaF6NgpLZ1zU8psbV0xiz-DWiSUy=DM8NA@mail.gmail.com> <43F20589-A7C7-42FF-9020-09CEE037D1CD@yahoo.com> <91F820A1-8940-4246-A20A-E62685F50079@yahoo.com> <F5D8E009-E6E1-42DA-856C-A6D91DA74A40@yahoo.com> <CAPyFy2B0va3FVa0-HKp3MJaJG=h6yPb%2BNMnjCy4kxBdUF=DybQ@mail.gmail.com> <27B5086A-7C98-4AE6-885A-CC7C7BD2F64B@yahoo.com> <3FC6BCDD-5865-4B5D-8238-3EC38AD4E78C@yahoo.com> <E832E3F0-8771-4943-B923-B02E4EDCCB17@yahoo.com> <2E86A8E9-9F0E-446E-BF80-5FA3B8ECB197@yahoo.com> <BC07B500-D36D-44AC-93D8-D3962155AD89@yahoo.com> <D50F7EA6-D9FE-4D47-8333-A41B73CF48AE@yahoo.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2021-May-4, at 20:26, Mark Millard <marklmi at yahoo.com> wrote:

> On 2021-May-4, at 13:38, Mark Millard <marklmi at yahoo.com> wrote:
>=20
>> [The first buidlworld is still in process. So while waiting . . .]
>>=20
>> On 2021-May-4, at 10:31, Mark Millard <marklmi at yahoo.com> wrote:
>>=20
>>> I probably know why the huge count of differences this time
>>> unlike the original report . . .
>>>=20
>>> Previously I built based on a checked-in branch as part of
>>> my experimenting. This time it was in a -dirty form (not
>>> checked in), again as part of my experimental exploration.
>>>=20
>>> WITH_REPRODUCIBLE_BUILD=3D makes a distinction between these
>>> if I remember right: (partially?) disabling itself for
>>> -dirty style.
>>>=20
>>> To reproduce the original style of test I need to create
>>> a branch with my few patches checked in and do the
>>> buildworlds from that branch.
>>>=20
>>> This will, of course, take a while.
>>>=20
>>> Sorry for the noise.
>>>=20
>>=20
>> I've confirmed some of the details of the large number of
>> files with difference while waiting for the 1st buildworld :
>>=20
>> The 4 bytes at the end of the .gnu_debuglink section
>> that are ending up different are the checksum for the
>> .debug file. The .debug files have differences such as:
>>=20
>> =E2=94=82 -    <1a>   DW_AT_comp_dir    : (indirect string) =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/usr/13_0R-src/arm64.aarch64/lib=
/csu/aarch64
>> =E2=94=82 +    <1a>   DW_AT_comp_dir    : (indirect string) =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang/usr/13_0R-src/arm64.aarch64/lib/csu=
/aarch64
>>=20
>> So I need to build, snapshot (in case need
>> to reference), install, clean-out, build,
>> install elsewhere, compare. (Or analogous
>> that uses the same build base-path for both
>> installs despite separate buildworld's.)
>> This is separate from any potential -dirty
>> vs. checked-in handling variation by
>> WITH_REPRODUCIBLE_BUILD=3D .
>>=20
>> My process that produced the original armv7
>> report happened to do that before I accidentally
>> discovered the presence of the few files with
>> differences. My new experiments were different
>> and I'd not though of needing to vary the
>> procedure to get you the right evidence.
>>=20
>=20
> The two aarch64 test installs did not show any
> differences in a "diff -rq" . Ignoring *.meta
> files generated during the builds, the build
> directory tree snapshots showed just the
> differences:
>=20
> # diff -rq =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr | grep -v '\.meta' | more
> Files =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c and =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c differ
> Files =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk and =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk differ
>=20
> # diff -u =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c
> --- =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 =
13:45:14.463351000 -0700
> +++ =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/stand/ficl/softcore.c 2021-05-04 =
19:04:32.338203000 -0700
> @@ -4,7 +4,7 @@
> ** Words from CORE set written in FICL
> ** Author: John Sadler (john_sadler@alum.mit.edu)
> ** Created: 27 December 1997
> -** Last update: Tue May  4 13:45:14 PDT 2021
> +** Last update: Tue May  4 19:04:32 PDT 2021
> *******************************************************************/
> /*
> ** DO NOT EDIT THIS FILE -- it is generated by softwords/softcore.awk
>=20
> # diff -u =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk
> --- =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-0/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 =
10:55:26.030179000 -0700
> +++ =
/usr/obj/BUILDs/13_0R-CA72-nodbg-clang-alt/.zfs/snapshot/commited-style-1/=
usr/13_0R-src/arm64.aarch64/toolchain-metadata.mk 2021-05-04 =
16:14:24.513346000 -0700
> @@ -1,4 +1,4 @@
> -.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on =
Tue May  4 10:55:26 PDT 2021
> +.info Using cached toolchain metadata from build at CA72_4c8G_ZFS on =
Tue May  4 16:14:24 PDT 2021
> _LOADED_TOOLCHAIN_METADATA=3Dt
> COMPILER_VERSION=3D110001
> X_COMPILER_VERSION=3D110001
>=20
>=20
>=20
> I may run a 'target cortex-a7 (so: armv7) from aarch64' test
> next. That was the context for the original discovery and
> report.
>=20
>=20

The armv7 builds and installs get the same sort of diff
results as the aarch64 ones.

So it does not look like I can readily reproduce the
problem files that had differences.

Given the time it takes to run the experiments, I would
not expect to reproduce the problem on any given
timescale. I'll stop the reporting as I go along in
my activities --unless I end up with a repetition
of the problem.

=3D=3D=3D
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?BD2F0EDC-9F3A-4D9C-89D5-A9A2DAC341F0>