Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 9 Jan 2020 17:57:03 -0800
From:      Mark Millard <marklmi@yahoo.com>
To:        FreeBSD PowerPC ML <freebsd-ppc@freebsd.org>
Subject:   Re: head kyua testing of head -r356426 for a powerpc64 example [32-bit powerpc example added]
Message-ID:  <F88BF05C-B476-406B-A8A6-7E09347461B1@yahoo.com>
In-Reply-To: <CE8828D6-62AF-4068-A31C-4C19999146FE@yahoo.com>
References:  <CE8828D6-62AF-4068-A31C-4C19999146FE@yahoo.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On 2020-Jan-8, at 18:38, Mark Millard <marklmi at yahoo.com> wrote:

> [Note: The powerpc64 kernel build still has epair built in.
> (This used to be required to avoid a crash when epair was
> loaded.) So I'll need to build a kernel without that and
> retest. I do not expect the load failure and so expect
> the result to closely match the below.]
>=20
> This is based on a non-debug buildworld buildkernel
> that has some personal patches, mostly for powerpc64
> and powerpc for PowerMac related issues.
>=20
> There is just 1 tested context:
>=20
> powerpc64:      G5 with 2 sockets, 2 cores each:
>=20
> =3D=3D=3D> Summary
> Results read from =
/root/.kyua/store/results.usr_tests.20200108-191837-136845.db
> Test cases: 7749 total, 286 skipped, 39 expected failures, 115 broken, =
34 failed
> Total time: 3118.533s
>=20
> FYI, this G5 vs. CortexA53 Rock64: 3118.533s vs. 2911.617s .
> (So similar time frames.)
>=20
> =3D=3D=3D> Failed tests
> lib/libarchive/functional_test:test_read_format_lha_filename_UTF16  -> =
 failed: atf-check failed; see the output of the test for details  =
[13.338s]
> lib/libc/gen/posix_spawn/spawn_test:t_spawn_missing  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:112: =
expected error 2, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_nonexist  [0.011s]
> lib/libc/gen/posix_spawn/spawn_test:t_spawn_nonexec  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:132: =
expected error 2, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_nonexec  [0.011s]
> lib/libc/gen/posix_spawn/spawn_test:t_spawn_zero  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:92: =
expected error 8, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_zero  [0.012s]
> lib/libc/sys/brk_test:mlockfuture  ->  failed: =
/usr/src/lib/libc/tests/sys/brk_test.c:132: unexpected page flags 0  =
[0.011s]
> lib/libc/sys/getcontext_test:setcontext_link  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_getcontext.c:66: i !=3D ia  =
[0.011s]
> lib/libc/sys/mincore_test:mincore_resid  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:216: =
check_residency(addr, npgs) =3D=3D npgs not met  [0.013s]
> lib/libc/sys/mincore_test:mincore_shmseg  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:307: =
check_residency(addr, npgs) =3D=3D npgs not met  [0.013s]
> lib/msun/fe_round_test:fe_round  ->  failed: 22 checks failed; see =
output for more details  [0.011s]
> local/atf/atf-c++/pkg_config_test:build  ->  failed: atf-check failed; =
see the output of the test for details  [3.101s]
> local/kyua/integration/cmd_config_test:config_flag__explicit__bad_file =
 ->  failed: atf-check failed; see the output of the test for details  =
[0.087s]
> =
local/kyua/integration/cmd_config_test:config_flag__explicit__missing_file=
  ->  failed: atf-check failed; see the output of the test for details  =
[0.089s]
> sbin/ping/in_cksum_test:aligned_even_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:50: sum =3D=3D 0x5397 not met  =
[0.011s]
> sbin/ping/in_cksum_test:aligned_even_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:72: 21399  [0.011s]
> sbin/ping/in_cksum_test:aligned_odd_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:61: sum =3D=3D 0x52fd not met  =
[0.011s]
> sbin/ping/in_cksum_test:aligned_odd_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:83: sum =3D=3D 0xfd52 not met  =
[0.011s]
> sbin/ping/in_cksum_test:unaligned_even_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:94: sum =3D=3D 0x5397 not met  =
[0.011s]
> sbin/ping/in_cksum_test:unaligned_even_length_little_endian  ->  =
failed: /usr/src/sbin/ping/tests/in_cksum_test.c:116: 21399  [0.011s]
> sbin/ping/in_cksum_test:unaligned_odd_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:105: sum =3D=3D 0x52fd not met  =
[0.011s]
> sbin/ping/in_cksum_test:unaligned_odd_length_little_endian  ->  =
failed: /usr/src/sbin/ping/tests/in_cksum_test.c:127: sum =3D=3D 0xfd52 =
not met  [0.011s]
> sys/kern/ptrace_test:ptrace__PT_STEP_with_signal  ->  failed: =
/usr/src/tests/sys/kern/ptrace_test.c:3546: WSTOPSIG(status) =3D=3D =
SIGABRT not met  [0.014s]
> sys/netinet/so_reuseport_lb_test:basic_ipv4  ->  failed: =
/usr/src/tests/sys/netinet/so_reuseport_lb_test.c:165: bind() failed: =
Address already in use  [0.011s]
> sys/netinet/so_reuseport_lb_test:basic_ipv6  ->  failed: =
/usr/src/tests/sys/netinet/so_reuseport_lb_test.c:221: bind() failed: =
Address already in use  [0.011s]
> usr.bin/hexdump/hexdump_test:d_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.076s]
> usr.bin/hexdump/hexdump_test:o_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.076s]
> usr.bin/hexdump/hexdump_test:x_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.076s]
> usr.bin/indent/functional_test:nsac  ->  failed: atf-check failed; see =
the output of the test for details  [0.135s]
> usr.bin/indent/functional_test:sac  ->  failed: atf-check failed; see =
the output of the test for details  [0.135s]
> usr.sbin/fstyp/fstyp_test:ext2  ->  failed: atf-check failed; see the =
output of the test for details  [0.082s]
> usr.sbin/fstyp/fstyp_test:ext3  ->  failed: atf-check failed; see the =
output of the test for details  [0.082s]
> usr.sbin/fstyp/fstyp_test:ext4  ->  failed: atf-check failed; see the =
output of the test for details  [0.082s]
> usr.sbin/fstyp/fstyp_test:ext4_label  ->  failed: atf-check failed; =
see the output of the test for details  [0.085s]
> usr.sbin/fstyp/fstyp_test:ntfs  ->  failed: atf-check failed; see the =
output of the test for details  [0.137s]
> usr.sbin/fstyp/fstyp_test:ntfs_with_label  ->  failed: atf-check =
failed; see the output of the test for details  [0.137s]
>=20
> Ignoring sys/cddl/zfs/tests (all systems are ufs based, no zfs use) . =
. .
> (just got "broken: Test program did not exit cleanly" for zfs tests)
>=20
> =3D=3D=3D> Broken tests
> lib/libc/gen/makecontext_test:makecontext_arg1  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.393s]
> lib/libc/gen/makecontext_test:makecontext_arg2  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.317s]
> lib/libc/gen/makecontext_test:makecontext_arg3  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.327s]
> lib/libc/gen/makecontext_test:makecontext_arg4  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.317s]
> lib/libc/gen/makecontext_test:makecontext_arg5  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.507s]
> lib/libc/gen/makecontext_test:makecontext_arg6  ->  broken: Premature =
exit; test case received signal 11 (core dumped)  [2.317s]
> lib/msun/fenv_test:main  ->  broken: Received signal 6  [2.309s]
> lib/msun/invtrig_test:main  ->  broken: Received signal 6  [2.293s]
> lib/msun/lrint_test:main  ->  broken: Received signal 6  [1.975s]
> lib/msun/nan_test:main  ->  broken: Received signal 6  [2.030s]
> lib/msun/rem_test:main  ->  broken: Received signal 6  [2.079s]


This is based on a non-debug buildworld buildkernel
that has some personal patches, mostly for powerpc64
and powerpc for PowerMac related issues.

The below is based on adding one patch to the
kernel code to fix an an error in one routine
that had a failure mode that stood out: an
unbounded loop for page-aligned addresses.
With the patch for 32-bit powerpc, kyua ran to
completion.

32-bit powerpc:      G4 with 2 sockets, 1 core each:

=3D=3D=3D> Summary
Results read from =
/root/.kyua/store/results.usr_tests.20200109-233211-948925.db
Test cases: 7747 total, 293 skipped, 39 expected failures, 111 broken, =
41 failed
Total time: 4530.412s

(FYI: The CortexA7 OrangePi+2E armv7 example was ball-park
similar for how long it took for its run: 4202.342s . But it
failed 474 tests, as listed in its summary.)

=3D=3D=3D> Failed tests
lib/libarchive/functional_test:test_read_format_lha_filename_UTF16  ->  =
failed: atf-check failed; see the output of the test for details  =
[11.435s]
lib/libc/gen/posix_spawn/spawn_test:t_spawn_missing  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:112: =
expected error 2, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_nonexist  [0.016s]
lib/libc/gen/posix_spawn/spawn_test:t_spawn_nonexec  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:132: =
expected error 2, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_nonexec  [0.017s]
lib/libc/gen/posix_spawn/spawn_test:t_spawn_zero  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/gen/posix_spawn/t_spawn.c:92: =
expected error 8, got 0 when spawning =
/usr/tests/lib/libc/gen/posix_spawn/h_zero  [0.017s]
lib/libc/sys/brk_test:mlockfuture  ->  failed: =
/usr/src/lib/libc/tests/sys/brk_test.c:132: unexpected page flags 0  =
[0.016s]
lib/libc/sys/mincore_test:mincore_resid  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:216: =
check_residency(addr, npgs) =3D=3D npgs not met  [0.021s]
lib/libc/sys/mincore_test:mincore_shmseg  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:307: =
check_residency(addr, npgs) =3D=3D npgs not met  [0.019s]
lib/libc/sys/sigqueue_test:sigqueue_basic  ->  failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_sigqueue.c:88: sv.sival_int =
!=3D value  [0.015s]
lib/msun/fe_round_test:fe_round  ->  failed: 22 checks failed; see =
output for more details  [0.017s]
local/atf/atf-c++/pkg_config_test:build  ->  failed: atf-check failed; =
see the output of the test for details  [6.947s]
local/kyua/engine/requirements_test:check_reqs__required_memory__fail  =
->  failed: Line 424: '' does not match regexp 'Requires 100.00T =
.*memory'  [0.037s]
local/kyua/utils/memory_test:physical_memory  ->  failed: Line 53: =
memory < 100 * units::TB not met  [0.035s]
sbin/ping/in_cksum_test:aligned_even_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:50: sum =3D=3D 0x5397 not met  =
[0.015s]
sbin/ping/in_cksum_test:aligned_even_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:72: 21399  [0.016s]
sbin/ping/in_cksum_test:aligned_odd_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:61: sum =3D=3D 0x52fd not met  =
[0.015s]
sbin/ping/in_cksum_test:aligned_odd_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:83: sum =3D=3D 0xfd52 not met  =
[0.017s]
sbin/ping/in_cksum_test:unaligned_even_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:94: sum =3D=3D 0x5397 not met  =
[0.016s]
sbin/ping/in_cksum_test:unaligned_even_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:116: 21399  [0.016s]
sbin/ping/in_cksum_test:unaligned_odd_length_big_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:105: sum =3D=3D 0x52fd not met  =
[0.016s]
sbin/ping/in_cksum_test:unaligned_odd_length_little_endian  ->  failed: =
/usr/src/sbin/ping/tests/in_cksum_test.c:127: sum =3D=3D 0xfd52 not met  =
[0.015s]
sys/file/dup_test:main  ->  failed: 2 of 32 tests failed  [0.023s]
sys/kern/acct/acct_test:encode_tv_random_million  ->  failed: 2339 =
checks failed; see output for more details  [0.267s]
sys/kern/kern_copyin:kern_copyin  ->  failed: 3 checks failed; see =
output for more details  [0.018s]
sys/kern/ptrace_test:ptrace__PT_STEP_with_signal  ->  failed: =
/usr/src/tests/sys/kern/ptrace_test.c:3546: WSTOPSIG(status) =3D=3D =
SIGABRT not met  [0.021s]
usr.bin/hexdump/hexdump_test:d_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.125s]
usr.bin/hexdump/hexdump_test:o_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.142s]
usr.bin/hexdump/hexdump_test:x_flag  ->  failed: atf-check failed; see =
the output of the test for details  [0.125s]
usr.bin/xo/functional_test:xo_01__H  ->  failed: atf-check failed; see =
the output of the test for details  [0.284s]
usr.bin/xo/functional_test:xo_01__HIPx  ->  failed: atf-check failed; =
see the output of the test for details  [0.284s]
usr.bin/xo/functional_test:xo_01__HP  ->  failed: atf-check failed; see =
the output of the test for details  [0.461s]
usr.bin/xo/functional_test:xo_01__J  ->  failed: atf-check failed; see =
the output of the test for details  [0.643s]
usr.bin/xo/functional_test:xo_01__JP  ->  failed: atf-check failed; see =
the output of the test for details  [0.280s]
usr.bin/xo/functional_test:xo_01__T  ->  failed: atf-check failed; see =
the output of the test for details  [0.279s]
usr.bin/xo/functional_test:xo_01__X  ->  failed: atf-check failed; see =
the output of the test for details  [0.281s]
usr.bin/xo/functional_test:xo_01__XP  ->  failed: atf-check failed; see =
the output of the test for details  [0.282s]
usr.sbin/fstyp/fstyp_test:ext2  ->  failed: atf-check failed; see the =
output of the test for details  [0.128s]
usr.sbin/fstyp/fstyp_test:ext3  ->  failed: atf-check failed; see the =
output of the test for details  [0.130s]
usr.sbin/fstyp/fstyp_test:ext4  ->  failed: atf-check failed; see the =
output of the test for details  [0.133s]
usr.sbin/fstyp/fstyp_test:ext4_label  ->  failed: atf-check failed; see =
the output of the test for details  [0.134s]
usr.sbin/fstyp/fstyp_test:ntfs  ->  failed: atf-check failed; see the =
output of the test for details  [0.225s]
usr.sbin/fstyp/fstyp_test:ntfs_with_label  ->  failed: atf-check failed; =
see the output of the test for details  [0.241s]

Ignoring sys/cddl/zfs/tests (all systems are ufs based, no zfs use) . . =
.
(just got "broken: Test program did not exit cleanly" for zfs tests)

=3D=3D=3D> Broken tests
lib/msun/fenv_test:main  ->  broken: Received signal 6  [0.494s]
lib/msun/invtrig_test:main  ->  broken: Received signal 6  [0.546s]
lib/msun/lrint_test:main  ->  broken: Received signal 6  [0.510s]
lib/msun/nan_test:main  ->  broken: Received signal 6  [0.502s]
lib/msun/rem_test:main  ->  broken: Received signal 6  [0.548s]
sbin/growfs/legacy_test:main  ->  broken: TAP test program yielded =
invalid data: Load of '/tmp/kyua.BRsHMe/2573/stdout.txt' failed: =
Reported plan differs from actual executed tests  [0.510s]
sys/capsicum/capsicum-test:main  ->  broken: Received signal 6  =
[38.367s]



=3D=3D=3D
Mark Millard
marklmi at yahoo.com
( dsl-only.net went
away in early 2018-Mar)




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?F88BF05C-B476-406B-A8A6-7E09347461B1>