Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 24 Jun 2016 15:50:15 -0600
From:      Alan Somers <asomers@freebsd.org>
To:        Ian Lepore <ian@freebsd.org>
Cc:        "Conrad E. Meyer" <cem@freebsd.org>, Mark Millard <markmi@dsl-only.net>,  freebsd-arm <freebsd-arm@freebsd.org>, FreeBSD Current <freebsd-current@freebsd.org>
Subject:   Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists
Message-ID:  <CAOtMX2hSZn4g411_Mgp_TrKYF7neavbc1BDnfpsECsUDVPuudw@mail.gmail.com>
In-Reply-To: <1465862808.1188.129.camel@freebsd.org>
References:  <F86BEFBC-9A3D-48A5-A389-2C97267ADE37@dsl-only.net> <CAOtMX2geyMO1wk9r4iusQ8uS=07DQZWYKFnidY7kCtjjAckymg@mail.gmail.com> <CAG6CVpUWuC2ys0cpfRnfV91MPpNOFU4%2BfMLRLCLkESmm=Nohyw@mail.gmail.com> <1465862808.1188.129.camel@freebsd.org>

next in thread | previous in thread | raw e-mail | index | archive | help
>> > On Mon, Jun 13, 2016 at 11:29 AM, Mark Millard <markmi@dsl-only.net
>> > > wrote:
>> > > With the newly less strict alignment requirements "kyua test -k
>> > > /usr/tests/Kyuafile" runs to completion, unlike before.
>> > >
>> > > > ===> Summary
>> > > > Results read from /root/.kyua/store/results.usr_tests.20160613
>> > > > -080302-120731.db
>> > > > Test cases: 5694 total, 54 skipped, 21 expected failures, 24
>> > > > broken, 59 failed
>> > > > Total time: 8723.243s
>> > >
>> > >
>> > > I only list the one line summaries below. Then I list various
>> > > context details.
>> > >
>> > > > ===> Broken tests
>> > > > lib/msun/cexp_test:main  ->  broken: Received signal 6
>> > > >  [1.054s]
>> > > > lib/msun/ctrig_test:main  ->  broken: Received signal 6
>> > > >  [1.074s]
>> > > > lib/msun/exponential_test:main  ->  broken: Received signal 6
>> > > >  [1.045s]
>> > > > lib/msun/fenv_test:main  ->  broken: Received signal 6
>> > > >  [1.048s]
>> > > > lib/msun/fma_test:main  ->  broken: Received signal 6  [1.080s]
>> > > > lib/msun/invctrig_test:main  ->  broken: Received signal 6
>> > > >  [1.091s]
>> > > > lib/msun/invtrig_test:main  ->  broken: Received signal 6
>> > > >  [1.086s]
>> > > > lib/msun/logarithm_test:main  ->  broken: Received signal 6
>> > > >  [1.054s]
>> > > > lib/msun/lrint_test:main  ->  broken: Received signal 6
>> > > >  [1.069s]
>> > > > lib/msun/nearbyint_test:main  ->  broken: Received signal 6
>> > > >  [1.066s]
>> > > > lib/msun/rem_test:main  ->  broken: Received signal 6  [1.069s]
>> > > > lib/msun/trig_test:main  ->  broken: Received signal 6
>> > > >  [1.070s]
>> > > > sbin/growfs/legacy_test:main  ->  broken: Reported plan differs
>> > > > from actual executed tests  [0.459s]
>> > > > sys/geom/class/eli/integrity_copy_test:main  ->  broken: Test
>> > > > case timed out  [1200.082s]
>> > > > sys/geom/class/eli/integrity_hmac_test:main  ->  broken: Test
>> > > > case timed out  [600.138s]
>> > > > sys/geom/class/eli/onetime_a_test:main  ->  broken: Test case
>> > > > timed out  [600.044s]
>> > > > sys/sys/bitstring_test:bit_clear  ->  broken: Test case body
>> > > > timed out  [300.032s]
>> > > > sys/sys/bitstring_test:bit_count  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.080s]
>> > > > sys/sys/bitstring_test:bit_ffc  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.077s]
>> > > > sys/sys/bitstring_test:bit_ffc_at  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.081s]
>> > > > sys/sys/bitstring_test:bit_ffs  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.082s]
>> > > > sys/sys/bitstring_test:bit_ffs_at  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.077s]
>> > > > sys/sys/bitstring_test:bit_nclear  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.083s]
>> > > > sys/sys/bitstring_test:bit_nset  ->  broken: Premature exit;
>> > > > test case received signal 11 (core dumped)  [1.079s]
>> > >
>> > >
>> > > > ===> Failed tests
>> > > > lib/libc/c063/fstatat_test:fstatat_fd  ->  failed:
>> > > > /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74:
>> > > > memcmp(&st1, &st2, sizeof(st1)) == 0 not met  [0.
>> > > > 027s]
>> > > > lib/libc/nss/gethostby_test:getipnodebyname_getaddrinfo_ipv4
>> > > > ->  failed: /usr/src/lib/libc/tests/nss/gethostby_test.c:1335:
>> > > > run_tests(_hostlist_file, _snapshot
>> > > > _file, 2, TEST_GETHOSTBYNAME2_GETADDRINFO, 0) == 0 not met
>> > > >  [15.315s]
>> > > > lib/libc/ssp/ssp_test:fgets  ->  failed: Test case body
>> > > > returned a non-ok exit code, but this is not allowed  [0.153s]
>> > > > lib/libc/ssp/ssp_test:gets  ->  failed: Test case body returned
>> > > > a non-ok exit code, but this is not allowed  [0.158s]
>> > > > lib/libc/ssp/ssp_test:memcpy  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.148s]
>> > > > lib/libc/ssp/ssp_test:memmove  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:memset  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:read  ->  failed: Test case body returned
>> > > > a non-ok exit code, but this is not allowed  [0.154s]
>> > > > lib/libc/ssp/ssp_test:readlink  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.155s]
>> > > > lib/libc/ssp/ssp_test:snprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:sprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:stpcpy  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.149s]
>> > > > lib/libc/ssp/ssp_test:stpncpy  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:strcat  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:strcpy  ->  failed: atf-check failed; see
>> > > > the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:strncat  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.147s]
>> > > > lib/libc/ssp/ssp_test:strncpy  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.146s]
>> > > > lib/libc/ssp/ssp_test:vsnprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.150s]
>> > > > lib/libc/ssp/ssp_test:vsprintf  ->  failed: atf-check failed;
>> > > > see the output of the test for details  [0.148s]
>> > > > lib/libc/stdio/printbasic_test:int_within_limits  ->  failed:
>> > > > printf("%tu", (size_t)-1) ==> [18446744073709551615], expected
>> > > > [4294967295]<<NEWLINE>>  [0.030s]
>> > > > lib/libc/stdio/scanfloat_test:infinities_and_nans  ->  failed:
>> > > > /usr/src/lib/libc/tests/stdio/scanfloat_test.c:191:
>> > > > fetestexcept(FE_INVALID) == 0 not met  [0.031
>> > > > s]
>> > > > lib/libc/sys/mincore_test:mincore_resid  ->  failed:
>> > > > /usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:225:
>> > > > check_residency(addr, npgs) == 0 not met  [0.04
>> > > > 0s]
>> > > > lib/libc/sys/mincore_test:mincore_shmseg  ->  failed:
>> > > > /usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:298:
>> > > > check_residency(addr, npgs) == 0 not met  [0.0
>> > > > 29s]
>> > > > lib/libc/tls/tls_dynamic_test:t_tls_dynamic  ->  failed: 15
>> > > > checks failed; see output for more details  [0.035s]
>> > > > lib/libproc/proc_test:symbol_lookup  ->  failed:
>> > > > /usr/src/lib/libproc/tests/proc_test.c:116: state != PS_STOP:
>> > > > process has state 4  [0.177s]
>> > > > lib/libxo/functional_test:test_02__E  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.166s]
>> > > > lib/libxo/functional_test:test_02__H  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.168s]
>> > > > lib/libxo/functional_test:test_02__HIPx  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.170s]
>> > > > lib/libxo/functional_test:test_02__HP  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.164s]
>> > > > lib/libxo/functional_test:test_02__J  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.169s]
>> > > > lib/libxo/functional_test:test_02__JP  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.166s]
>> > > > lib/libxo/functional_test:test_02__T  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.168s]
>> > > > lib/libxo/functional_test:test_02__X  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.169s]
>> > > > lib/libxo/functional_test:test_02__XP  ->  failed: atf-check
>> > > > failed; see the output of the test for details  [0.168s]
>> > > > lib/msun/conj_test:main  ->  failed: 9 tests of 42 failed
>> > > >  [0.034s]
>> > > > lib/msun/ldexp_test:ldexp_denormal  ->  failed: 4 checks
>> > > > failed; see output for more details  [0.034s]
>> > > > local/kyua/model/metadata_test:override_all_with_set_string  ->
>> > > >   failed: Line 253: disk_space != md.required_disk_space()
>> > > > (16777216.00T != 2.00G)  [0.047s]
>> > > > local/kyua/testers/stacktrace_test:dump__cannot_find_gdb  ->
>> > > >  failed: testers/stacktrace_test.c:281:
>> > > > atf_utils_grep_file("execvp failed", "stacktrace") not met
>> > > >  [0.611s]
>> > > > local/kyua/testers/stacktrace_test:dump__gdb_fail  ->  failed:
>> > > > testers/stacktrace_test.c:294: atf_utils_grep_file("foo",
>> > > > "stacktrace") not met  [0.610s]
>> > > > local/kyua/testers/stacktrace_test:dump__gdb_times_out  ->
>> > > >  failed: testers/stacktrace_test.c:311:
>> > > > atf_utils_grep_file("foo", "stacktrace") not met  [0.614s]
>> > > > local/kyua/testers/stacktrace_test:dump__integration  ->
>> > > >  failed: testers/stacktrace_test.c:233:
>> > > > atf_utils_grep_file("#0", "stacktrace") not met  [0.613s]
>> > > > local/kyua/testers/stacktrace_test:dump__ok  ->  failed:
>> > > > testers/stacktrace_test.c:249: atf_utils_grep_file("frame 1",
>> > > > "stacktrace") not met  [0.614s]
>> > > > local/kyua/testers/stacktrace_test:find_core__found__long  ->
>> > > >  failed: Core dumped, but no candidates found  [0.606s]
>> > > > local/kyua/testers/stacktrace_test:find_core__found__short  ->
>> > > >  failed: Core dumped, but no candidates found  [0.603s]
>> > > > local/kyua/testers/tap_parser_test:try_parse_plan__insane  ->
>> > > >  failed: testers/tap_parser_test.c:135: 'too long' not matched
>> > > > in 'Plan line includes out of range
>> > > >  numbers'  [0.032s]
>> > > > sys/geom/class/eli/resize_test:main  ->  failed: 15 tests of 27
>> > > > failed  [1.292s]
>> > > > sys/kern/pipe/pipe_fstat_bug_test:main  ->  failed: Returned
>> > > > non-success exit status 1  [0.044s]
>> > > > usr.bin/lastcomm/legacy_test:main  ->  failed: 4 tests of 6
>> > > > failed  [0.151s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_bindip  ->  failed: 1
>> > > > checks failed; see output for more details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_bindip_rev  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_localhost_only  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.034s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_one_addr_on_each_subn
>> > > > et  ->  failed: 1 checks failed; see output for more details
>> > > >  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_one_addr_on_each_subn
>> > > > et_rev  ->  failed: 1 checks failed; see output for more
>> > > > details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_point2point  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_point2point_rev  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.033s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_recvdstaddr  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_recvdstaddr_rev  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.035s]
>> > > > usr.sbin/rpcbind/addrmerge_test:addrmerge_singlehomed  ->
>> > > >  failed: 1 checks failed; see output for more details  [0.032s]
>> > > > usr.sbin/sa/legacy_test:main  ->  failed: 12 tests of 13 failed
>> > > >   [0.340s]
>> > >
>> > >
>> > >

As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring
tests should all be fixed.  I opened PR 210329 for the
usr.bin/lastcomm test.  I haven't investigated the others.

-Alan



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOtMX2hSZn4g411_Mgp_TrKYF7neavbc1BDnfpsECsUDVPuudw>