Date: Tue, 9 Sep 2014 11:17:17 -0600 From: Alan Somers <asomers@freebsd.org> To: Garrett Cooper <yaneurabeya@gmail.com> Cc: FreeBSD CURRENT <freebsd-current@freebsd.org>, Allan Jude <allanjude@freebsd.org> Subject: Re: Need help fixing tests in CURRENT Message-ID: <CAOtMX2gGYnh_yV-hNsYJC3bJRxeFKqjqctzN-z3rn-2UgBUy9g@mail.gmail.com> In-Reply-To: <0D9BBC19-3139-4E66-B9E3-263ACB1C056B@gmail.com> References: <CAG=rPVd_On9HnPBcr8Hv_kBT1ekQ7kZViB0tOYQJqT-N=m%2BWMg@mail.gmail.com> <540F34B1.7040103@freebsd.org> <0D9BBC19-3139-4E66-B9E3-263ACB1C056B@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Sep 9, 2014 at 11:13 AM, <yaneurabeya@gmail.com> wrote: > On Sep 9, 2014, at 10:11, Allan Jude <allanjude@freebsd.org> wrote: > >> On 2014-09-09 13:05, Craig Rodrigues wrote: >>> Hi, >>> >>> I did a buildworld/installworld of current in a bhyve VM, and then did = the >>> following. >>> >>> pkg install devel/kyua >>> cd /usr/tests >>> kyua test >>> kyua report >>> kyua report-html >>> kyua report-junit >>> >>> I then published the results in Jenkins: >>> >>> The results are here: >>> >>> https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastComplet= edBuild/testReport/ >>> >>> There seem to be 31 test failures. Can folks look into those >>> and see if the tests need to be fixed >>> >>> Right now I ran these steps manually, but hopefully over time >>> we can automate more of this stuff. >> >> Most of the errors (jot, m4, sed, etc) seems to be: >> >> kyua-tap-tester: Configuration variables not supported; ignoring >> 'has.cleanup=3Dfalse' >> kyua-tap-tester: Configuration variables not supported; ignoring >> 'unprivileged-user=3Dtests=E2=80=99 > > Not quite=E2=80=A6 > >> while everything else about the test was successful. > > Hi Craig, > Taking a stab at the issues, most of the problems are because of = https://github.com/jmmv/kyua/issues/103 . The other issues with atf ( https= ://github.com/jmmv/atf/issues/8 ) and kyua ( https://github.com/jmmv/kyua/i= ssues/109 ) are known (I=E2=80=99m sure about ATF, not 100% sure about kyua= , but my gut instinct says yes). > Thanks! > -Garrett There are still a few genuine failures. usr.bin.yacc.yacc_tests.main is failing for reasons that have nothing to do with ATF or Kyua. So are bin.pkill.pkill-j_test.main and bin.pkill.pgrep-j_test.main.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOtMX2gGYnh_yV-hNsYJC3bJRxeFKqjqctzN-z3rn-2UgBUy9g>