Date: Sun, 2 Mar 2014 15:46:41 -0500 From: Julio Merino <jmmv@freebsd.org> To: "R. Tyler Croy" <tyler@monkeypox.org> Cc: "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>, jenkins-admin@freebsd.org Subject: Re: Generating Kyua test result output in JUnit XML format for Jenkins integration? Message-ID: <CAFY7cWCMjPw%2BpO36bcyAarTMOFF7CW%2BLRtunztHYivaR9BNEAw@mail.gmail.com> In-Reply-To: <20140225033526.GN85115@kiwi> References: <CAG=rPVd_32sXvZnx_btys=GgjNrxTmC8NAnkwd4U-hRu7eCx=A@mail.gmail.com> <CAOtMX2jU3DbxeX3CDJzmWkBAL4CsQK=zs5Vmp8uCFYFze1g%2Bnw@mail.gmail.com> <CAG=rPVfuz_K38KtvtCCkCNMADAc4d0xg_fSibbwZ%2BYy3NOF=PQ@mail.gmail.com> <CAOtMX2ix1oKVUs9Vue=1RVxyxaZrGzb=3JLN-_LOUmxW=iL_qQ@mail.gmail.com> <20140225033526.GN85115@kiwi>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Feb 24, 2014 at 10:35 PM, R. Tyler Croy <tyler@monkeypox.org> wrote: >> 2) I don't see any "expected failure" results in the links that you >> provided. That's an absolute requirement for Kyua. Treating expected >> failures like ordinary failures will greatly reduce the utility of >> Kyua, by reducing its ability to spot regressions. > > > JUnit allows for the concept of "skipped" tests, which Jenkins' parsing code > respects. IIRC this is just a "skipped=true" on a <testcase>, I believe that > would help solve for this case. No, it's not. An expected failure is not the same as skipped. Possibly the best approximation is to consider an expected failure as a pass.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFY7cWCMjPw%2BpO36bcyAarTMOFF7CW%2BLRtunztHYivaR9BNEAw>