From owner-freebsd-testing@FreeBSD.ORG Mon Sep 8 14:23:55 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5727BC8F for ; Mon, 8 Sep 2014 14:23:55 +0000 (UTC) Received: from mail-qc0-f178.google.com (mail-qc0-f178.google.com [209.85.216.178]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1692113BC for ; Mon, 8 Sep 2014 14:23:54 +0000 (UTC) Received: by mail-qc0-f178.google.com with SMTP id x13so15875961qcv.9 for ; Mon, 08 Sep 2014 07:23:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-type; bh=hUsccFMpjCxXOH4ZcP+an6ovTiZPOaF3hL6p+q4DSWI=; b=LOleA6vJdv/mRQ1KBZlIOzBhx/FZYJ3NjC5pxnIBBdmPDViaKmwcaDpGYqgLjjtedS xAM1SRryOtbmFmml/bPizblZVMgjjpQoOyALMRbOvV/8jbWveuxezra3Cs9cmKOQQL+X AxQAb0lWazIfJT2U+ehd0sX67gOOBXM52LHfnPYT+PxBJypywMs5m107VSut7adSJY7P GPC0WeslnWhLY5uiMMN3qEZb0Ry3PonE8/1iJn17HKHruLAPblRKwUY/3Y2/e+g95rsb bK70sy05g34DmuCtrYoeMojRjTYmHKgsgfv+WEmA0l1+4TIeyIsf4QvHJbiFz3H2OCbf 7IuA== X-Gm-Message-State: ALoCoQluG/M5QSWgGDCYXoWJiqKyohPiT/3HtUIIcZXLfxJKJ1P+FJnHijz+rbfJu1GfLqepxTfD X-Received: by 10.224.88.3 with SMTP id y3mr42091202qal.65.1410186228036; Mon, 08 Sep 2014 07:23:48 -0700 (PDT) MIME-Version: 1.0 Sender: jmmv@meroh.net Received: by 10.96.83.99 with HTTP; Mon, 8 Sep 2014 07:23:27 -0700 (PDT) X-Originating-IP: [2620:0:1003:1007:6091:363d:d526:1ccd] In-Reply-To: References: From: Julio Merino Date: Mon, 8 Sep 2014 10:23:27 -0400 X-Google-Sender-Auth: bP0mtxfwFgV4lDSIbLx6h8TixyE Message-ID: Subject: Re: Introducing the ZFS test suite To: Alan Somers Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" , "zfs-devel@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Sep 2014 14:23:55 -0000 On Mon, Aug 25, 2014 at 2:38 PM, wrote: > I just merged the ZFS test suite to projects/zfsd/head in change 270604. > [...] > The ZFS test suite still has some problems. Some of these are > blocking it from being merged to head: > * The atf-ksh93 hack. This is not a good thing to officially add to > ATF, but it would be a lot of work to convert the test programs to run > under sh. Especially because of the use of ksh arrays. As we discussed, agreed that this is a bit hackish, but I think this is a reasonable compromise and the hack is unlikely to break anytime soon. (Haven't looked at the specifics that were implemented though.) Therefore, I would personally not consider a "rewrite in sh" to be a blocker for merging into head. > Remember, don't run these tests on a production system. What's the plan for this? Are the tests somehow disabled by default so that a user running the full test suite is not tripped by this? Or will all the panics and deadlocks be fixed before merging to head? Thanks for doing this! From owner-freebsd-testing@FreeBSD.ORG Mon Sep 8 14:59:48 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D3796F14; Mon, 8 Sep 2014 14:59:48 +0000 (UTC) Received: from mail-wi0-x22b.google.com (mail-wi0-x22b.google.com [IPv6:2a00:1450:400c:c05::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 24726198C; Mon, 8 Sep 2014 14:59:47 +0000 (UTC) Received: by mail-wi0-f171.google.com with SMTP id hi2so2826223wib.16 for ; Mon, 08 Sep 2014 07:59:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=+BqMXuuKdUEV2WGcQuIMmgPZXRFA612jjVcmWwlMgG8=; b=TroSHEeFgoCHuVPkDiN2adDZDi7VCO5KkP6FNMpynFSJ4UfRiYGcToVPCB3nM1JVUT UwBhdIA1/d8ZO/98SlTY3DuxizC3UhrcM9wwfF/GZcBsy0JvO8QoK58cjo1MPAkhW94O 48NTR+c65BwMmivrHUXTGwo8y9afjTBjGgaz3ZWQoh9tXwyOkpUfz0Crdw2yNrE/06nL iUmRiDdTbYn64T0wi4dwCB2pEwKYkruAAiPty4e7eEbbvYFJJluaKCGhNLB+4G+59WHU 4Oq9TtFFF3wjiQvyQJjU3NbstpHv581PkFnhDGSkpkGzlaz72JuQBfORSS+1rUduB4Yg mLyg== MIME-Version: 1.0 X-Received: by 10.180.89.36 with SMTP id bl4mr14592297wib.50.1410188386323; Mon, 08 Sep 2014 07:59:46 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.194.126.1 with HTTP; Mon, 8 Sep 2014 07:59:46 -0700 (PDT) In-Reply-To: References: Date: Mon, 8 Sep 2014 08:59:46 -0600 X-Google-Sender-Auth: VVEY3AyMNS-Hn4_3uJwQjAVy76c Message-ID: Subject: Re: Introducing the ZFS test suite From: Alan Somers To: Julio Merino Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" , "zfs-devel@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Sep 2014 14:59:48 -0000 On Mon, Sep 8, 2014 at 8:23 AM, Julio Merino wrote: > On Mon, Aug 25, 2014 at 2:38 PM, wrote: >> I just merged the ZFS test suite to projects/zfsd/head in change 270604. >> [...] >> The ZFS test suite still has some problems. Some of these are >> blocking it from being merged to head: >> * The atf-ksh93 hack. This is not a good thing to officially add to >> ATF, but it would be a lot of work to convert the test programs to run >> under sh. Especially because of the use of ksh arrays. > > As we discussed, agreed that this is a bit hackish, but I think this > is a reasonable compromise and the hack is unlikely to break anytime > soon. (Haven't looked at the specifics that were implemented though.) > Therefore, I would personally not consider a "rewrite in sh" to be a > blocker for merging into head. Good. That certainly reduces the workload. > > > Remember, don't run these tests on a production system. > > What's the plan for this? > > Are the tests somehow disabled by default so that a user running the > full test suite is not tripped by this? Currently, most if not all of the tests reference the test_suites.FreeBSD.disks variable. We should add it to require.configs, and then none of them will run by default. The bigger problem, though, is that even if you define that variable, many disks will destroy all pools on cleanup unless you also define the keep_pools variable. It's part of the default_cleanup_noexit function in libtests.kshlib. That must be fixed. > > Or will all the panics and deadlocks be fixed before merging to head? I doubt it. I certainly don't want to wait for it. But merging these tests to head will certainly help to focus attention on those bugs. > > Thanks for doing this! From owner-freebsd-testing@FreeBSD.ORG Mon Sep 8 15:07:51 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EA652B33; Mon, 8 Sep 2014 15:07:51 +0000 (UTC) Received: from smtp1.multiplay.co.uk (smtp1.multiplay.co.uk [85.236.96.35]) by mx1.freebsd.org (Postfix) with ESMTP id ABDC81AB5; Mon, 8 Sep 2014 15:07:51 +0000 (UTC) Received: by smtp1.multiplay.co.uk (Postfix, from userid 65534) id 6E7F320E70894; Mon, 8 Sep 2014 15:07:49 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on smtp1.multiplay.co.uk X-Spam-Level: * X-Spam-Status: No, score=1.8 required=8.0 tests=AWL,BAYES_05,DOS_OE_TO_MX, FSL_HELO_NON_FQDN_1,RDNS_DYNAMIC,STOX_REPLY_TYPE autolearn=no version=3.3.1 Received: from r2d2 (82-69-141-170.dsl.in-addr.zen.co.uk [82.69.141.170]) by smtp1.multiplay.co.uk (Postfix) with ESMTP id E982720E70885; Mon, 8 Sep 2014 15:07:43 +0000 (UTC) Message-ID: From: "Steven Hartland" To: "Alan Somers" , "Julio Merino" References: Subject: Re: Introducing the ZFS test suite Date: Mon, 8 Sep 2014 16:07:48 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: freebsd-testing@freebsd.org, zfs-devel@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Sep 2014 15:07:52 -0000 ----- Original Message ----- From: "Alan Somers" snip... >> Or will all the panics and deadlocks be fixed before merging to head? > > I doubt it. I certainly don't want to wait for it. But merging these > tests to head will certainly help to focus attention on those bugs. Absolutely the sooner thes gets to head the sooner we can start attacking those bugs :) Regards Steve From owner-freebsd-testing@FreeBSD.ORG Tue Sep 9 04:11:59 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 48096D89; Tue, 9 Sep 2014 04:11:59 +0000 (UTC) Received: from mail-pd0-x22e.google.com (mail-pd0-x22e.google.com [IPv6:2607:f8b0:400e:c02::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0C895989; Tue, 9 Sep 2014 04:11:59 +0000 (UTC) Received: by mail-pd0-f174.google.com with SMTP id v10so8141090pde.19 for ; Mon, 08 Sep 2014 21:11:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=333mhcI224ESWFlvuSUc6dSd6Cokuhik3c/J+zywhtY=; b=CeQFTwEjFjgyHu0aLCv+8DbYBSR6kPMQMlbi6k4WK2M3+D3Ll5xpk1PhIiSfM+nqif ziv2iSnx9Z0IgkoclKqzVWZwY+yuY8yGrjj5IAA3klj8k5eJ8tN67OLZihod9jwZnhy1 TrnvpWT1Xgq1X6Pz+bUrq/bbYEbMtgfPwnFDL/zza6X8PDfks2b/FKQj9Rvj+HCY3223 7CGqhtnNjWcCIojAuR64Gs13MBO2qBiu0h8oB2NwW9d9GkGCNAejLVb33bd/CjUmCj9f RZwECWvLvlHQEq+43BPM+drw/8EcW70GYdzVZi3Zxxt5yUIJHzxgFSi5fCeI2SrRca9l MK6Q== X-Received: by 10.69.27.71 with SMTP id je7mr8791554pbd.155.1410235918538; Mon, 08 Sep 2014 21:11:58 -0700 (PDT) Received: from [192.168.242.58] (c-67-182-131-225.hsd1.wa.comcast.net. [67.182.131.225]) by mx.google.com with ESMTPSA id td4sm10900064pab.19.2014.09.08.21.11.57 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 08 Sep 2014 21:11:57 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_264B747A-585A-4378-84B2-7419B4F8C816"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: svn commit: r271298 - in stable/10: . etc/mtree libexec/atf libexec/atf/atf-check libexec/atf/atf-sh share/mk tools/build/mk usr.bin From: yaneurabeya@gmail.com In-Reply-To: <201409090400.s8940Vwv099647@svn.freebsd.org> Date: Mon, 8 Sep 2014 21:11:57 -0700 Message-Id: <22676884-CC9A-4DF1-8D3C-F30B6661238E@gmail.com> References: <201409090400.s8940Vwv099647@svn.freebsd.org> To: Garrett Cooper X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" , freebsd-stable@FreeBSD.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Sep 2014 04:11:59 -0000 --Apple-Mail=_264B747A-585A-4378-84B2-7419B4F8C816 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On Sep 8, 2014, at 21:00, Garrett Cooper wrote: > Author: ngie > Date: Tue Sep 9 04:00:30 2014 > New Revision: 271298 > URL: http://svnweb.freebsd.org/changeset/base/271298 >=20 > Log: > MFC r267176, r267181, r268445 (ATF-related commits): >=20 > Phabric: https://reviews.freebsd.org/D706 > Approved by: rpaulo (mentor) > Approved by: re (gjb) > Reviewed by: jmmv > Sponsored by: EMC / Isilon Storage Division Hello all! If you are running stable/10 with MK_TESTS =3D=3D yes after this = point, please be sure to run a complete buildworld without -DNO_CLEAN = and run make delete-old, or you might run into false positives with test = cases/suites that use atf-sh. Thank you! -Garrett --Apple-Mail=_264B747A-585A-4378-84B2-7419B4F8C816 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUDn4NAAoJEMZr5QU6S73ebPUH/3jLvgfws4oohzmPsiH1yVX+ RpDZcKIihDACMoobPDUoUVdMKAx70nXrLE3tsCcMqKIitHf7RhTy0YckDdU1zjVj XwK1svZ0T9n0BN9ZXffIFRN5b1Ecp4ca7iFVTomQPJ+rQrn8qYbRqLyzGwJUL8/f 3GoLGkr/6sxIogyMYyvfXVRmEjVsBoyAAmGdZRXw59xrpbuYAANXaEX2GacBflbu oG41lierB5jwM8Wk4g9yfkQurzV7Pj5pwEauOovOF4U5mNnDuvJ8kUp+i4cdoPK5 zbFMjcEOJQMRqJrBdwdBhZrw0mzDWkllx7t5LXeWACemVAH4id0IY6gvvDcycn8= =Uv5b -----END PGP SIGNATURE----- --Apple-Mail=_264B747A-585A-4378-84B2-7419B4F8C816-- From owner-freebsd-testing@FreeBSD.ORG Tue Sep 9 17:05:37 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6693C835; Tue, 9 Sep 2014 17:05:37 +0000 (UTC) Received: from mail-la0-x233.google.com (mail-la0-x233.google.com [IPv6:2a00:1450:4010:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B95BF938; Tue, 9 Sep 2014 17:05:36 +0000 (UTC) Received: by mail-la0-f51.google.com with SMTP id gi9so7464648lab.24 for ; Tue, 09 Sep 2014 10:05:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=Dp1cNsh83mVKctWZMqaAhHYNObecKyWb2NjJwnKgRpQ=; b=RNw6FTORZJgHoW4Q1n/c/B6Mc9irqpa9+mrPvl1GAJF6nJMkWvnEpROL+qTlohpm/T XAk4pwQMs9b1FbN3+NwQ1ZRgNC7bK1CixnSHz4gWZrBtT7yR0QkY4ZlhK3wq5hINSF+Y 1EHj4hhTkWZy1DBcECW7I4Z+ggbnEHa6WMdmpqQ2rQncrbrQhR96tnySmbDBXCWmapsl EclQ0MFbnyWIrO7jFAx36RUQKfItYWsZbfnxvDWt1KbM5iKT4Jt602sqU/sJzxM5Gzbl HB5k8SuMf9/VYJPUlVapURSAUI/LUqSWPJY8TtR7KEy3t0EjO9gtpUJ7RAlyLWU9JJTg 1I1g== MIME-Version: 1.0 X-Received: by 10.152.29.129 with SMTP id k1mr11058033lah.81.1410282334478; Tue, 09 Sep 2014 10:05:34 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.22.72 with HTTP; Tue, 9 Sep 2014 10:05:34 -0700 (PDT) Date: Tue, 9 Sep 2014 10:05:34 -0700 X-Google-Sender-Auth: 6KtBhF2FRTIKgEtyKBKw98GO3OM Message-ID: Subject: Need help fixing tests in CURRENT From: Craig Rodrigues To: freebsd-current Current , "freebsd-testing@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Sep 2014 17:05:37 -0000 Hi, I did a buildworld/installworld of current in a bhyve VM, and then did the following. pkg install devel/kyua cd /usr/tests kyua test kyua report kyua report-html kyua report-junit I then published the results in Jenkins: The results are here: https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedBuild/testReport/ There seem to be 31 test failures. Can folks look into those and see if the tests need to be fixed Right now I ran these steps manually, but hopefully over time we can automate more of this stuff. -- Craig From owner-freebsd-testing@FreeBSD.ORG Tue Sep 9 18:01:41 2014 Return-Path: Delivered-To: testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 42F30B18; Tue, 9 Sep 2014 18:01:41 +0000 (UTC) Received: from mail-la0-x234.google.com (mail-la0-x234.google.com [IPv6:2a00:1450:4010:c03::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 343BBF53; Tue, 9 Sep 2014 18:01:37 +0000 (UTC) Received: by mail-la0-f52.google.com with SMTP id b8so8263578lan.39 for ; Tue, 09 Sep 2014 11:01:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=IBJKvWY3YxxSoxuDdWVKUEPzhNSzLUNCIwTdZFucPDU=; b=EMkinmGd2rx1RDWtZdjbu6FseQiZi/OUy2pxrqEn6vmUDwiLbzQ0rxgCmRR2zHS+sf cz3I0hIxsJXP4SJPa3/bnUtcS5Uz4e2y8XrQk0u6ikTz8D8AROtSmh2kbDb+vurtUeZ8 UIjmyebZd62eqxyEtYIWSsa7W3iF1rJFMrZuHcsTAWm0sMCFEpQqk5puZ4SwGU5QHkNY XxzI6QJ2GbIzjK5NEr+0W4xgH+yHVKFT0Mhc+rp1DItx6dMza0bVnt1JgI8Bxo9X3zj1 +DzNreO7K0BNElcEkJZAQ8mOyB1v+aneHpAxMRJYQ3OwgAMo/buZfSAcT4peoAZMIIsA +10Q== MIME-Version: 1.0 X-Received: by 10.112.138.201 with SMTP id qs9mr32139556lbb.41.1410285695099; Tue, 09 Sep 2014 11:01:35 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.22.72 with HTTP; Tue, 9 Sep 2014 11:01:35 -0700 (PDT) In-Reply-To: <540F34B1.7040103@freebsd.org> References: <540F34B1.7040103@freebsd.org> Date: Tue, 9 Sep 2014 11:01:35 -0700 X-Google-Sender-Auth: SjF_m5HoahqekZ4Kp8rpmnhGNS8 Message-ID: Subject: Re: Need help fixing tests in CURRENT From: Craig Rodrigues To: Allan Jude Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-current Current , "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Sep 2014 18:01:41 -0000 On Tue, Sep 9, 2014 at 10:11 AM, Allan Jude wrote: > > > > > https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedBuild/testReport/ > > > Most of the errors (jot, m4, sed, etc) seems to be: > > kyua-tap-tester: Configuration variables not supported; ignoring > 'has.cleanup=false' > kyua-tap-tester: Configuration variables not supported; ignoring > 'unprivileged-user=tests' > > while everything else about the test was successful. > > "Configuration variables not supported" is a behavior of kyua. I filed an issue for it here: https://github.com/jmmv/kyua/issues/104 I'm not sure if that is the source of the test failures. -- Craig From owner-freebsd-testing@FreeBSD.ORG Wed Sep 10 16:40:35 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 39BFD96; Wed, 10 Sep 2014 16:40:35 +0000 (UTC) Received: from mail-lb0-x229.google.com (mail-lb0-x229.google.com [IPv6:2a00:1450:4010:c04::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8C6DD1C93; Wed, 10 Sep 2014 16:40:34 +0000 (UTC) Received: by mail-lb0-f169.google.com with SMTP id p9so10323693lbv.28 for ; Wed, 10 Sep 2014 09:40:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=V5A2p3Y+a9YE0FVc/SvglzWfJ4YwSLDFmrPatFPbcMg=; b=015usbN9nnv4FGPknf4mV1FUZHBjaiMWMqAdxS+8xom++tFEEqVWRbYpmYBmnmH454 IG8F/vp2kNt3B5Jp/qecXGC/WQGflHwpLgAwozFKx53nzBbJdiw7L1IGcp62ZXQugi58 lml/idyGZRKaIZPVRoPZcunB/2+x7jsaIgthAM0bH0tERCxEd6e6sb9x6Ps9sxWtXYmF K7altTkJJG7dZfSfekE+bQSpHK2isCoGOJpU1XMdST61p7Hm3fHbE018GpLJLLMaMk1g ObHyFG5aNCBGTEFbtHrLj5uPzd3N9Bq/KBsC1Sk3t4q2pDM+Ke4H3n4r7Mxb9Ib41odh TfZA== MIME-Version: 1.0 X-Received: by 10.152.36.73 with SMTP id o9mr3958996laj.88.1410367232389; Wed, 10 Sep 2014 09:40:32 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.22.72 with HTTP; Wed, 10 Sep 2014 09:40:32 -0700 (PDT) Date: Wed, 10 Sep 2014 09:40:32 -0700 X-Google-Sender-Auth: oo8AlU6hSFHIdJn69P1ZikZ-Xis Message-ID: Subject: Need help fixing tests in CURRENT From: Craig Rodrigues To: freebsd-current Current Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Sep 2014 16:40:35 -0000 Hi, Based on feedback from Garrett, it looks like there were some problems in kyua, causing test failures. I patched my local copy of the kyua port: https://github.com/rodrigc/kyua-port/ and re-ran the tests: cd /usr/tests kyua test kyua report kyua report-html kyua report-junit https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedBuild/testReport/ There are still 7 test failures which I don't understand. Can someone help fix these? -- Craig