From owner-freebsd-testing@FreeBSD.ORG Fri Jul 18 07:11:32 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DEC6F9C0 for ; Fri, 18 Jul 2014 07:11:32 +0000 (UTC) Received: from mail-pa0-x22f.google.com (mail-pa0-x22f.google.com [IPv6:2607:f8b0:400e:c03::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B614421D2 for ; Fri, 18 Jul 2014 07:11:32 +0000 (UTC) Received: by mail-pa0-f47.google.com with SMTP id kx10so4874379pab.34 for ; Fri, 18 Jul 2014 00:11:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:references:from:content-type:message-id:date:to :content-transfer-encoding:mime-version; bh=inhOgYgrEITqEjypVgfmLuiog8iIOh4zJ55AE+erhBg=; b=WdSG2ZYiRO5E00bAcuaPY3C/GOuE1yr9TMIzVy9QeXH58lcxumzAKCbEJNs74Y/Qpw vfY4ZGy0B2fWUYhnGYTSVrONJj1BnYhc9X+bcqMnJ+svzKXEr5iWV6IW6LP3umJrmLXv PFdBEGwErAkDc7Z/stfut4iE1/lkjq2L9BAhnzEcaVOpBPYwRXjbBe1BLhQsH2uTtfLs ht9jID3myFpnVRbiuN5sFrrmLOuPfJ0tI10lZ0sCFVnptrVgW8KqcO9O7L1kKAYGoI5y Bdb9BulLzeUeAWkMuVhza8UcE31FUWBDj8CkU+tZQQCQwK6+zGiDeMFTWAtoryoT7LOA Ddig== X-Received: by 10.70.91.16 with SMTP id ca16mr2655236pdb.52.1405667492338; Fri, 18 Jul 2014 00:11:32 -0700 (PDT) Received: from [10.228.90.86] (mobile-166-137-213-243.mycingular.net. [166.137.213.243]) by mx.google.com with ESMTPSA id r3sm6202116pdd.8.2014.07.18.00.11.30 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 18 Jul 2014 00:11:31 -0700 (PDT) Subject: Need input on preference on location of 3rd party tests vs FreeBSD tests References: From: Garrett Cooper Content-Type: text/plain; charset=us-ascii X-Mailer: iPhone Mail (11D257) Message-Id: Date: Fri, 18 Jul 2014 00:11:27 -0700 To: freebsd-testing@freebsd.org Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 07:11:32 -0000 Hi all, One of the things that I've done on my fork of FreeBSD is I've imported A= TF test suites from NetBSD and I have integrated existing test suites from f= reebsd's tools/regression tree into Kyua as well. Due to the size and differ= ence in test content/coverage, I pulled lib/libc and lib/msun from bother so= urces and integrated them into Kyua. What I did was I put the netbsd testcas= es into the tests/ subdirectory and put the FreeBSD test suites into a tests= /legacy subdirectory. The goal was that the legacy directory would eventuall= y be converted over to atf testcases and then could be removed once the conv= ersion was complete. I'm not sure if this scheme makes sense though. Does anyone have a prefer= ence as to whether or not this makes sense? Thanks! -Garrett= From owner-freebsd-testing@FreeBSD.ORG Fri Jul 18 14:45:18 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9BC63FBA for ; Fri, 18 Jul 2014 14:45:18 +0000 (UTC) Received: from mail-we0-x234.google.com (mail-we0-x234.google.com [IPv6:2a00:1450:400c:c03::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 351722BE1 for ; Fri, 18 Jul 2014 14:45:18 +0000 (UTC) Received: by mail-we0-f180.google.com with SMTP id w61so4544448wes.11 for ; Fri, 18 Jul 2014 07:45:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=8iFkfCwyOYvcs/fnl9LV+6+fpyaDcjYoFWrrS9QxHzQ=; b=TqLJAqWroOhVTq8r+fy5IBDPIWUg8wW+xL29SOql09ORJuxRn2WKzwJ3Gq6rv0FoRp ukfHL15ZsYYZcwW7lIDyw/UZI73XbdqDPHhwnIlBwxVUCriBgVLpKgoyam9ksVQR7Ey1 MA5+24oHoFbRFFuyYYxWWuvy8Tb0flBhdPouUuiN7H/UstHfcWChypAEDdIhhZBtl0zn d5wtUn9smeo1S/t8f83l/S4JaQG7+/xCQ4geRIUVre24JhDmIF1Ws6LrQJ/KlHNeJNkA dpjesqSs99rVn4zL+Kfx0G3ZdfwZtZfR7uVBs7AOin0Pm7UTHw7IwTXEUGGISnohZpWu F/qg== MIME-Version: 1.0 X-Received: by 10.180.207.105 with SMTP id lv9mr4228845wic.23.1405694716405; Fri, 18 Jul 2014 07:45:16 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.194.203.134 with HTTP; Fri, 18 Jul 2014 07:45:16 -0700 (PDT) In-Reply-To: References: Date: Fri, 18 Jul 2014 08:45:16 -0600 X-Google-Sender-Auth: QT3gakoLc6o4fvc-NljS730FI54 Message-ID: Subject: Re: Need input on preference on location of 3rd party tests vs FreeBSD tests From: Alan Somers To: Garrett Cooper Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 14:45:18 -0000 On Fri, Jul 18, 2014 at 1:11 AM, Garrett Cooper wro= te: > Hi all, > One of the things that I've done on my fork of FreeBSD is I've importe= d ATF test suites from NetBSD and I have integrated existing test suites fr= om freebsd's tools/regression tree into Kyua as well. Due to the size and d= ifference in test content/coverage, I pulled lib/libc and lib/msun from bot= her sources and integrated them into Kyua. What I did was I put the netbsd = testcases into the tests/ subdirectory and put the FreeBSD test suites into= a tests/legacy subdirectory. The goal was that the legacy directory would = eventually be converted over to atf testcases and then could be removed onc= e the conversion was complete. > I'm not sure if this scheme makes sense though. Does anyone have a pre= ference as to whether or not this makes sense? > Thanks! > -Garrett I don't understand. What did you put in tests/legacy? If you're just copying from tools/regression, why not simply leave them in place until you convert them to ATF? -Alan From owner-freebsd-testing@FreeBSD.ORG Fri Jul 18 21:52:11 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 93E0C198; Fri, 18 Jul 2014 21:52:11 +0000 (UTC) Received: from mail-pa0-x232.google.com (mail-pa0-x232.google.com [IPv6:2607:f8b0:400e:c03::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 610A62344; Fri, 18 Jul 2014 21:52:11 +0000 (UTC) Received: by mail-pa0-f50.google.com with SMTP id et14so6229498pad.9 for ; Fri, 18 Jul 2014 14:52:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:mime-version:subject:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=aA/p0ESh8lCy27OoITdc/hUBDknJkILgLlbVv+w3cN8=; b=KYa3o9HTGiHnhrxYPTxy8Kugagn1UhFPkwpmnHX2aojWR0WkmUUdFDua823JHvNL2f 4TcZWk0bUkLhm72dksE7LlTSCNbSOUh3Ga8xy3NYj7KP/8XKYTS4Z1ohlVdz/QU6pHX6 /bon+hbr7oRLjCkz0K0lFlFNZY/KHGCY3fnPuuHGP0c90oP+svcr92+GgIsOnukPdCvm L0Q3tCD/j188dUg+taZBXLB2mZczim4Dk0Hqf1oZ0IXUTLcswyuFfe47u+XBQTdS1HzL sWScckqnwdpUrK94KVkzCrdnob+0hf2rTPfbkLTbjLEdUD/XesNqIsTMoMjcEtpgLfR6 GJbg== X-Received: by 10.68.203.132 with SMTP id kq4mr8681168pbc.12.1405720330943; Fri, 18 Jul 2014 14:52:10 -0700 (PDT) Received: from ?IPv6:2601:8:ab80:7d6:803c:321d:601c:70ce? ([2601:8:ab80:7d6:803c:321d:601c:70ce]) by mx.google.com with ESMTPSA id xz7sm27274091pac.3.2014.07.18.14.52.09 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 18 Jul 2014 14:52:10 -0700 (PDT) From: Garrett Cooper X-Google-Original-From: Garrett Cooper Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Need input on preference on location of 3rd party tests vs FreeBSD tests In-Reply-To: Date: Fri, 18 Jul 2014 14:52:09 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <4D9EB4FA-672A-47AC-8F6E-19D2B3FAB3F5@gmail.com> References: To: Alan Somers X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jul 2014 21:52:11 -0000 On Jul 18, 2014, at 7:45 AM, Alan Somers wrote: > On Fri, Jul 18, 2014 at 1:11 AM, Garrett Cooper = wrote: >> Hi all, >> One of the things that I've done on my fork of FreeBSD is I've = imported ATF test suites from NetBSD and I have integrated existing test = suites from freebsd's tools/regression tree into Kyua as well. Due to = the size and difference in test content/coverage, I pulled lib/libc and = lib/msun from bother sources and integrated them into Kyua. What I did = was I put the netbsd testcases into the tests/ subdirectory and put the = FreeBSD test suites into a tests/legacy subdirectory. The goal was that = the legacy directory would eventually be converted over to atf testcases = and then could be removed once the conversion was complete. >> I'm not sure if this scheme makes sense though. Does anyone have a = preference as to whether or not this makes sense? >> Thanks! >> -Garrett >=20 >=20 > I don't understand. What did you put in tests/legacy? The tests from tools/regression. tests/ contains the tests from NetBSD. > If you're just > copying from tools/regression, why not simply leave them in place > until you convert them to ATF? I moved the files over into their respective locations to avoid having = to change build machinery at the top level, but you bring up a valid = concern. These pieces are the exception, not the norm, so would it make = more sense to leave them be, hook the directories into the build = somehow, then move them over to their respective spots once they=92ve = been converted over? I was trying to keep things relatively pristine when dealing with the = NetBSD testcases as well so it would be clearer which was =93our=92s=94 = and what was =93their=92s=94, mostly because the code isn=92t checked = into a vendor tree as I don=92t have a commit bit and no one else with a = commit bit has done it yet. Thanks! -Garrett=