From owner-freebsd-testing@FreeBSD.ORG Mon Oct 13 06:14:49 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5DCCF5AE; Mon, 13 Oct 2014 06:14:49 +0000 (UTC) Received: from mail-la0-x233.google.com (mail-la0-x233.google.com [IPv6:2a00:1450:4010:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 82ACC27D; Mon, 13 Oct 2014 06:14:48 +0000 (UTC) Received: by mail-la0-f51.google.com with SMTP id ge10so6093050lab.10 for ; Sun, 12 Oct 2014 23:14:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=SXY9olLNRdQmN9wXDYsUB8DP+E9zWbp/iPgWRwEL9Iw=; b=LDHy7GQBX+jFUHphUkg+b9h8jj/uSHsLqmM7SFpieMcWPzrnxys7bQfyfFxbhx2yJu nbgRRqbgjIU5oXqpQZL0TtGXWB7DXRbe999id6UWxB09Qm/k+A3+P3g+gnUyUHSxEFu6 VBflNgyL5hRhlHZRhkpZY84lb/fy25wTAL7A1LJG59HXf+VioEXhhfqqS8L5g7Y0ZHhX PmgtynqZ0s14hESRt7+9rMBVdLuJUbn2tSSU+6R7ajLDVIGKMmjYeNSi2XZvrsbJWZYa wj19ctCQvn35gTHd4Pf0tv4gLBffTQYWL3QYkM2XbMQJ3f5FKuME0v++WLgrh7mP0NVs PqFg== MIME-Version: 1.0 X-Received: by 10.112.52.165 with SMTP id u5mr1166163lbo.80.1413180885134; Sun, 12 Oct 2014 23:14:45 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Sun, 12 Oct 2014 23:14:45 -0700 (PDT) Date: Sun, 12 Oct 2014 23:14:45 -0700 X-Google-Sender-Auth: x4hPCYLIElEluSbZGKUNjM4-9C0 Message-ID: Subject: Automatically running /usr/tests on stable/10 branch under Jenkins From: Craig Rodrigues To: FreeBSD stable Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Oct 2014 06:14:49 -0000 Hi, I have created this Jenkins job, which you can see a graphical representation of: https://jenkins.freebsd.org/jenkins/view/FreeBSD_src_stable/job/FreeBSD_stable_10/848/BuildGraph/ (1) does a buildworld/buildkernel on amd64 when someone checks new code into the stable/10 branch (2) Creates a bootable UFS image with makefs (3) Boots the image under bhyve (4) Runs these commands inside the bhyve VM: cd /usr/tests kyua test kyua report-junit --output=test-output.xml (5) Shuts down the bhyve VM (6) imports test-output.xml into Jenkins. You can see a full test report here: https://jenkins.freebsd.org/jenkins/job/FreeBSD_stable_10-tests/4/testReport/ We already do the same thing for CURRENT. Hopefully by running the tests regularly, we can help improve the quality of FreeBSD. -- Craig From owner-freebsd-testing@FreeBSD.ORG Mon Oct 13 06:17:42 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3C6A3711; Mon, 13 Oct 2014 06:17:42 +0000 (UTC) Received: from mail-pa0-x22a.google.com (mail-pa0-x22a.google.com [IPv6:2607:f8b0:400e:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ED8E02BA; Mon, 13 Oct 2014 06:17:41 +0000 (UTC) Received: by mail-pa0-f42.google.com with SMTP id bj1so5385471pad.29 for ; Sun, 12 Oct 2014 23:17:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=YAUKX8iaONTwNKnKwKh+fu1Qk44deLc826PFoEGYTmY=; b=oM2ifeeR59WTAx4COQYpOkeus+/1a+7M+6D3uRRqPrE56jotuR7zxF1T4WymDEd1QF cp4gMv0sJruolltd0qSLfSrlcEHOJQiTI0NBJSk9beRECs/1xaC6Qd0OzUdJ5hn8ENSO Nn3U5JzbrY7hEPD2XnClHsHjkxhqiAzv3RQ7i5YYShW85BjiJ6oAwn21KIl1vMPyYQO4 aHXVAnhuPcoHcRTAVQE1Mgj4EeMus32kmtZ318/Wcq30TEbV4yHLQD/x5AYartaYoNrA gPgzxKDCwVZ4TCGjST47NO4IIcMkHpdDw3DoyDnLdRNqf/7R8nR4gkTmzOfrgiXwUyC6 6nVA== X-Received: by 10.70.126.101 with SMTP id mx5mr21817658pdb.112.1413181061561; Sun, 12 Oct 2014 23:17:41 -0700 (PDT) Received: from ?IPv6:2601:8:ab80:7d6:3158:a83c:dca7:c7bc? ([2601:8:ab80:7d6:3158:a83c:dca7:c7bc]) by mx.google.com with ESMTPSA id kk10sm10089234pdb.63.2014.10.12.23.17.40 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sun, 12 Oct 2014 23:17:41 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_FE9F3DB8-2654-45AC-9B11-E2E54ADA38A3"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins From: Garrett Cooper In-Reply-To: Date: Sun, 12 Oct 2014 23:17:40 -0700 Message-Id: References: To: Craig Rodrigues X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" , FreeBSD stable , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Oct 2014 06:17:42 -0000 --Apple-Mail=_FE9F3DB8-2654-45AC-9B11-E2E54ADA38A3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Oct 12, 2014, at 23:14, Craig Rodrigues wrote: > Hi, >=20 > I have created this Jenkins job, which you can see a graphical > representation of: >=20 > = https://jenkins.freebsd.org/jenkins/view/FreeBSD_src_stable/job/FreeBSD_st= able_10/848/BuildGraph/ =85 Hi Craig! As much as everyone would like to take i386 out to pasture, = there=92s a large degree of value in running i386 tests on 11-CURRENT = and 10-STABLE (I=92ve caught some interesting build bugs and test bugs = by running on my i386/CURRENT VM). Are there any plans to have i386 = executors running tests anytime soon (does bhyve support i386?)? Thanks! -Garrett --Apple-Mail=_FE9F3DB8-2654-45AC-9B11-E2E54ADA38A3 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUO26EAAoJEMZr5QU6S73e5iYIAKWNtVc+D9KflJ07hRtE/1mD bJZEGltByNu+IJITu3/wA6JVRH1mtZlMwh0YZ3fBsp82PQIVJbA7Q85EvLDa2Uy0 pF0Zu7sEsofe+9ptMIjcaUjRLWujy1n1o6s7IMKse0oZ77dCSXVHgh41eOAH932+ YcQ/J+lIyIHvMgykdSkX+UgUDRj41JbJOSB5xIuFJ27hIxgTDQFWdtaJEuo+D9lj qJr4sq/PKaL7yUMJdEhgUjU51HcHSuR9IGEKOQGGvcGcw0YmztZis1RmSVPDrRmc 0i//162LeYrZjAKtd71nmPBh9TBF/x3E64iGOvD5uEv5FSPMeHbhgLAEvQmHc4c= =mbYP -----END PGP SIGNATURE----- --Apple-Mail=_FE9F3DB8-2654-45AC-9B11-E2E54ADA38A3-- From owner-freebsd-testing@FreeBSD.ORG Mon Oct 13 06:20:48 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id B2C77891; Mon, 13 Oct 2014 06:20:48 +0000 (UTC) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 703E52ED; Mon, 13 Oct 2014 06:20:48 +0000 (UTC) Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57]) by alto.onthenet.com.au (Postfix) with ESMTP id 994BA1278A; Mon, 13 Oct 2014 16:20:40 +1000 (EST) Received: from Peter-Grehans-MacBook-Pro-2.local (c-67-161-27-37.hsd1.ca.comcast.net [67.161.27.37]) by dommail.onthenet.com.au (MOS 4.4.4-GA) with ESMTP id BYY99736 (AUTH peterg@ptree32.com.au); Mon, 13 Oct 2014 16:20:38 +1000 Message-ID: <543B6F30.9060505@freebsd.org> Date: Sun, 12 Oct 2014 23:20:32 -0700 From: Peter Grehan User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:24.0) Gecko/20100101 Thunderbird/24.6.0 MIME-Version: 1.0 To: Garrett Cooper , Craig Rodrigues Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins References: In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "freebsd-testing@freebsd.org" , FreeBSD stable , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Oct 2014 06:20:48 -0000 > (does bhyve support i386?)? Yes, and also PAE (props to jhb). later, Peter. From owner-freebsd-testing@FreeBSD.ORG Thu Oct 16 00:25:43 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 485ABBCA for ; Thu, 16 Oct 2014 00:25:43 +0000 (UTC) Received: from mail-pa0-x22a.google.com (mail-pa0-x22a.google.com [IPv6:2607:f8b0:400e:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 19456924 for ; Thu, 16 Oct 2014 00:25:43 +0000 (UTC) Received: by mail-pa0-f42.google.com with SMTP id bj1so2309788pad.1 for ; Wed, 15 Oct 2014 17:25:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=35KSEwac7uZsuW09konFIQQJU1QT7v1m+fuzF+gvT/4=; b=XY73oFcHKmYQGFWl+gAR4MQvGA4S2Sb/PuZ7kvMxHgimvC+1aYMBLbMYRa1oyrU48T wSJ5UiC+C5x8PzRWkdyAY9wxkp1nJZuCNxlLT5mB9dU4hRTckMKasplIOVHLu4EVlT93 dw8BJRAUbEx4Ra+ox0QToAVk151L2ti/jXMGnDXmp9pWHeQ5KdRNS4LwcgniJC0Gwo3+ r/jTIFb+8x6i7bgj1JLA/d5akNW09nOLtPVWRUkehnhPcOTdNvMQLxgyxKfz/KIor09V rmc7sPgPruFE6HBm3bjpSnI05ZNqShr2TqYqnoXXa0u8O2fsh7B8ilTVp92HEywJOx5z JUfw== X-Received: by 10.70.126.6 with SMTP id mu6mr82708pdb.154.1413419142655; Wed, 15 Oct 2014 17:25:42 -0700 (PDT) Received: from [192.168.242.58] (c-67-182-131-225.hsd1.wa.comcast.net. [67.182.131.225]) by mx.google.com with ESMTPSA id k9sm18170231pdj.41.2014.10.15.17.25.41 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 15 Oct 2014 17:25:42 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_834EE1CE-519F-4856-98B0-1FE1DDFE202B"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: help on testing for FreeBSD... From: Garrett Cooper In-Reply-To: <20141016001543.GD1852@funkthat.com> Date: Wed, 15 Oct 2014 17:25:39 -0700 Message-Id: <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> References: <20141016001543.GD1852@funkthat.com> To: John-Mark Gurney X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 00:25:43 -0000 --Apple-Mail=_834EE1CE-519F-4856-98B0-1FE1DDFE202B Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 Hey jmg@ (-testing CCed)! On Oct 15, 2014, at 17:15, John-Mark Gurney wrote: > Hello, >=20 > I'm working on testing parts of OpenCrypto. I have committed some = work > to p4 at: > = https://p4db.freebsd.org/depotTreeBrowser.cgi?FSPC=3D//depot/projects/open= crypto/tests/sys/opencrypto&HIDEDEL=3DNO >=20 > But it requires a few files to be installed... I'm not sure where the > best location to install these are and now best to install them=85 I have a couple questions: - Where would the source live in the tree? - Why are they written in python? Also, the .pyc files shouldn=92t be committed to head (saw that they = were checked in to p4). Thanks! -Garrett --Apple-Mail=_834EE1CE-519F-4856-98B0-1FE1DDFE202B Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUPxCDAAoJEMZr5QU6S73eo/cH/2FhYBBIS6Ojc2242O+PsflI 3njdkyVQPfy+rIrFPkNo7d46YtW/eUmZOPHcYGA+HjXLqGadAmzAWShUsoMPbVx7 6XCUXLFa+Eo83eEjIfiMQXeD1x9AB4nGHMmmtnqt1XwKmAE1Cn78zFmfS+qmtQV9 8aldxvjRxVQXINbpzAuSE+v6jjZEX62s5GYbH8cFiUjD2Is0UKB7tMoA6CgKptq1 Ogq2jm66YJnfY5AI6AWVzkYhPyWOJG/GRUtMmls68OEyf99U6gQDla6JmYu2Vu2+ UNU0nXahyEv1b6LwQUDAfpQs9mXoK2HXyO/4D4bGFDD2VBfeWf77CT/4VOXHrlk= =wQmZ -----END PGP SIGNATURE----- --Apple-Mail=_834EE1CE-519F-4856-98B0-1FE1DDFE202B-- From owner-freebsd-testing@FreeBSD.ORG Thu Oct 16 00:38:27 2014 Return-Path: Delivered-To: freebsd-testing@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C425E3DF for ; Thu, 16 Oct 2014 00:38:27 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7E692A3D for ; Thu, 16 Oct 2014 00:38:23 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9G0cNaK051552 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 15 Oct 2014 17:38:23 -0700 (PDT) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9G0cMXH051551; Wed, 15 Oct 2014 17:38:22 -0700 (PDT) (envelope-from jmg) Date: Wed, 15 Oct 2014 17:38:22 -0700 From: John-Mark Gurney To: Garrett Cooper Subject: Re: help on testing for FreeBSD... Message-ID: <20141016003822.GE1852@funkthat.com> References: <20141016001543.GD1852@funkthat.com> <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Wed, 15 Oct 2014 17:38:23 -0700 (PDT) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 00:38:27 -0000 Garrett Cooper wrote this message on Wed, Oct 15, 2014 at 17:25 -0700: > Hey jmg@ (-testing CCed)! Sure, np... > On Oct 15, 2014, at 17:15, John-Mark Gurney wrote: > > > Hello, > > > > I'm working on testing parts of OpenCrypto. I have committed some work > > to p4 at: > > https://p4db.freebsd.org/depotTreeBrowser.cgi?FSPC=//depot/projects/opencrypto/tests/sys/opencrypto&HIDEDEL=NO > > > > But it requires a few files to be installed... I'm not sure where the > > best location to install these are and now best to install them? > > I have a couple questions: > - Where would the source live in the tree? Which source are you talking about? The python source? or the source for the input data files? If you mean the later, it's where they will be committed... They are taken from NIST's CAVP program unchanged... I COULD possibly write a complicated rules to fetch and extract the files, but decided not to... > - Why are they written in python? Because I'm too lazy to write code in C... I had already written framework code in Python, and C doesn't have a standard function to decode hex.. :) And error handling it much easier in python... > Also, the .pyc files shouldn?t be committed to head (saw that they were checked in to p4). Thanks for pointing that out... problems of p4 add *... I've removed them... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-testing@FreeBSD.ORG Thu Oct 16 00:46:59 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 42892958 for ; Thu, 16 Oct 2014 00:46:59 +0000 (UTC) Received: from mail-ie0-x22a.google.com (mail-ie0-x22a.google.com [IPv6:2607:f8b0:4001:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 134E8B15 for ; Thu, 16 Oct 2014 00:46:59 +0000 (UTC) Received: by mail-ie0-f170.google.com with SMTP id rd18so2464692iec.1 for ; Wed, 15 Oct 2014 17:46:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=D247p9QPNqSz/hDNY3lhYq2mpEaFSqc6OU0EXcc5GvA=; b=E6eSjKZTbQw6yny8wgad7ccTzx3p8lGq4txRMYPMkuvGeKuxOCEN3c4s9mf+ZN5r5L m6ZqX1gdS3VtxqCeGo0zCF1P81ppb+kN0zEMzPCoQaWwaaeYPh22Rvnf99Y+iWftQfe8 1rxK0ECQcKHFjE52bG7ZKaF0ElR0iYqJK5XnWFLm+7dmBA/i0CgqGvrsAX9Z+t1ZuiI9 7eMLHe2F6USICRg+sCSFhS7MzuEvV/BvQvUr+spqb0sVt6TQAYrLAP5gyXu7cBuJL2Vt QeLD8pBQuXVVJzGHcJkLjVT+hbBt3R8l90bTAckfmsqwVwtWIUEgiV9BVxCETFzFFI73 I2ZA== MIME-Version: 1.0 X-Received: by 10.107.13.80 with SMTP id 77mr6903650ion.2.1413420418477; Wed, 15 Oct 2014 17:46:58 -0700 (PDT) Received: by 10.50.227.42 with HTTP; Wed, 15 Oct 2014 17:46:58 -0700 (PDT) In-Reply-To: <20141016003822.GE1852@funkthat.com> References: <20141016001543.GD1852@funkthat.com> <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> <20141016003822.GE1852@funkthat.com> Date: Wed, 15 Oct 2014 17:46:58 -0700 Message-ID: Subject: Re: help on testing for FreeBSD... From: NGie Cooper To: John-Mark Gurney Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 00:46:59 -0000 On Wed, Oct 15, 2014 at 5:38 PM, John-Mark Gurney wrote: > Garrett Cooper wrote this message on Wed, Oct 15, 2014 at 17:25 -0700: >> Hey jmg@ (-testing CCed)! > > Sure, np... > >> On Oct 15, 2014, at 17:15, John-Mark Gurney wrote: >> >> > Hello, >> > >> > I'm working on testing parts of OpenCrypto. I have committed some work >> > to p4 at: >> > https://p4db.freebsd.org/depotTreeBrowser.cgi?FSPC=//depot/projects/opencrypto/tests/sys/opencrypto&HIDEDEL=NO >> > >> > But it requires a few files to be installed... I'm not sure where the >> > best location to install these are and now best to install them? >> >> I have a couple questions: >> - Where would the source live in the tree? > > Which source are you talking about? The python source? or the source > for the input data files? If you mean the later, it's where they will > be committed... They are taken from NIST's CAVP program unchanged... > I COULD possibly write a complicated rules to fetch and extract the > files, but decided not to... The bulk majority of the driver source (.c, .h, etc). >> - Why are they written in python? > > Because I'm too lazy to write code in C... I had already written > framework code in Python, and C doesn't have a standard function to > decode hex.. :) And error handling it much easier in python... I ask because we don't have a means for doing unittest level execution right now and not being written in something that's in base or installed automatically (perl for instance) would mean that your test code wouldn't be run by default on jenkins runs. >> Also, the .pyc files shouldn?t be committed to head (saw that they were checked in to p4). > > Thanks for pointing that out... problems of p4 add *... I've removed > them... Np! From owner-freebsd-testing@FreeBSD.ORG Thu Oct 16 00:52:51 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E7F1FB18 for ; Thu, 16 Oct 2014 00:52:50 +0000 (UTC) Received: from h2.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "funkthat.com", Issuer "funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id ABB04BF0 for ; Thu, 16 Oct 2014 00:52:50 +0000 (UTC) Received: from h2.funkthat.com (localhost [127.0.0.1]) by h2.funkthat.com (8.14.3/8.14.3) with ESMTP id s9G0qmHe051709 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 15 Oct 2014 17:52:49 -0700 (PDT) (envelope-from jmg@h2.funkthat.com) Received: (from jmg@localhost) by h2.funkthat.com (8.14.3/8.14.3/Submit) id s9G0qm1f051708; Wed, 15 Oct 2014 17:52:48 -0700 (PDT) (envelope-from jmg) Date: Wed, 15 Oct 2014 17:52:48 -0700 From: John-Mark Gurney To: NGie Cooper Subject: Re: help on testing for FreeBSD... Message-ID: <20141016005248.GF1852@funkthat.com> References: <20141016001543.GD1852@funkthat.com> <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> <20141016003822.GE1852@funkthat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i X-Operating-System: FreeBSD 7.2-RELEASE i386 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (h2.funkthat.com [127.0.0.1]); Wed, 15 Oct 2014 17:52:49 -0700 (PDT) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 16 Oct 2014 00:52:51 -0000 NGie Cooper wrote this message on Wed, Oct 15, 2014 at 17:46 -0700: > On Wed, Oct 15, 2014 at 5:38 PM, John-Mark Gurney wrote: > > Garrett Cooper wrote this message on Wed, Oct 15, 2014 at 17:25 -0700: > >> Hey jmg@ (-testing CCed)! > > > > Sure, np... > > > >> On Oct 15, 2014, at 17:15, John-Mark Gurney wrote: > >> > >> > Hello, > >> > > >> > I'm working on testing parts of OpenCrypto. I have committed some work > >> > to p4 at: > >> > https://p4db.freebsd.org/depotTreeBrowser.cgi?FSPC=//depot/projects/opencrypto/tests/sys/opencrypto&HIDEDEL=NO > >> > > >> > But it requires a few files to be installed... I'm not sure where the > >> > best location to install these are and now best to install them? > >> > >> I have a couple questions: > >> - Where would the source live in the tree? > > > > Which source are you talking about? The python source? or the source > > for the input data files? If you mean the later, it's where they will > > be committed... They are taken from NIST's CAVP program unchanged... > > I COULD possibly write a complicated rules to fetch and extract the > > files, but decided not to... > > The bulk majority of the driver source (.c, .h, etc). The code that I'm testing is in src/sys/opencrypto (and there are other drivers that can get tested too, but it still goes through the opencrypto code)... Hence why I put them in tests/sys/opencrypto... If that's the wrong location, let me know and I can move them... > >> - Why are they written in python? > > > > Because I'm too lazy to write code in C... I had already written > > framework code in Python, and C doesn't have a standard function to > > decode hex.. :) And error handling it much easier in python... > > I ask because we don't have a means for doing unittest level execution > right now and not being written in something that's in base or > installed automatically (perl for instance) would mean that your test > code wouldn't be run by default on jenkins runs. Yeh... Though as a kld will have to be loaded, and a sysctl set as root, there's other issues to having it automaticly run as part of jenkins... -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not."