From owner-freebsd-current@FreeBSD.ORG  Tue Sep 22 10:30:30 2009
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: current@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 2FC0B106568B
	for <current@freebsd.org>; Tue, 22 Sep 2009 10:30:30 +0000 (UTC)
	(envelope-from rwatson@freebsd.org)
Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42])
	by mx1.freebsd.org (Postfix) with ESMTP id 091788FC17
	for <current@freebsd.org>; Tue, 22 Sep 2009 10:30:30 +0000 (UTC)
Received: from [192.168.2.101] (host81-155-13-237.range81-155.btcentralplus.com
	[81.155.13.237])
	by cyrus.watson.org (Postfix) with ESMTPSA id 2F36046B06;
	Tue, 22 Sep 2009 06:30:29 -0400 (EDT)
Mime-Version: 1.0 (Apple Message framework v1075.2)
Content-Type: text/plain; charset=us-ascii; format=flowed; delsp=yes
From: "Robert N. M. Watson" <rwatson@freebsd.org>
In-Reply-To: <wpmy63sabp.fsf@heho.snv.jussieu.fr>
Date: Tue, 22 Sep 2009 11:30:27 +0100
Content-Transfer-Encoding: 7bit
Message-Id: <E7DF11DA-60A5-4DE5-B55C-D24A60D89D7B@freebsd.org>
References: <alpine.BSF.2.00.0908121329130.66335@fledge.watson.org>
	<wpmy63sabp.fsf@heho.snv.jussieu.fr>
To: Arno J. Klaassen <arno@heho.snv.jussieu.fr>
X-Mailer: Apple Mail (2.1075.2)
Cc: current@freebsd.org
Subject: Re: Call for regression and performance testing - 8.0
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>, 
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 22 Sep 2009 10:30:30 -0000


On 13 Aug 2009, at 21:55, Arno J. Klaassen wrote:

> Robert Watson <rwatson@freebsd.org> writes:
>
>>> [ ... ]
>>  Functional testing
>>
>> We actually have a sizable regression test suite in src/tools/ 
>> regression --
>
> is anyone aware of some rudimentary efforts to set up an overall
> "make && ./runtests" environment?

Resurfacing after organising conferences, and discovered I had missed  
this e-mail. I'm not aware of any such efforts, and it would be really  
good to do. Making it easy to do "runtests" would vastly improve the  
ease of testing during the release process. Right now the output of  
the tests is fairly inconsistent, and this is probably to a large  
extent my fault. It would be nice to have a "test template" program  
that people can start with when writing new regression tests -- I know  
I would find that valuable.

Robert