From owner-freebsd-testing@freebsd.org Sun Nov 22 20:33:28 2015 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89A9DA2E7AA for ; Sun, 22 Nov 2015 20:33:28 +0000 (UTC) (envelope-from jmmv@meroh.net) Received: from mail-vk0-x230.google.com (mail-vk0-x230.google.com [IPv6:2607:f8b0:400c:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 465411960 for ; Sun, 22 Nov 2015 20:33:28 +0000 (UTC) (envelope-from jmmv@meroh.net) Received: by vkha189 with SMTP id a189so26204491vkh.2 for ; Sun, 22 Nov 2015 12:33:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=meroh-net.20150623.gappssmtp.com; s=20150623; h=sender:from:content-type:content-transfer-encoding:subject :message-id:date:to:mime-version; bh=1ROWwSOvE1vc/fRoc10o3zPQuvgcmbBnR5cyJntrkkE=; b=gjryGqflQqJXRn04AZjwzAZzU90c/TeXc41sEgrkLEuI5xpEd5LETUZOCDh5LxJbf1 lrdS1fSSAmYvWhH6IkqpNtSWjcfT9YyUivfUF4MH01V37ef1RRNdeGQ/JHYsjQvWbsTm +V/pwtaGJRSspUcJ2Jkyeb5FfgsaVmimwoa6dwtTlPubqyq42Yu/8uysIpRC7lB0XszH 7NDlTSgWTtjFgxgnWrFk7IWiKMqzh0yK5JouMzWHpAIeBUwhg7cHNx369fCXTe9HhAZO zdl8oYwGRzu7OMNTbHVtZrwwktP0Uww9W2PE2PEZo4wNXKxKngOdd146HEFfCtOxeBD4 ZaKQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:from:content-type :content-transfer-encoding:subject:message-id:date:to:mime-version; bh=1ROWwSOvE1vc/fRoc10o3zPQuvgcmbBnR5cyJntrkkE=; b=ZNMu8YbUR5JRBew3upfyvlTddazfZEGGAFBWd2lJEPzggHJUiFpov1TVOW0dXVSRzl z7E/cUPqjPZyIsBKl085032NKIOkjxKASNJ83Tp27NgViD9erunMXYvTF0OxWm7X8krJ Dr4viEiNy30X5sfwaaVCTL2x/dDso3eEflsEI1kSkfQIG5rDqopPWNGl10wuFmM4QJiq coTVHQC8iccOvIVnjkczEfKXjeuG43JlMylyDBC8eoJ3kVS/aVvzwKa08KYIs5zc7Gg2 e1xdYCwgBZs4fwRRfXEy1X6kXN9nVL7RCLXilMuKn+09WvIZUwMu1QPqmX23dTKXBxfV SY/g== X-Gm-Message-State: ALoCoQlhV/vTmMbv2/QoAQbzqWzsMqyhlRVlHsWujAlPrjRil9t55JJrYdDbDbe8wbN2FhIEBFkB X-Received: by 10.31.49.147 with SMTP id x141mr14398977vkx.1.1448224406981; Sun, 22 Nov 2015 12:33:26 -0800 (PST) Received: from lime.meroh.net (cpe-24-90-142-167.nyc.res.rr.com. [24.90.142.167]) by smtp.gmail.com with ESMTPSA id g133sm8050812vke.25.2015.11.22.12.33.26 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 22 Nov 2015 12:33:26 -0800 (PST) Sender: Julio Merino From: Julio Merino Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: Updating to Kyua 0.12 Message-Id: <1C6F9C51-FB94-4B86-8B61-7300B639320F@freebsd.org> Date: Sun, 22 Nov 2015 15:33:25 -0500 To: freebsd-testing@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 9.1 \(3096.5\)) X-Mailer: Apple Mail (2.3096.5) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Nov 2015 20:33:28 -0000 Hello all, It has been more than a year since the previous release and, finally, Kyua 0.12 is here! Apologies for the delay. How this impacts FreeBSD ------------------------ The devel/kyua ports package will be updated as soon as a I get D4243 reviewed and approved. I have done multiple local runs of the FreeBSD test suite under different configurations to ensure that Kyua 0.12 does not introduce regressions... but this was not under the environment that Jenkins runs, so things could still go awry in our continuous builds. If you notice any breakage either in Jenkins or locally, please let me know and I'll try to address the problem ASAP. If you intend to run the FreeBSD test suite with parallelism enabled, then you should currently patch D4254 in order to avoid some spurious failures. I cannot submit that yet, and the rationale is in the review description. Rest of the original announcement in kyua-discuss ------------------------------------------------- This is a huge release and marks a major milestone for Kyua as it finally implements a long-standing feature request: the ability to execute test cases in parallel. This is a big deal because test cases are rarely CPU-bound: running them in parallel yields much faster execution times for large test suites, allowing faster iteration of changes during development. As an example: the FreeBSD test suite as of this date contains 3285 test cases. With sequential execution, a full test suite run takes around 12 minutes to complete, whereas on a 4-core machine with a high level of parallelism it takes a little over 1 minute. Implementing parallel execution required rewriting most of Kyua's core and partly* explains explains why there has not been a new release for over a year. The current implementation is purely subprocess-based, which works but has some limitations and has resulted in a core that is really complex and difficult to understand. Future versions will investigate the use of threads instead for a simplified programming model and additional parallelization possibilities. For more details on the changes in this release and the link to the source distfile, see the GitHub page: https://github.com/jmmv/kyua/releases/tag/kyua-0.12 Enjoy! *: The other part is that we got kid number 2 earlier this year and he has prevented me from having the energy to hack at odd times ;-P