From owner-freebsd-performance@FreeBSD.ORG Sun Nov 11 21:00:05 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 66ECB16A468 for ; Sun, 11 Nov 2007 21:00:05 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.180]) by mx1.freebsd.org (Postfix) with ESMTP id F2F6F13C4B9 for ; Sun, 11 Nov 2007 21:00:04 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so872033pyb for ; Sun, 11 Nov 2007 12:59:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=5J99NRO2HxQLuM1DqAqP/dCqjRJRG/pMviGDEZM4IeI=; b=oufnUgI9ALE271azaMtOjenvmkc4/08ro066EfN8xSqhN3Hpx65NKpiLIvtYcaJqzwxBxr+sadHUHZ7qPH9YKw8Eab35KkLqqNbWs2oJnx/hlhcGhAUQIhbZPg9mrZ9ZI4qr3/dkAlOEWt9U6pl6j6ZkGUsWqE568Wsa4YEKYSw= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=U3/0vAv/7gBAiH9uFsPUtQ9ZoGaBeaftZJvuThzC71MgF7NmAywiIXMppa3WlYzbHLJB2amaGajQE2slpPJEIbJ8n2WckIXzxkRO6vjEM3I7jrnSVf8dZteJQYc7fKogybHwNgHP866txxwobSHcxTiObVrkjCbLjA4YZd1mHTk= Received: by 10.35.103.6 with SMTP id f6mr5166316pym.1194814795390; Sun, 11 Nov 2007 12:59:55 -0800 (PST) Received: by 10.35.57.12 with HTTP; Sun, 11 Nov 2007 12:59:55 -0800 (PST) Message-ID: <8cb6106e0711111259hd4f854at245672359bf25c82@mail.gmail.com> Date: Sun, 11 Nov 2007 15:59:55 -0500 From: "Josh Carroll" To: "Kris Kennaway" In-Reply-To: <47361134.3050301@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> <47361134.3050301@FreeBSD.org> Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2007 21:00:05 -0000 > Try the /usr/src/tools/tools/ministat utility for a simple and effective > way to compare these kinds of noisy measurements and extract reliable > comparisons. Thanks again for the suggestion, Kris! I compiled results for 5 runs of the three benchmarks I've been using (ffmpeg, sysbench(mysql), and buildworld). I re-ran all tests under idle conditions for the three scheduler configurations, and I put the results up here: http://pflog.net/~floyd/uletesting I figured it'd be easier to view them separately there. For any future patches/tests, I'll re-run ministat and update the results (or, I can just use 4bsd as a reference, please let me know which you'd prefer Jeff). These ministat results show that the latest patch (alone) results in slightly worse performance for ffmpeg and buildworld, but slightly better results for sysbench. Thanks! Josh From owner-freebsd-performance@FreeBSD.ORG Sun Nov 11 21:36:02 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0B26F16A418 for ; Sun, 11 Nov 2007 21:36:02 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.180]) by mx1.freebsd.org (Postfix) with ESMTP id A218D13C491 for ; Sun, 11 Nov 2007 21:36:00 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so886649pyb for ; Sun, 11 Nov 2007 13:35:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=k2kzTs1zsCpxlS5IkLaHv+WI6Wcy7b9bxplpo4CpgEM=; b=jbP1aJ3HFY1wLlH+QXXnwQiIiJNWp6fQQPjsLNvUm+2vlyohd75BKVUSnl3kEgHPvSLVdoBO56GJCD/fShXNX+LRFwgDgczZ9XdJOaQlGHNvXgD6I+fDFtwbL3BIAqhC1DS2zK9OwYq5HD7y15jNQnuRGEf0PwvelA4j+m/Fw6I= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=VX1qsQlyQDKmPb3cOX7Q7rXjvNSXPT+L4ZPYF9QfTd6dwb3cK0s9/SaIQkSY5Kte0ZWF9tuzT6wh1P2nh4jKA2cNumHYOjhiMJnifFE3nsdJzpLM+Pk4g8/8DLcwrn2vxeg2MyuRz1UI72VsYnE6u1olYTpDOOzETE+BspNskSw= Received: by 10.35.106.15 with SMTP id i15mr5213298pym.1194816949078; Sun, 11 Nov 2007 13:35:49 -0800 (PST) Received: by 10.35.57.12 with HTTP; Sun, 11 Nov 2007 13:35:47 -0800 (PST) Message-ID: <8cb6106e0711111335y13d4cc48w1bd173a72f60b369@mail.gmail.com> Date: Sun, 11 Nov 2007 16:35:47 -0500 From: "Josh Carroll" In-Reply-To: <8cb6106e0711111259hd4f854at245672359bf25c82@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> <47361134.3050301@FreeBSD.org> <8cb6106e0711111259hd4f854at245672359bf25c82@mail.gmail.com> Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Nov 2007 21:36:02 -0000 > These ministat results show that the latest patch (alone) results in > slightly worse performance for ffmpeg and buildworld, but slightly > better results for sysbench. Please disregard those conclusions, I misread the ffmpeg results and didn't look at all thread counts for the sysbench runs. Looking more closely, the latest ULE patch improves ffmpeg performance slightly but degrades buildworld performance slightly. As for sysbench, the new patch takes a hit with 4 threads (1 per core), but is better with 8 threads (2 per core). It's slightly better at 12 threads (3 per core) and 16 threads (4 per core). Thanks, Josh