From owner-freebsd-performance@FreeBSD.ORG Wed Dec 21 01:37:33 2011 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDE8E106566B; Wed, 21 Dec 2011 01:37:33 +0000 (UTC) (envelope-from matthew@phoronix.com) Received: from phx1.phoronix.com (173.192.77.202-static.reverse.softlayer.com [173.192.77.202]) by mx1.freebsd.org (Postfix) with ESMTP id 888C58FC14; Wed, 21 Dec 2011 01:37:33 +0000 (UTC) Received: from mobile-166-205-136-198.mycingular.net ([166.205.136.198] helo=www.palm.com) by phx1.phoronix.com with esmtpa (Exim 4.69) (envelope-from ) id 1RdB7b-0007Hu-W1; Tue, 20 Dec 2011 19:37:32 -0600 Date: Tue, 20 Dec 2011 17:37:29 -0800 From: To: "Adrian Chadd" In-Reply-To: X-Mailer: Palm webOS X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - phx1.phoronix.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - phoronix.com Message-Id: <20111221013733.BDE8E106566B@hub.freebsd.org> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: FreeBSD Stable Mailing List , Current FreeBSD , Igor Mozolevsky , freebsd-performance@freebsd.org, "O. Hartmann" , Jeremy Chadwick Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Dec 2011 01:37:33 -0000 The benchmarks themselves are versioned. So in general most of the av= ailable versions of PTS itself should be fine. PTS can be considered = an execution shell that doesn't affect the benchmark itself. Note th= at you'll download a pile of the benchmarks, build and install them. = Then you run about 49 individual steps. Matthew -- Sent from my HP Pre3 _________________________________________________________________ On Dec 20, 2011 5:30 PM, Adrian Chadd = ; wrote: Is there a specific version of the test suite that = should be used, to=0D compare against the published results?=0D =0D=0D Adrian=0D =0D On 20 December 2011 17:18, Matthew Tippett <= ;matthew@phoronix.com> wrote:=0D > For such a system, the greatest= immediate value would be to attempt to=0D > reproduce the benchmarks= in question.=0D >=0D > Install PTS from www.phoronix-test-suit= e.com or freshports.org.=0D >=0D > Run the benchmark against th= ose used in the article=0D >=0D > =C2=A0 =C2=A0phoronix-test-su= ite benchmark 1112113-AR-ORACLELIN37=0D >=0D > You will be aske= d to push the comparison up to openbenchmarking at the end.=0D >=0D> Matthew=0D >=0D >=0D > On 12/20/2011 01:39 PM, O. = Hartmann wrote:=0D >>=0D >> On 12/20/11 21:20, Igor Mozol= evsky wrote:=0D >>>=0D >>> Interestingly, while peo= ple seem to be (arguably rightly) focused on=0D >>> criticising= Phoronix's benchmarking, nobody has offered an alternative=0D >>&= gt; benchmark; and while (again, arguably rightly) it is important to=0D >>> benchmark real world performance, equally, nobody has offered= any=0D >>> numbers in relation to, for example, HTTP or SMTP, = or any other "real=0D >>> world"-application torture tests done= on the aforementioned two=0D >>> platforms... IMO, this just g= oes to show that "doing is hard" and=0D >>> "criticising is muc= h easier" (yes, I am aware of the irony involved in=0D >>> maki= ng this statement, but someone has to!)=0D >>>=0D >>&g= t;=0D >>> Cheers,=0D >>> Igor M :-)=0D >>= =0D >> Unfortunately, M. Larabel is the only one who's performing = benchmarks on=0D >> FreeBSD, comparing its performance to the Linu= x-opponents. Adn indeed,=0D >> there is a lot of criticism, but no= alternative.=0D >> I said unfortunately - not offensive - since L= arabel and Phoronix are=0D >> sadly the only ones who do actually = such bechmarking.=0D >>=0D >> It would be much more nicer= and kind to support those people.=0D >>=0D >> Well, in J= anuary/February we get new hardware. One box is supposed to do=0D >&g= t; number crunching via 12 cores and a TESLA GPU. My colleague is=0D >= ;> developing a high parallelized peice of software for satellite data= =0D >> transformation. The software package is CPU bound, partiall= y GPU, but=0D >> massively memory hungry (96 to 128 GB RAM is need= ed).=0D >> What I can offer is, since I will also work on that mac= hine and I've=0D >> free hand to administer, in the spare time of = doing my PhD, installing=0D >> FreeBSD 9.0/10.0 besides SuSe Linux= and looking forward having one ZFS=0D >> data storage drive for h= omes, so both systems can perform on a most=0D >> recent ZFS. I'm = new to Linux, not a BSD guru, nor I'm a professional=0D >> program= mer/developer. My skills are sufficient for the daily scientific=0D >= > work. So, without pressure, I'm willing to perform some HPC benchmarks= =0D >> under advice if the day comes and those interested in bare = numbers of=0D >> FreeBSD vs. Linux performance with a real-world-s= cientific application.=0D >>=0D >> I would appreciate to = see some of the developers and/or FreeBSD hackers=0D >> to help Ph= oronix setting up a proper testenvironment instead of bashing=0D >>= ; M. Larabel and his fellows.=0D >>=0D >> Regards,=0D = >> Oliver=0D >>=0D >=0D > ______________________= _________________________=0D > freebsd-stable@freebsd.org mailing lis= t=0D > http://lists.freebsd.org/mailman/listinfo/freebsd-stable=0D > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.= org"=0D _______________________________________________=0D freebsd-pe= rformance@freebsd.org mailing list=0D http://lists.freebsd.org/mailman/l= istinfo/freebsd-performance=0D To unsubscribe, send any mail to "freebsd= -performance-unsubscribe@freebsd.org"=0D