Date: Tue, 20 Dec 2011 17:37:29 -0800 From: <matthew@phoronix.com> To: "Adrian Chadd" <adrian@freebsd.org> Cc: FreeBSD Stable Mailing List <freebsd-stable@freebsd.org>, Current FreeBSD <freebsd-current@freebsd.org>, Igor Mozolevsky <igor@hybrid-lab.co.uk>, freebsd-performance@freebsd.org, "O. Hartmann" <ohartman@zedat.fu-berlin.de>, Jeremy Chadwick <freebsd@jdc.parodius.com> Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server Message-ID: <20111221013733.BDE8E106566B@hub.freebsd.org> In-Reply-To: <CAJ-Vmo=sJGoCnuZr40ZVHccBbhovvq=Nwzm4Z37kSd%2BjWuMNqg@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
The benchmarks themselves are versioned. So in general most of the
av= ailable versions of PTS itself should be fine. PTS can be
considered = an execution shell that doesn't affect the benchmark
itself.
Note th= at you'll download a pile of the benchmarks, build and
install them. = Then you run about 49 individual steps.
Matthew
-- Sent from my HP Pre3
_________________________________________________________________
On Dec 20, 2011 5:30 PM, Adrian Chadd <adrian@freebsd.org>= ; wrote:
Is there a specific version of the test suite that = should be used,
to=0D
compare against the published results?=0D
=0D=0D
Adrian=0D
=0D
On 20 December 2011 17:18, Matthew Tippett <= ;matthew@phoronix.com>
wrote:=0D
> For such a system, the greatest= immediate value would be to attempt
to=0D
> reproduce the benchmarks= in question.=0D
>=0D
> Install PTS from www.phoronix-test-suit= e.com or freshports.org.=0D
>=0D
> Run the benchmark against th= ose used in the article=0D
>=0D
> =C2=A0 =C2=A0phoronix-test-su= ite benchmark
1112113-AR-ORACLELIN37=0D
>=0D
> You will be aske= d to push the comparison up to openbenchmarking at
the end.=0D
>=0D> Matthew=0D
>=0D
>=0D
> On 12/20/2011 01:39 PM, O. = Hartmann wrote:=0D
>>=0D
>> On 12/20/11 21:20, Igor Mozol= evsky wrote:=0D
>>>=0D
>>> Interestingly, while peo= ple seem to be (arguably rightly)
focused on=0D
>>> criticising= Phoronix's benchmarking, nobody has offered an
alternative=0D
>>&= gt; benchmark; and while (again, arguably rightly) it is
important to=0D
>>> benchmark real world performance, equally, nobody has offered=
any=0D
>>> numbers in relation to, for example, HTTP or SMTP, = or any other
"real=0D
>>> world"-application torture tests done= on the aforementioned
two=0D
>>> platforms... IMO, this just g= oes to show that "doing is hard"
and=0D
>>> "criticising is muc= h easier" (yes, I am aware of the irony
involved in=0D
>>> maki= ng this statement, but someone has to!)=0D
>>>=0D
>>&g= t;=0D
>>> Cheers,=0D
>>> Igor M :-)=0D
>>= =0D
>> Unfortunately, M. Larabel is the only one who's performing =
benchmarks on=0D
>> FreeBSD, comparing its performance to the Linu= x-opponents. Adn
indeed,=0D
>> there is a lot of criticism, but no= alternative.=0D
>> I said unfortunately - not offensive - since L= arabel and Phoronix
are=0D
>> sadly the only ones who do actually = such bechmarking.=0D
>>=0D
>> It would be much more nicer= and kind to support those people.=0D
>>=0D
>> Well, in J= anuary/February we get new hardware. One box is
supposed to do=0D
>&g= t; number crunching via 12 cores and a TESLA GPU. My colleague
is=0D
>= ;> developing a high parallelized peice of software for satellite
data= =0D
>> transformation. The software package is CPU bound, partiall= y GPU,
but=0D
>> massively memory hungry (96 to 128 GB RAM is need= ed).=0D
>> What I can offer is, since I will also work on that mac= hine and
I've=0D
>> free hand to administer, in the spare time of = doing my PhD,
installing=0D
>> FreeBSD 9.0/10.0 besides SuSe Linux= and looking forward having one
ZFS=0D
>> data storage drive for h= omes, so both systems can perform on a
most=0D
>> recent ZFS. I'm = new to Linux, not a BSD guru, nor I'm a
professional=0D
>> program= mer/developer. My skills are sufficient for the daily
scientific=0D
>= > work. So, without pressure, I'm willing to perform some HPC
benchmarks= =0D
>> under advice if the day comes and those interested in bare =
numbers of=0D
>> FreeBSD vs. Linux performance with a real-world-s= cientific
application.=0D
>>=0D
>> I would appreciate to = see some of the developers and/or FreeBSD
hackers=0D
>> to help Ph= oronix setting up a proper testenvironment instead of
bashing=0D
>>= ; M. Larabel and his fellows.=0D
>>=0D
>> Regards,=0D
= >> Oliver=0D
>>=0D
>=0D
> ______________________= _________________________=0D
> freebsd-stable@freebsd.org mailing lis= t=0D
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable=0D
> To unsubscribe, send any mail to
"freebsd-stable-unsubscribe@freebsd.= org"=0D
_______________________________________________=0D
freebsd-pe= rformance@freebsd.org mailing list=0D
http://lists.freebsd.org/mailman/l= istinfo/freebsd-performance=0D
To unsubscribe, send any mail to "freebsd=
-performance-unsubscribe@freebsd.org"=0D
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20111221013733.BDE8E106566B>