From owner-freebsd-current@FreeBSD.ORG Thu Dec 15 15:48:40 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E78701065670; Thu, 15 Dec 2011 15:48:40 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from smtp.utwente.nl (smtp1.utsp.utwente.nl [130.89.2.8]) by mx1.freebsd.org (Postfix) with ESMTP id 548BD8FC13; Thu, 15 Dec 2011 15:48:39 +0000 (UTC) Received: from [130.89.165.91] (nox.student.utwente.nl [130.89.165.91]) by smtp.utwente.nl (8.12.10/SuSE Linux 0.7) with ESMTP id pBFFmXD8023626; Thu, 15 Dec 2011 16:48:33 +0100 Message-ID: <4EEA16D1.2010900@degoeje.nl> Date: Thu, 15 Dec 2011 16:48:33 +0100 From: Pieter de Goeje User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:6.0.2) Gecko/20110902 Thunderbird/6.0.2 MIME-Version: 1.0 To: "O. Hartmann" References: <4EE1EAFE.3070408@m5p.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <4EE933C6.4020209@zedat.fu-berlin.de> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> In-Reply-To: <4EE9A2A0.80607@zedat.fu-berlin.de> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-UTwente-MailScanner-Information: Scanned by MailScanner. Contact icts.servicedesk@utwente.nl for more information. X-UTwente-MailScanner: Found to be clean X-UTwente-MailScanner-From: pieter@degoeje.nl X-Spam-Status: No Cc: freebsd-performance@freebsd.org, Current FreeBSD Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Dec 2011 15:48:41 -0000 Op 15-12-2011 8:32, O. Hartmann schreef: > Just saw this shot benchmark on Phoronix dot com today: > > http://www.phoronix.com/scan.php?page=news_item&px=MTAyNzA > > It may be worth to discuss the sad performance of FBSD in some parts of > the benchmark. A difference of a factor 10 or 100 is simply far beyond > disapointing, it is more than inacceptable and by just reading those > benchmarks, I'd like to drop thinking of using FreeBSD even as a backend > server in scientific and business environments. In detail, some of the > SciMark benches look disappointing. The overall image can't help over > the fact that in C-Ray FreeBSD is better performing. > > From the compiler, I'd like say there couldn't be a drop of more than 10 > - 15% in performance - but not 10 or 100 times. > > I'm just thinking about the discussion of SCHED_ULE and all the saur > spots we discussed when I stumbled over the test. > > Regards, > Oliver Detailed results here: http://openbenchmarking.org/result/1112113-AR-ORACLELIN37 As usual, the phoronix benchmarks are very misleading. 1) The linked benchmarks were not run on the same hardware. Hardware is close but not completely equal; for instance different brands of disks were used. 2) They didn't use the same compiler. This is really bad and _can_ lead to more than a factor 2 performance difference. Especially in "scientific" programs where (auto) vectorization is very important. Why on earth the benchmarker was too lazy to install a more recent GCC I have no idea. Of all the benchmarks shown only the disk benchmarks are interesting, because they actually stress the system. Unfortunately they screwed that up too because they were performed on ZFS instead of the default, plain UFS which is a lot more like EXT4 in terms of functionality. The rest are pure CPU bound userspace workloads and I bet that if they were performed using the same compiler, similar results would've been achieved (barring any major VM differences). In any case we would've been able to actually compare FreeBSD vs Oracle Linux instead of GCC 4.5 vs 4.2. Now they are useless. I'm sorry if this mail sounds a bit harsh but I'm tired of seeing phoronix making the same elementary mistakes again and again even after these have been pointed out years ago. - Pieter