From owner-freebsd-stable@FreeBSD.ORG Fri Aug 20 11:12:10 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E782F10656A3 for ; Fri, 20 Aug 2010 11:12:10 +0000 (UTC) (envelope-from olivier@gid0.org) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id BB4C68FC17 for ; Fri, 20 Aug 2010 11:12:10 +0000 (UTC) Received: by iwn36 with SMTP id 36so3283284iwn.13 for ; Fri, 20 Aug 2010 04:12:10 -0700 (PDT) MIME-Version: 1.0 Received: by 10.231.172.83 with SMTP id k19mr1356046ibz.114.1282301299264; Fri, 20 Aug 2010 03:48:19 -0700 (PDT) Received: by 10.231.176.140 with HTTP; Fri, 20 Aug 2010 03:48:19 -0700 (PDT) In-Reply-To: References: Date: Fri, 20 Aug 2010 12:48:19 +0200 Message-ID: From: Olivier Smedts To: Heinrich Rebehn Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-stable@freebsd.org Subject: Re: ZFS performance question X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Aug 2010 11:12:11 -0000 2010/8/20 Heinrich Rebehn : > Hi all, > > After setting up our new server (Intel Q9550 CPU, 8GB RAM, 4 x ST31000340= NS) i did a bonnie++ benchmark on the zfs raidz that i created on 4 partiti= ons on the 4 disks. > > root@antsrv4 [/data/nocompression] # bonnie++ -u root -d . > Using uid:0, gid:0. > Writing a byte at a time...done > Writing intelligently...done > Rewriting...done > Reading a byte at a time...done > Reading intelligently...done > start 'em...done...done...done...done...done... > Create files in sequential order...done. > Stat files in sequential order...done. > Delete files in sequential order...done. > Create files in random order...done. > Stat files in random order...done. > Delete files in random order...done. > Version =A01.96 =A0 =A0 =A0 ------Sequential Output------ --Sequential In= put- --Random- > Concurrency =A0 1 =A0 =A0 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block= -- --Seeks-- > Machine =A0 =A0 =A0 =A0Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec= %CP =A0/sec %CP > antsrv4.ant.uni 16G =A0 =A094 =A081 151823 =A039 100780 =A027 =A0 303 =A0= 99 239853 =A030 148.3 =A0 4 > Latency =A0 =A0 =A0 =A0 =A0 =A0 =A04733ms =A0 =A06051ms =A0 =A08173ms =A0= 37504us =A0 =A0 917ms =A0 =A01030ms > Version =A01.96 =A0 =A0 =A0 ------Sequential Create------ --------Random = Create-------- > antsrv4.ant.uni-bre -Create-- --Read--- -Delete-- -Create-- --Read--- -De= lete-- > =A0 =A0 =A0 =A0 =A0 =A0 =A0files =A0/sec %CP =A0/sec %CP =A0/sec %CP =A0/= sec %CP =A0/sec %CP =A0/sec %CP > =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 16 24183 =A097 +++++ +++ 21715 =A098 1720= 9 =A098 +++++ +++ 21291 =A097 > Latency =A0 =A0 =A0 =A0 =A0 =A0 19779us =A0 =A0 128us =A0 =A0 162us =A0 3= 9671us =A0 =A0 =A038us =A0 =A0 =A077us > 1.96,1.96,antsrv4.ant.uni-bremen.de,1,1282303232,16G,,94,81,151823,39,100= 780,27,303,99,239853,30,148.3,4,16,,,,,24183,97,+++++,+++,21715,98,17209,98= ,+++++,+++,21291,97, 733ms,6051ms,8173ms,37504us,917ms,1030ms,19779us,128us= ,162us,39671us,38us,77us > > > I am somewhat concerned about the numbers for per-char-output and per-cha= r-input. In fact, i have never before seen that low numbers in a bonnie tes= t. Using a single disk with UFS yields about 6 times as much. > > > I know that this is not crucial for a normal file server, but i want to r= ule out any configuration errors. > > Is this normal for ZFS?. Disks are accessed using ahci. I did not attempt= any tuning yet. Can you try without AHCI ? http://www.phoronix.com/scan.php?page=3Darticle&item=3Dfreebsd_zfs_cam&num= =3D5 > BTW: Running OpenSolaris on the same hardware yields 110306 for per-char-= write and 94698 for per-char-read. > > --Heinrich > > > Heinrich Rebehn > > University of Bremen > Physics / Electrical and Electronics Engineering > - Department of Telecommunications - > > Phone : +49/421/218-62394 > Fax =A0 : =A0 =A0 =A0 =A0 =A0 =A0-3341 > > > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > --=20 Olivier Smedts=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0=A0 _ =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0= =A0 ASCII ribbon campaign ( ) e-mail: olivier@gid0.org=A0 =A0 =A0 =A0 - against HTML email & vCards=A0 X www: http://www.gid0.org=A0 =A0 - against proprietary attachments / \ =A0 "Il y a seulement 10 sortes de gens dans le monde : =A0 ceux qui comprennent le binaire, =A0 et ceux qui ne le comprennent pas."