From owner-freebsd-questions@FreeBSD.ORG Fri Jun 1 16:24:35 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 669301065676 for ; Fri, 1 Jun 2012 16:24:34 +0000 (UTC) (envelope-from Albert.Shih@obspm.fr) Received: from smtp-int-m.obspm.fr (smtp-int-m.obspm.fr [145.238.187.15]) by mx1.freebsd.org (Postfix) with ESMTP id 9534C8FC0A for ; Fri, 1 Jun 2012 16:24:33 +0000 (UTC) Received: from pcjas.obspm.fr (pcjas.obspm.fr [145.238.184.233]) by smtp-int-m.obspm.fr (8.14.3/8.14.3/SIO Observatoire de Paris - 07/2009) with ESMTP id q51GOVQe001007 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT); Fri, 1 Jun 2012 18:24:32 +0200 Date: Fri, 1 Jun 2012 18:24:31 +0200 From: Albert Shih To: Wojciech Puchar Message-ID: <20120601162431.GA44290@pcjas.obspm.fr> References: <20120601052309.GA32942@pcjas.obspm.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-Miltered: at smtp-int-m.obspm.fr with ID 4FC8ECBF.000 by Joe's j-chkmail (http : // j-chkmail dot ensmp dot fr)! X-j-chkmail-Enveloppe: 4FC8ECBF.000/145.238.184.233/pcjas.obspm.fr/pcjas.obspm.fr/ Cc: freebsd-questions@freebsd.org, Oscar Hodgson Subject: Re: Anyone using freebsd ZFS for large storage servers? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 01 Jun 2012 16:24:35 -0000 Le 01/06/2012 ? 18:17:38+0200, Wojciech Puchar a écrit > > i dare not to agree about "very fast". very fast is relative term. how did > you configured your storage? > > trivial test: > > make 10 100GB files (so none fits in RAM) by > > for x in 0 1 2 3 4 5 6 7 8 9;do ( dd if=/dev/zero of=testfile$x bs=1m > count=100k &) ;done > > measure time needed for it to finish (all dd processes exist) > > then install /usr/ports/benchmark/randomio and do some tests of random > reads on that files. > > and final test - 10 randomio in parallel with 10 threads each, one per > every file. > > then sum up results (IOPS) and divide by amount of disks you have. > > then decide if is it fast or slow :) When I say fast that's mean I already do some benchmarks with iozone. And do some graphs to see what the performance are. What I can say is it's go lot faster than H700+ 12 disk 600 15k/min. And I do those tests on FreeBSD with 12 disk, 24 disk, 36 disk and finaly 48 disk. All I can say is ZFS go faster than 12 disk with H700 (and ext3) almost every time. If you like I can privalty send you the url of those graph. Just ask me, > >>        Eat lot of Ram > > can be controlled by settings in loader.conf. Yes, but I think that's not a good idea to buy a server with 4 Go and make him manage 100To through ZFS.... Regards. JAS -- Albert SHIH DIO bâtiment 15 Observatoire de Paris 5 Place Jules Janssen 92195 Meudon Cedex Téléphone : 01 45 07 76 26/06 86 69 95 71 xmpp: jas@jabber.obspm.fr Heure local/Local time: ven 1 jui 2012 18:18:55 CEST