From owner-freebsd-fs@FreeBSD.ORG Sun Nov 16 21:11:23 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9354B106568D for ; Sun, 16 Nov 2008 21:11:23 +0000 (UTC) (envelope-from ltning@anduin.net) Received: from mail.anduin.net (mail.anduin.net [213.225.74.249]) by mx1.freebsd.org (Postfix) with ESMTP id 543E88FC18 for ; Sun, 16 Nov 2008 21:11:23 +0000 (UTC) (envelope-from ltning@anduin.net) Received: from [212.62.248.147] (helo=[192.168.2.10]) by mail.anduin.net with esmtpsa (TLSv1:AES128-SHA:128) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1L1oDC-000OI8-KD; Sun, 16 Nov 2008 21:27:14 +0100 Message-Id: From: =?ISO-8859-1?Q?Eirik_=D8verby?= To: fbsd@dannysplace.net In-Reply-To: <491C9535.3030504@dannysplace.net> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v929.2) Date: Sun, 16 Nov 2008 21:27:15 +0100 References: <490A782F.9060406@dannysplace.net> <20081031033208.GA21220@icarus.home.lan> <490A849C.7030009@dannysplace.net> <20081031043412.GA22289@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> <491C5AA7.1030004@samsco.org> <491C9535.3030504@dannysplace.net> X-Mailer: Apple Mail (2.929.2) Cc: freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 16 Nov 2008 21:11:23 -0000 On Nov 13, 2008, at 21:59, Danny Carroll wrote: > Scott Long wrote: >> The Areca controller likely doesn't buffer/cache for disks in JBOD >> mode, >> as others in this thread have stated. Without buffering, simple disk >> controllers will almost always be faster than accelerated raid >> controllers because the accelerated controllers add more latency >> between >> the host and the disk. A simple controller will directly funnel data >> from the host to the disk as soon as it receives a command. An >> accelerated controller, however, has a CPU and a mini-OS on it that >> has >> to schedule the work coming from the host and handle its own tasks >> and >> interrupts. This adds latency that quickly adds up under benchmarks. >> Your numbers clearly demonstrate this. > > That's nice to know. I'm not sure it tells us why the Non-Cached > writes > were about 8% faster though. The other thing about the "NoWriteCache" > test I performed that I neglected to mention yesterday is that I > actually panic'd the box (running out of memory). This was the first > time I have had that happen with ZFS even though in previous testing > (with cache enabled) I punished the box for a lot longer. > > Perhaps the ZFS caching took over where the disk caching left off? > Could that explain why I did not see a negative difference in the > numbers between Cache enabled and Cache disabled? > > One of the questions I wanted to answer for myself was just this: > "Does > a battery-backed cache on an Areca card protect me when I am in JBOD > mode." If the Areca does not buffer/cache in JBOD mode then that > means > the answer is no. I have noticed that my 3ware controllers, after updating firmware recently, have removed the JBOD option entirely, classifying it as something you wouldn't want to do with that kind of hardware anyway. I believed then, and even more so now, they are correct. Use the RAID-0 disk trick to be able to utilize the controller cache. And regarding write-back vs write-through; I believe write-through is equvivalent to disabling controller write cache, however it WILL cache the writes in order to respond to future reads of the data being written. I would guess, but I don't know, that this also goes for disk- level caches too, though, so it probably doesn't matter. /Eirik