From owner-freebsd-fs@FreeBSD.ORG Sat Jun 22 19:16:41 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id D70B770D for ; Sat, 22 Jun 2013 19:16:41 +0000 (UTC) (envelope-from jdc@koitsu.org) Received: from relay5-d.mail.gandi.net (relay5-d.mail.gandi.net [217.70.183.197]) by mx1.freebsd.org (Postfix) with ESMTP id 9687C1A18 for ; Sat, 22 Jun 2013 19:16:41 +0000 (UTC) Received: from mfilter22-d.gandi.net (mfilter22-d.gandi.net [217.70.178.150]) by relay5-d.mail.gandi.net (Postfix) with ESMTP id CD7B041C060; Sat, 22 Jun 2013 21:16:23 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mfilter22-d.gandi.net Received: from relay5-d.mail.gandi.net ([217.70.183.197]) by mfilter22-d.gandi.net (mfilter22-d.gandi.net [10.0.15.180]) (amavisd-new, port 10024) with ESMTP id JhwKs5IZX2Hl; Sat, 22 Jun 2013 21:16:22 +0200 (CEST) X-Originating-IP: 76.102.14.35 Received: from jdc.koitsu.org (c-76-102-14-35.hsd1.ca.comcast.net [76.102.14.35]) (Authenticated sender: jdc@koitsu.org) by relay5-d.mail.gandi.net (Postfix) with ESMTPSA id D6F8441C056; Sat, 22 Jun 2013 21:16:21 +0200 (CEST) Received: by icarus.home.lan (Postfix, from userid 1000) id C31ED73A1C; Sat, 22 Jun 2013 12:16:19 -0700 (PDT) Date: Sat, 22 Jun 2013 12:16:19 -0700 From: Jeremy Chadwick To: John Subject: Re: Dell R710 with PERC H310. GPT issues and hardware raid or ZFS? Message-ID: <20130622191619.GA73246@icarus.home.lan> References: <51C5B4EE.3010601@growveg.net> <81EDE2A7D67241DAB985C38662DA57DD@multiplay.co.uk> <51C5EAB0.7040009@growveg.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <51C5EAB0.7040009@growveg.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Jun 2013 19:16:41 -0000 On Sat, Jun 22, 2013 at 07:19:28PM +0100, John wrote: > Hello, thank you for your reply. > > On 22/06/2013 18:48, Steven Hartland wrote: > > I see you have an dell + mfi controller, there was an important FW update > > released a week or so back do ensure you have that installed or you'll > > suffer from nasty IO stalls. > > Thats... thats what I was seeing!!! I was running a svn update for ports > and svn just sat there like a piece of cheese in a state of wdrain > according to top. > > OK so firstly I need to update the controller. After some googling I > found this site https://calomel.org/zfs_raid_speed_capacity.html where > they "raid0" each disk to take advantage of the controller, but it seems > (so far) with my controller that once hardware raid is enabled it can't > be disabled. It does not allow the opportunity to make one raid0 disk > from one disk and then go to another disk to do the same. Maybe I should > do it with the first one then let zfs do the remaining three. 1. I would recommend you avoid use of the controller entirely. Get yourself a different controller that doesn't do RAID and use that. If you can disable the on-board controller in the BIOS, and pick yourself up a Supermicro AOC-USAS2-L8e HBA (around US$140) and use that (or even a siis(4) controller (around US$30)), you'd be better off. http://www.supermicro.com/products/accessories/addon/AOC-USAS2-L8i.cfm?TYP=E This uses the mps(4) driver. I'm intentionally keeping this terse rather than going into the different HBA types (ex. the 2108 uses mfi(4) (avoid please), and there are other models which do RAID but some which can have RAID disabled by using a different "version" of firmware (have to ask Technical Support for it, etc.). 2. The "make each disk a RAID 0 volume" has caveats which the author of that article does not disclose. One of the biggest is if you plan on using SSDs with the controller -- you won't be able to get TRIM/UNMAP support (via SCSI commands 0x85 (PASS-THROUGH-16) or 0xa1 (PASS-THROUGH-12) doing that, which will hurt you **big time**. It probably varies per controller, but it's proof that using a non-RAID controller is always the way to go with ZFS. Proof of the "RAID 0 volume per disk" crap: http://lists.freebsd.org/pipermail/freebsd-stable/2013-June/073680.html -- | Jeremy Chadwick jdc@koitsu.org | | UNIX Systems Administrator http://jdc.koitsu.org/ | | Making life hard for others since 1977. PGP 4BD6C0CB |