From owner-freebsd-questions@freebsd.org Fri Jun 3 10:48:04 2016 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ABE9EB68AE7 for ; Fri, 3 Jun 2016 10:48:04 +0000 (UTC) (envelope-from steve@sohara.org) Received: from uk1mail2513.mymailbank.co.uk (UK1MAIL2513-PERMANET.IE.mymailbank.co.uk [217.69.47.44]) by mx1.freebsd.org (Postfix) with ESMTP id 294B2188A for ; Fri, 3 Jun 2016 10:48:03 +0000 (UTC) (envelope-from steve@sohara.org) Received: from smtp.lan.sohara.org (UnknownHost [88.151.27.41]) by uk1mail2513-d.mymailbank.co.uk with SMTP; Fri, 3 Jun 2016 11:47:31 +0100 Received: from [192.168.63.1] (helo=steve.lan.sohara.org) by smtp.lan.sohara.org with smtp (Exim 4.86_2 (FreeBSD)) (envelope-from ) id 1b8mds-000PKQ-UH; Fri, 03 Jun 2016 10:47:53 +0000 Date: Fri, 3 Jun 2016 11:47:46 +0100 From: Steve O'Hara-Smith To: Julien Cigar Cc: freebsd-questions@freebsd.org Subject: Re: redundant storage Message-Id: <20160603114746.6b75e6e79ecd51fe14311e40@sohara.org> In-Reply-To: <20160603101446.GM95511@mordor.lan> References: <20160603083843.GK95511@mordor.lan> <20160603104138.fdf3c0ac4be93769be6da401@sohara.org> <20160603101446.GM95511@mordor.lan> X-Mailer: Sylpheed 3.5.0 (GTK+ 2.24.29; amd64-portbld-freebsd10.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Jun 2016 10:48:04 -0000 On Fri, 3 Jun 2016 12:14:46 +0200 Julien Cigar wrote: > On Fri, Jun 03, 2016 at 10:41:38AM +0100, Steve O'Hara-Smith wrote: > > Hi, > > > > Just one change - don't use RAID1 use ZFS mirrors. ZFS does > > better RAID than any hardware controller. > > right.. I must admit that I haven't looked at ZFS yet (I'm still using > UFS + gmirror), but it will be the opportunity to do so..! > > Does ZFS play well with HAST? Never tried it but it should work well enough, ZFS sits on top of geom providers so it should be possible to use the pool on the primary. One concern would be that since all reads come from local storage the secondary machine never gets scrubbed and silent corruption never gets detected on the secondary. A periodic (say weekly) switch over and scrub takes care of this concern. Silent corruption is rare, but the bigger the pool and the longer it's used the more likely it is to happen eventually, detection and repair of this is one of ZFSs advantages over hardware RAID so it's good not to defeat it. Drive failures on the primary will wind up causing both the primary and the secondary to be rewritten when the drive is replaced - this could probably be avoided by switching primaries and letting HAST deal with the replacement. Another very minor issue would be that any corrective rewrites (for detected corruption) will happen on both copies but that's harmless and there really should be *very* few of these. One final concern, but it's HAST purely and not really ZFS. Writing a large file flat out will likely saturate your LAN with half the capacity going to copying the data for HAST. A private backend link between the two boxes would be a good idea (or 10 gigabit ethernet). > > On Fri, 3 Jun 2016 10:38:43 +0200 > > Julien Cigar wrote: > > > > > Hello, > > > > > > I'm looking for a low-cost redundant HA storage solution for our > > > (small) team here (~30 people). It will be used to store files > > > generated by some webapps, to provide a redundant dovecot (imap) > > > server, etc. > > > > > > For the hardware I have to go with HP (no choice), so I planned to buy > > > 2 x HP ProLiant DL320e Gen8 v2 E3-1241v3 (768645-421) with > > > 4 x WD Hard Drive Re SATA 4TB 3.5in 6gb/s 7200rpm 64MB Buffer > > > (WD4000FYYZ) in a RAID1 config (the machine has a smartarray P222 > > > controller, which is apparently supported by the ciss driver) > > > > > > On the FreeBSD side I plan to use HAST with CARP, and the volumes > > > will be exported through NFS4. > > > > > > Any comments on this setup (or other recommendations) ? :) > > > > > > Thanks! > > > Julien > > > > > > > > > -- > > Steve O'Hara-Smith > > > -- Steve O'Hara-Smith | Directable Mirror Arrays C:>WIN | A better way to focus the sun The computer obeys and wins. | licences available see You lose and Bill collects. | http://www.sohara.org/