From owner-freebsd-fs@FreeBSD.ORG Thu May 19 23:09:51 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28E2D1065673 for ; Thu, 19 May 2011 23:09:51 +0000 (UTC) (envelope-from pawel@dawidek.net) Received: from mail.garage.freebsd.pl (60.wheelsystems.com [83.12.187.60]) by mx1.freebsd.org (Postfix) with ESMTP id C610E8FC18 for ; Thu, 19 May 2011 23:09:50 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 7F10D45E86; Fri, 20 May 2011 01:09:48 +0200 (CEST) Received: from localhost (89-73-195-149.dynamic.chello.pl [89.73.195.149]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 4B3D145CDC; Fri, 20 May 2011 01:09:43 +0200 (CEST) Date: Fri, 20 May 2011 01:09:21 +0200 From: Pawel Jakub Dawidek To: Per von Zweigbergk Message-ID: <20110519230921.GF2100@garage.freebsd.pl> References: <85EC77D3-116E-43B0-BFF1-AE1BD71B5CE9@itassistans.se> <20110519181436.GB2100@garage.freebsd.pl> <4DD5A1CF.70807@itassistans.se> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="OZkY3AIuv2LYvjdk" Content-Disposition: inline In-Reply-To: <4DD5A1CF.70807@itassistans.se> X-OS: FreeBSD 9.0-CURRENT amd64 User-Agent: Mutt/1.5.21 (2010-09-15) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-0.6 required=4.5 tests=BAYES_00,RCVD_IN_SORBS_DUL autolearn=no version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: HAST + ZFS self healing? Hot spares? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 May 2011 23:09:51 -0000 --OZkY3AIuv2LYvjdk Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, May 20, 2011 at 01:03:43AM +0200, Per von Zweigbergk wrote: > Very well, that is how failures are handled. But how do we *recover* > from a disk failure? Without taking the entire server down that is. HAST opens local disk only when changing role to primary or changing role to secondary and accepting connection from primary. If your disk fails, switch to init for that HAST device, replace you disk, call 'hastctl create ' and switch back to primary or secondary. > I already know how to deal with my HBA to hot-add and hot-remove > devices. And how to deal with hardware failures on the *secondary* > node seems fairly straightforward, after all, it doesn't really > matter if the mirroring becomes degraded for a few seconds while I > futz around with restarting hastd and such. The primary sees the > secondary disappear a few seconds, when it comes back, it will just > truck all of the dirty data over. Big deal. You don't need to restart hastd or stop secondary. Just use hastctl to change role to init for the failing resource. > But what if the drive fails on the primary side? On the primary > server I can't just restart hastd at my leisure, the underlying > filesystem relies on it not going away. Ideally I'd want to just be > able to tell hast that "hey, there's a new drive you can use, just > suck over all the data from the secondary onto this drive, and route > I/O from the secondary in the meantime" - without restarting hastd. > Is this possible? Yes. > These unresolved questions is why I would feel safer in simply > running ZFS on the metal and running HAST on Zvols. :-) If running > ZFS on top of a Zvol is a bad idea, there is always the option of > simply exporting the HAST resource backed by Zvols as an iSCSI > target and run VMFS on the drives. But that does mean losing some of > the cooler features of ZFS which is a shame. I'd suggest to test configuration that seems best in theory and then see if it works for your or not. If not, then we can wonder what to do next. --=20 Pawel Jakub Dawidek http://www.wheelsystems.com FreeBSD committer http://www.FreeBSD.org Am I Evil? Yes, I Am! http://yomoli.com --OZkY3AIuv2LYvjdk Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (FreeBSD) iEYEARECAAYFAk3VoyEACgkQForvXbEpPzRFBQCeJxsKlLR3h7/8+X9nHfVmKpXO EzIAoJWya2Cp6o58JnOENxViv3QRFkPX =tjW/ -----END PGP SIGNATURE----- --OZkY3AIuv2LYvjdk--