From owner-freebsd-fs@FreeBSD.ORG Tue Sep 22 12:56:29 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B3BDC1065679 for ; Tue, 22 Sep 2009 12:56:29 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (chello087206049004.chello.pl [87.206.49.4]) by mx1.freebsd.org (Postfix) with ESMTP id 01ED48FC1F for ; Tue, 22 Sep 2009 12:56:28 +0000 (UTC) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id BD59D45CDC; Tue, 22 Sep 2009 14:56:26 +0200 (CEST) Received: from localhost (pdawidek.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BBC2E45CBA; Tue, 22 Sep 2009 14:56:21 +0200 (CEST) Date: Tue, 22 Sep 2009 14:56:25 +0200 From: Pawel Jakub Dawidek To: Kurt Touet Message-ID: <20090922125625.GJ6038@garage.freebsd.pl> References: <2a5e326f0909201500w1513aeb5ra644f1c748e22f34@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="VJJoKLVEFXdmHQwR" Content-Disposition: inline In-Reply-To: <2a5e326f0909201500w1513aeb5ra644f1c748e22f34@mail.gmail.com> User-Agent: Mutt/1.4.2.3i X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 8.0-CURRENT i386 X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=4.5 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS - Unable to offline drive in raidz1 based pool X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Sep 2009 12:56:29 -0000 --VJJoKLVEFXdmHQwR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Sep 20, 2009 at 04:00:10PM -0600, Kurt Touet wrote: > I am using ZFS pool based on a 4-drive raidz1 setup for storage. I > believe that one of the drives is failing, and I'd like to > remove/replace it. The drive has been causing some issues (such as > becoming non-responsive and hanging the system with timeouts), so I'd > like to offline it, and then run in degraded mode until I can grab a > new drive (tomorrow). However, when I disconnected the drive (pulled > the plug, not using a zpool offline command), the following occurred: >=20 > NAME STATE READ WRITE CKSUM > storage FAULTED 0 0 1 > raidz1 DEGRADED 0 0 0 > ad14 ONLINE 0 0 0 > ad6 UNAVAIL 0 0 0 > ad12 ONLINE 0 0 0 > ad4 ONLINE 0 0 0 >=20 > Note: That's my recreation of the output... not the actual text. >=20 > At this point, I was unable to to do anything with the pool... and all > data was inaccessible. Fortunately, the after sitting pulled for a > bit, I tried putting the failing drive back into the array, and it > booted properly. Of course, I still want to replace it, but this is > what happens when I try to take it offline: >=20 > monolith# zpool status storage > pool: storage > state: ONLINE > scrub: none requested > config: >=20 > NAME STATE READ WRITE CKSUM > storage ONLINE 0 0 0 > raidz1 ONLINE 0 0 0 > ad14 ONLINE 0 0 0 > ad6 ONLINE 0 0 0 > ad12 ONLINE 0 0 0 > ad4 ONLINE 0 0 0 >=20 > errors: No known data errors > monolith# zpool offline storage ad6 > cannot offline ad6: no valid replicas Could you send the output of: # apply "zdb -l /dev/%1" ad{4,6,12,14} --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --VJJoKLVEFXdmHQwR Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) iD8DBQFKuMl5ForvXbEpPzQRAnPIAKCjK7am3F1WUvEHMwtIeXckcy36UgCg4n/z tkqBHfYKHh2q419EqdOlBr8= =A7sR -----END PGP SIGNATURE----- --VJJoKLVEFXdmHQwR--