From owner-freebsd-stable@FreeBSD.ORG Wed Jul 21 05:57:26 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CAFD61065679 for ; Wed, 21 Jul 2010 05:57:26 +0000 (UTC) (envelope-from alanbryan1234@yahoo.com) Received: from web50502.mail.re2.yahoo.com (web50502.mail.re2.yahoo.com [206.190.38.78]) by mx1.freebsd.org (Postfix) with SMTP id 6AA9D8FC08 for ; Wed, 21 Jul 2010 05:57:26 +0000 (UTC) Received: (qmail 39212 invoked by uid 60001); 21 Jul 2010 05:57:25 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1279691845; bh=25RV+40Ps1uhG/YJwfF127pEps2rJbxy5yLwM5rN/wY=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=pxqTu9tYP/BtjCMVdstgM4MK7YjGEqCLWORmxdQDWoSjOhOekFhTJaDDvG1gAz1wgIg3VcdRt34tb+TgCOzGkKsyJeW1sstbkb8fHhvuTtxf4768ocTKzV1MaaUzYP0S/qo2ULaqU1GK4mFaOEHiNjbgtfta5rVj9oETyb/Ad9A= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=sfzt3+5v3LH7nyleIAPaj4f1zyh6ufhghvFaLqnr96QS+aipUN5nMuwvenuDU86iu0ZEHjc+lTP7X1otZramKCwzYUEifIlmQfb5BKSvcHKFqenB/BiJ70bvNmQa94m6HJIATb8mJlm37YzFZMyiHA9JbMunfL67RHAyHqbJ+0I=; Message-ID: <578438.38753.qm@web50502.mail.re2.yahoo.com> X-YMail-OSG: 0pcScCwVM1mJiPPrGvyI.yobcmF49wUYGMeB7nK9thAu5cj seoOIfrCIW6QfCZ3kwoH95za37_5.rj558NdptwIIRY0Ec.XJoFvwNLvHs6B qF4XA7k0itZJagcub9M.RqhE6cmBDU8f66XU6XTFec1kpmnV9jLIC4ZYMV4Y cpOYThaVZi9m6s9PMlrEEX1qXbgt.zlCRvsfoYfydfMjE7H1vj_UX.f8utwF MoW5BJ4azBu5QSWY4ZubsNHA3kToWoblEg9yruDIqGuBVU9_ACZRnTFH8fSj ICACTOlV80MarFmH1ohgbbMLfOSHrIfIC.VGQPROTVh.n3EjnQui0.ecDk5w 7oDbM_b5GcAxBCIImqUnTo62V1aamkAGC Received: from [68.4.245.43] by web50502.mail.re2.yahoo.com via HTTP; Tue, 20 Jul 2010 22:57:25 PDT X-Mailer: YahooMailClassic/11.2.4 YahooMailWebService/0.8.104.276605 Date: Tue, 20 Jul 2010 22:57:25 -0700 (PDT) From: alan bryan To: Freddie Cash , Dan Langille In-Reply-To: <4C4504DF.30602@langille.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-stable Subject: Re: Problems replacing failing drive in ZFS pool X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jul 2010 05:57:27 -0000 =0A=0A--- On Mon, 7/19/10, Dan Langille wrote:=0A=0A> Fr= om: Dan Langille =0A> Subject: Re: Problems replacing fai= ling drive in ZFS pool=0A> To: "Freddie Cash" =0A> Cc: "= freebsd-stable" =0A> Date: Monday, July 19, 201= 0, 7:07 PM=0A> On 7/19/2010 12:15 PM, Freddie Cash=0A> wrote:=0A> > On Mon,= Jul 19, 2010 at 8:56 AM, Garrett Moore=A0=0A> wrot= e:=0A> >> So you think it's because when I switch from the=0A> old disk to = the new disk,=0A> >> ZFS doesn't realize the disk has changed, and=0A> thin= ks the data is just=0A> >> corrupt now? Even if that happens, shouldn't the= =0A> pool still be available,=0A> >> since it's RAIDZ1 and only one disk ha= s gone=0A> away?=0A> > =0A> > I think it's because you pull the old drive, = boot with=0A> the new drive,=0A> > the controller re-numbers all the device= s (ie da3 is=0A> now da2, da2 is=0A> > now da1, da1 is now da0, da0 is now = da6, etc), and ZFS=0A> thinks that all=0A> > the drives have changed, thus = corrupting the=0A> pool.=A0 I've had this=0A> > happen on our storage serve= rs a couple of times before=0A> I started using=0A> > glabel(8) on all our = drives (dead drive on RAID=0A> controller, remove=0A> > drive, reboot for w= hatever reason, all device nodes=0A> are renumbered,=0A> > everything goes = kablooey).=0A> =0A> Can you explain a bit about how you use glabel(8) in=0A= > conjunction with ZFS?=A0 If I can retrofit this into an=0A> exist ZFS arr= ay to make things easier in the future...=0A> =0A> 8.0-STABLE #0: Fri Mar= =A0 5 00:46:11 EST 2010=0A> =0A> ]# zpool status=0A> =A0 pool: storage=0A> = state: ONLINE=0A> scrub: none requested=0A> config:=0A> =0A> =A0 =A0 =A0 = =A0 NAME=A0 =A0 =A0 =A0=0A> STATE=A0 =A0=A0=A0READ WRITE CKSUM=0A> =A0 =A0 = =A0 =A0 storage=A0=0A> =A0=A0=A0ONLINE=A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A00= =A0=0A> =A0=A0=A00=0A> =A0 =A0 =A0 =A0 =A0 raidz1=A0 =A0=0A> ONLINE=A0 =A0 = =A0=A0=A00=A0=0A> =A0=A0=A00=A0 =A0=A0=A00=0A> =A0 =A0 =A0 =A0 =A0 =A0 ad8= =A0=0A> =A0=A0=A0ONLINE=A0 =A0=0A> =A0=A0=A00=A0 =A0=A0=A00=A0=0A> =A0=A0= =A00=0A> =A0 =A0 =A0 =A0 =A0 =A0 ad10=A0 =A0=0A> ONLINE=A0 =A0 =A0=A0=A00= =A0=0A> =A0=A0=A00=A0 =A0=A0=A00=0A> =A0 =A0 =A0 =A0 =A0 =A0 ad12=A0 =A0=0A= > ONLINE=A0 =A0 =A0=A0=A00=A0=0A> =A0=A0=A00=A0 =A0=A0=A00=0A> =A0 =A0 =A0 = =A0 =A0 =A0 ad14=A0 =A0=0A> ONLINE=A0 =A0 =A0=A0=A00=A0=0A> =A0=A0=A00=A0 = =A0=A0=A00=0A> =A0 =A0 =A0 =A0 =A0 =A0 ad16=A0 =A0=0A> ONLINE=A0 =A0 =A0=A0= =A00=A0=0A> =A0=A0=A00=A0 =A0=A0=A00=0A> =0A> > Of course, always have good= backups.=A0 ;)=0A> =0A> In my case, this ZFS array is the backup.=A0 ;)=0A= > =0A> But I'm setting up a tape library, real soon now....=0A> =0A> -- Dan= Langille - http://langille.org/=0A> ______________________________________= _________=0A> freebsd-stable@freebsd.org=0A> mailing list=0A> http://lists.= freebsd.org/mailman/listinfo/freebsd-stable=0A> To unsubscribe, send any ma= il to "freebsd-stable-unsubscribe@freebsd.org"=0A> =0A=0ADan,=0A=0AHere's h= ow to do it after the fact:=0A=0Ahttp://unix.derkeiler.com/Mailing-Lists/Fr= eeBSD/current/2009-07/msg00623.html=0A=0A--Alan Bryan=0A=0A=0A=0A=0A=0A =