From owner-freebsd-questions@FreeBSD.ORG Mon Jan 26 22:58:31 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1AE7C10657E1 for ; Mon, 26 Jan 2009 22:58:31 +0000 (UTC) (envelope-from bryant.eadon@gmail.com) Received: from mail-qy0-f17.google.com (mail-qy0-f17.google.com [209.85.221.17]) by mx1.freebsd.org (Postfix) with ESMTP id B21D08FC20 for ; Mon, 26 Jan 2009 22:58:30 +0000 (UTC) (envelope-from bryant.eadon@gmail.com) Received: by qyk10 with SMTP id 10so9602937qyk.19 for ; Mon, 26 Jan 2009 14:58:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to :user-agent:mime-version:to:subject:content-type :content-transfer-encoding; bh=Fg2o8Z8hFaT1IuDbO4fuW+aV6pH6IAq2jv8JYi8dzvk=; b=Da9HiXb/7rU2cDbxtI8NBZZj5ay/VHWCbj16PzJV28haBWZ7QJIMPhQco/6xZwJNax V/zfj68HNPxuZgMQqq4zIWWwGDDA+/HebWJZY2DDLZpygxqMaMD3ISYYWInaPnHYKv4+ 9RyCm56pzBzRk1jfLIWM/g/4y9tgk1gP0ZMw0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:reply-to:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; b=M2gmOEzkZ2DoLHRkL6NkHlhNp4PZup49trrjLyCZV5Xs+CqTX7tsvMMVZu6A6Eg6yZ MaHyQXO5uelwQQKceQsw8EwdWHkt718q+AxokDSc5CVs/EOs916TMssDI7rEHTH3uK7L SDDVIy+KZub/OV+3gH3dIBU1srsvYsVD3O4ic= Received: by 10.214.181.17 with SMTP id d17mr12473049qaf.355.1233008890795; Mon, 26 Jan 2009 14:28:10 -0800 (PST) Received: from ?192.168.1.202? (itsf207.itsnpt.com [64.119.85.207]) by mx.google.com with ESMTPS id 2sm830284qwi.20.2009.01.26.14.28.09 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 26 Jan 2009 14:28:09 -0800 (PST) Message-ID: <497E38F7.9010405@gmail.com> Date: Mon, 26 Jan 2009 17:28:07 -0500 From: Bryant Eadon User-Agent: Thunderbird 2.0.0.19 (Windows/20081209) MIME-Version: 1.0 To: FreeBSD Questions Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: danging dbufs in ZFS v6 , FreeBSD 7.1 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: bryant.eadon@gmail.com List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Jan 2009 22:58:31 -0000 A problem I'm hoping you can solve ! Running on a 64bit platform with 5, 500GB HDDs in a basic raidz configuration classically named 'tank', I began copying a file. During the copy, I lost a disk. Since these are all hot swappable SATA drives, I pulled the one I *thought* had died and swapped in a good drive, which powered up and I attempted a 'replace'. The copy was still proceeding... (you see where this is going...) This wasn't the broken drive I pulled, which I quickly found after the replace attempt ! In an effort to put the good drive back into the array, I reconnected and rebooted the machine citing possible 'drive disappearance' problems with the stunt I just pulled. Nothing doing. The kernel hung at : "panic : dangling dbufs. dn = 0xffffff000a49f338 dbuf = 0xffffff000a4a01e0 " Leading me to believe the array is dead. :-/ I am happy to lose the data that was copied at the time of failure if it's possible to recover the rest of the array. I suppose that the rest of the data remains intact. Is there a way to rid myself of the dangling buffers to get back to a usable state ? (some dd magic ?) Could I recover by using a newer version of ZFS for FreeBSD ? (v13 instead of v v6) Quickly it moved from : NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz1 DEGRADED 0 0 0 da0 ONLINE 0 0 0 da1 UNAVAIL 0 887 0 cannot open da2 ONLINE 0 0 0 ad5 ONLINE 0 0 0 ad6 ONLINE 0 0 0 to : NAME STATE READ WRITE CKSUM tank UNAVAIL 0 0 0 insufficient replicas raidz1 UNAVAIL 0 0 0 insufficient replicas da0 UNAVAIL 0 0 0 cannot open da1 UNAVAIL 0 0 0 cannot open da2 ONLINE 0 0 0 ad5 ONLINE 0 0 0 ad6 ONLINE 0 0 0