From owner-freebsd-questions@FreeBSD.ORG Thu Nov 5 03:04:13 2009 Return-Path: Delivered-To: questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6E81B106568F for ; Thu, 5 Nov 2009 03:04:13 +0000 (UTC) (envelope-from steven.samuel.cole@gmail.com) Received: from mail-yw0-f178.google.com (mail-yw0-f178.google.com [209.85.211.178]) by mx1.freebsd.org (Postfix) with ESMTP id 1DD9E8FC26 for ; Thu, 5 Nov 2009 03:04:12 +0000 (UTC) Received: by ywh8 with SMTP id 8so7226482ywh.3 for ; Wed, 04 Nov 2009 19:04:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from :user-agent:mime-version:to:subject:references:in-reply-to :content-type:content-transfer-encoding; bh=iTcMpU/R1Am4P3NMFvI15p7pLHswwKsySPg/iOhfmZk=; b=tIll0CKtQEC65KNBYtUiKWLzXA6PHuQLqBSoZJ8LQb069fsRE295BzzTlSaudwVtfj V6ekC6idhllBon/ya3/0qnDer9xb0nPR9rVN4+qs1FuEz2Od35MY4+dstI4UM70i26FI DVz5JRaiBNDuYLffErVbGvizaAjeo1jkzrdTM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; b=od/BqbPOsF23z5BMcQEHEpifF4KKsU8RHEXQbzAeTcC9vyZxc/CbA/3vl2QvqrymS3 aN5D8OfrHBkxwjv4srJbEqUMDCcSt+v+IhJJgPAE81DG16+zE+ioERZEYUsY6jWoj8Wc 6kRvc72IVLh6vQKBulQwdv7yzsCuyPA90RPXM= Received: by 10.150.214.11 with SMTP id m11mr4189568ybg.130.1257390252549; Wed, 04 Nov 2009 19:04:12 -0800 (PST) Received: from call.local ([121.98.140.46]) by mx.google.com with ESMTPS id 23sm610067ywh.33.2009.11.04.19.04.10 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 04 Nov 2009 19:04:11 -0800 (PST) Message-ID: <4AF240A6.5010001@gmail.com> Date: Thu, 05 Nov 2009 16:04:06 +1300 From: Steven Samuel Cole User-Agent: Thunderbird 2.0.0.23 (Macintosh/20090812) MIME-Version: 1.0 To: questions@freebsd.org References: <4AF11670.7010603@gmail.com> <4AF2148E.4090200@gmail.com> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: [zfs-discuss] ZFS non-zero checksum and permanent error with deleted file X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Nov 2009 03:04:13 -0000 Bob Friesenhahn schrieb: > On Thu, 5 Nov 2009, Steven Samuel Cole wrote: > >>> Definitely do >>> >>> zpool scrub zpool01 >>> >>> to see if there is any other decay. >> >> I have done that prior to getting the status, several times actually, >> tried to indicate that in my OP. IIRC, all checksums are zero after >> clearing; after scrubbing, the total checksum goes back up to 4. The >> error is not cleared, though. > > Strange. I do recall that there was one OpenSolaris development release > which did produce spurious checksum errors which looked weird like > that. Hopefully you are not using that particular release. I am using ZFS as it comes with the official FreeBSD 7.2 64bit, no patches, no dev releases, all binary out of the box, nothing self-built. IIRC, that's ZFS version 6. > Your 'zpool status' output did not indicate that a scrub was done. You are correct, my mistake. I reproduced the 3 zpool command lines in my OP from memory. I have gone through many clear/scrub/status, export/import, wash/rinse/repeat cycles now, the 'last scrub' info must have gone lost in one of them. A scrub on that pool takes ~8 hours, so I refrained from running it again just for demonstration purposes. Hmmm. Just as I want to double-check, I get this: [user@host ~]$ sudo zpool history History for 'zpool01': 2008-05-31.22:16:22 zpool create -m /mnt/zpool01 zpool01 raidz1 ad12 ad14 ad16 ad18 2008-12-28.15:06:54 zpool import zpool01 2008-12-28.18:37:42 zpool export zpool01 2008-12-28.18:51:39 zpool import zpool01 2009-01-05.17:31:51 zpool export zpool01 2009-01-05.19:55:27 zpool import -d /dev/disk/by-id zpool01 2009-08-25.00:50:31 zpool clear zpool01 Assertion failed: ((null)), function nvlist_lookup_string(records[i], ZPOOL_HIST_CMD, &cmdstr) == 0, file /usr/src/cddl/sbin/zpool/../../../cddl/contrib/opensolaris/cmd/zpool/zpool_main.c, line 3338. Abort trap: 6 (core dumped) Sigh. Maybe I should take that as another indication that something is just not right and I should rebuild the pool, afterwise there'll always be that nagging thought if my data is actually safe... > > Bob > -- > Bob Friesenhahn > bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ > GraphicsMagick Maintainer, http://www.GraphicsMagick.org/