From owner-freebsd-fs@FreeBSD.ORG Wed Jan 2 05:06:44 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E719216A419 for ; Wed, 2 Jan 2008 05:06:44 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from ns.trinitel.com (186.161.36.72.static.reverse.ltdomains.com [72.36.161.186]) by mx1.freebsd.org (Postfix) with ESMTP id BF37E13C43E for ; Wed, 2 Jan 2008 05:06:44 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from neutrino.vnode.org (r74-193-81-203.pfvlcmta01.grtntx.tl.dh.suddenlink.net [74.193.81.203]) (authenticated bits=0) by ns.trinitel.com (8.14.1/8.14.1) with ESMTP id m024inQt081259 for ; Tue, 1 Jan 2008 22:44:49 -0600 (CST) (envelope-from anderson@freebsd.org) Message-ID: <477B16BB.8070104@freebsd.org> Date: Tue, 01 Jan 2008 22:44:43 -0600 From: Eric Anderson User-Agent: Thunderbird 2.0.0.9 (X11/20071227) MIME-Version: 1.0 To: "freebsd-fs@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=0.0 required=5.0 tests=none autolearn=failed version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on ns.trinitel.com Subject: ZFS i/o errors - which disk is the problem? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Jan 2008 05:06:45 -0000 I created a zpool with two new identical (500GB) SATA disks. I rsync'ed a bunch of data over to the new ZFS file systems, and started seeing i/o errors. Here's how I created the file systems: zpool create tank mirror ad6 ad8 zfs create tank/media zfs create tank/documents zfs set sharenfs=on tank/media zfs set sharenfs=on tank/documents zfs set atime=off tank zfs set mountpoint=/media tank/media zfs set mountpoint=/documents tank/documents Here's what zpool status says: # zpool status pool: tank state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scrub: scrub completed with 731 errors on Tue Jan 1 15:17:08 2008 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 1.47K mirror ONLINE 0 0 1.47K ad6 ONLINE 0 0 5.12K ad8 ONLINE 0 0 4.66K How can I tell which drive gave the problems, or where the problem came from? I see several errors in /var/log/messages, like: ZFS: zpool I/O failure, zpool=tank error=86 and many many of these: ZFS: checksum mismatch, zpool=tank path=/dev/ad6 offset=31970426880 size=131072 for both the ad6 and ad8 devices. I'm happy to swap the drive out, but I don't know which is the problem. I was also wondering if it was a saturated I/O issue on the system (it's a fairly slow and poky old box). Any ideas/hints? Eric