From owner-freebsd-current@FreeBSD.ORG Sun Jan 27 12:53:56 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 9CA0DD08; Sun, 27 Jan 2013 12:53:56 +0000 (UTC) (envelope-from bland@FreeBSD.org) Received: from mail2.asahi-net.or.jp (mail2.asahi-net.or.jp [202.224.39.198]) by mx1.freebsd.org (Postfix) with ESMTP id 3E084EF6; Sun, 27 Jan 2013 12:53:55 +0000 (UTC) Received: from eee.bbnest.net (w133033.ppp.asahi-net.or.jp [121.1.133.33]) by mail2.asahi-net.or.jp (Postfix) with ESMTP id 606D218C9F; Sun, 27 Jan 2013 21:53:48 +0900 (JST) Received: from nest.bbnest.net (w133033.ppp.asahi-net.or.jp [121.1.133.33]) (authenticated bits=0) by eee.bbnest.net (8.14.6/8.14.5) with ESMTP id r0RCqHQX001467 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Sun, 27 Jan 2013 21:52:18 +0900 (JST) (envelope-from bland@FreeBSD.org) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.2 \(1499\)) Subject: Re: ZFS + usb in trouble? From: Alexander Nedotsukov In-Reply-To: <20130123134601.GB53514@garage.freebsd.pl> Date: Sun, 27 Jan 2013 21:52:20 +0900 Content-Transfer-Encoding: quoted-printable Message-Id: <845D0D19-7191-4EDD-8EDE-1331E13821CB@FreeBSD.org> References: <20130121205851.GB1341@garage.freebsd.pl> <20130121211718.GD1341@garage.freebsd.pl> <20130122181012.GD1714@garage.freebsd.pl> <20130123134601.GB53514@garage.freebsd.pl> To: Pawel Jakub Dawidek , "hselasky@FreeBSD.org" X-Mailer: Apple Mail (2.1499) X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Sun Jan 27 21:53:48 2013 X-DSPAM-Confidence: 0.9997 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 5105235b14686911810420 Cc: FreeBSD Current , "freebsd-usb@freebsd.org" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 27 Jan 2013 12:53:56 -0000 Thank you, Pawel. Hans, can please you take a look at your commits done on Dec 20 (r244500 = and r244503)? They are seems to be the culprit. On 23.01.2013, at 22:46, Pawel Jakub Dawidek wrote: > On Wed, Jan 23, 2013 at 09:11:23PM +0900, Alexander Nedotsukov wrote: >> And now both are failing, although zfs in a different way. >=20 > Yes, but now we are sure this is not ZFS issue. Sequential read simply > doesn't trigger the corruption, but ZFS access patterns do. The read > errors you are seeing are due to GELI returning EIO on integrity > verification error. >=20 >> # zpool status >> pool: testpool >> state: ONLINE >> status: One or more devices has experienced an unrecoverable error. = An >> attempt was made to correct the error. Applications are = unaffected. >> action: Determine if the device needs to be replaced, and clear the = errors >> using 'zpool clear' or replace the device with 'zpool replace'. >> see: http://illumos.org/msg/ZFS-8000-9P >> scan: scrub repaired 1M in 0h2m with 0 errors on Wed Jan 23 20:57:11 = 2013 >> config: >>=20 >> NAME STATE READ WRITE CKSUM >> testpool ONLINE 0 0 0 >> raidz1-0 ONLINE 0 0 0 >> da5.elid ONLINE 0 0 0 >> da5.elie ONLINE 21 0 0 >> da5.elif ONLINE 0 0 0 >>=20 >> # dmesg | tail -20 >> GEOM_ELI: da1.eli: Failed to authenticate 131072 bytes of data at = offset 1010827264. >> ath0: bb hang detected (0x4), resetting >> GEOM_ELI: Device da5.eli created. >> GEOM_ELI: Encryption: AES-XTS 128 >> GEOM_ELI: Integrity: HMAC/SHA1 >> GEOM_ELI: Crypto: software >> GEOM_ELI: da5.eli: Failed to authenticate 4096 bytes of data at = offset 4096. >> GEOM_ELI: da5.eli: Failed to authenticate 4096 bytes of data at = offset 0. >> GEOM_ELI: da5.eli: Failed to authenticate 5792 bytes of data at = offset 229288288. >> GEOM_ELI: da5.eli: Failed to authenticate 65536 bytes of data at = offset 229429248. >> GEOM_ELI: da5.eli: Failed to authenticate 131072 bytes of data at = offset 229298176. >> GEOM_ELI: da5.eli: Failed to authenticate 26496 bytes of data at = offset 229494784. >> GEOM_ELI: da5.eli: Failed to authenticate 12288 bytes of data at = offset 270299136. >> GEOM_ELI: da5.eli: Failed to authenticate 65536 bytes of data at = offset 270319616. >> GEOM_ELI: da5.eli: Failed to authenticate 5792 bytes of data at = offset 273095488. >> GEOM_ELI: da5.eli: Failed to authenticate 56864 bytes of data at = offset 273105376. >> GEOM_ELI: da5.eli: Failed to authenticate 2400 bytes of data at = offset 273326080. >> GEOM_ELI: da5.eli: Failed to authenticate 65536 bytes of data at = offset 272560128. >> GEOM_ELI: da5.eli: Failed to authenticate 131072 bytes of data at = offset 272429056. >> GEOM_ELI: da5.eli: Failed to authenticate 32768 bytes of data at = offset 272396288. >=20 > --=20 > Pawel Jakub Dawidek http://www.wheelsystems.com > FreeBSD committer http://www.FreeBSD.org > Am I Evil? Yes, I Am! http://tupytaj.pl