Date: Wed, 01 May 2019 12:26:15 +1000 From: Michelle Sullivan <michelle@sorbs.net> To: Xin LI <delphij@gmail.com> Cc: rainer@ultra-secure.de, owner-freebsd-stable@freebsd.org, freebsd-stable <freebsd-stable@freebsd.org>, Andrea Venturoli <ml@netfence.it> Subject: Re: ZFS... Message-ID: <fe6880bc-d40a-2377-6bea-28bfd8229e9f@sorbs.net> In-Reply-To: <CAGMYy3tYqvrKgk2c==WTwrH03uTN1xQifPRNxXccMsRE1spaRA@mail.gmail.com> References: <30506b3d-64fb-b327-94ae-d9da522f3a48@sorbs.net> <CAOtMX2gf3AZr1-QOX_6yYQoqE-H%2B8MjOWc=eK1tcwt5M3dCzdw@mail.gmail.com> <56833732-2945-4BD3-95A6-7AF55AB87674@sorbs.net> <3d0f6436-f3d7-6fee-ed81-a24d44223f2f@netfence.it> <17B373DA-4AFC-4D25-B776-0D0DED98B320@sorbs.net> <70fac2fe3f23f85dd442d93ffea368e1@ultra-secure.de> <70C87D93-D1F9-458E-9723-19F9777E6F12@sorbs.net> <CAGMYy3tYqvrKgk2c==WTwrH03uTN1xQifPRNxXccMsRE1spaRA@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Xin LI wrote:
>
> On Tue, Apr 30, 2019 at 5:08 PM Michelle Sullivan <michelle@sorbs.net
> <mailto:michelle@sorbs.net>> wrote:
>
> but in my recent experience 2 issues colliding at the same time
> results in disaster
>
>
> Do we know exactly what kind of corruption happen to your pool? If
> you see it twice in a row, it might suggest a software bug that should
> be investigated.
>
Oh I did spot one interesting bug... though it is benign...
Check out the following (note the difference between 'zpool status' and
'zpool status -v'):
root@colossus:/mnt # zpool status
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 5
raidz2-0 ONLINE 0 0 20
mfid11 ONLINE 0 0 0
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: 4 data errors, use '-v' for a list
root@colossus:/mnt # zpool status
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 5
raidz2-0 ONLINE 0 0 20
mfid11 ONLINE 0 0 0
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: 4 data errors, use '-v' for a list
root@colossus:/mnt # zpool status -v
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 5
raidz2-0 ONLINE 0 0 20
mfid11 ONLINE 0 0 0
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: Permanent errors have been detected in the following files:
<metadata>:<0x3e>
<metadata>:<0x5d>
storage:<0x0>
storage@now:<0x0>
root@colossus:/mnt # zpool status -v
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 7
raidz2-0 ONLINE 0 0 28
mfid11 ONLINE 0 0 0
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: Permanent errors have been detected in the following files:
<metadata>:<0x3e>
<metadata>:<0x5d>
storage:<0x0>
storage@now:<0x0>
root@colossus:/mnt # zpool status -v
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: Permanent errors have been detected in the following files:
<metadata>:<0x3e>
<metadata>:<0x5d>
storage:<0x0>
storage@now:<0x0>
root@colossus:/mnt # zpool status -v
pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Mon Apr 29 20:22:03 2019
6.54T scanned at 0/s, 6.54T issued at 0/s, 28.8T total
445G resilvered, 22.66% done, no estimated completion time
config:
NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 11
raidz2-0 ONLINE 0 0 44
mfid11 ONLINE 0 0 0
mfid10 ONLINE 0 0 0
mfid8 ONLINE 0 0 0
mfid7 ONLINE 0 0 0
mfid0 ONLINE 0 0 0
mfid5 ONLINE 0 0 0
mfid4 ONLINE 0 0 0
mfid3 ONLINE 0 0 0
mfid2 ONLINE 0 0 0
mfid14 ONLINE 0 0 0
mfid15 ONLINE 0 0 0
mfid6 ONLINE 0 0 0
mfid9 ONLINE 0 0 0
mfid13 ONLINE 0 0 0
mfid1 ONLINE 0 0 0
errors: Permanent errors have been detected in the following files:
<metadata>:<0x3e>
<metadata>:<0x5d>
storage:<0x0>
storage@now:<0x0>
root@colossus:/mnt #
--
Michelle Sullivan
http://www.mhix.org/
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?fe6880bc-d40a-2377-6bea-28bfd8229e9f>