From owner-freebsd-stable@freebsd.org Thu May 9 09:41:25 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6514115A3724 for ; Thu, 9 May 2019 09:41:25 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from cu01176b.smtpx.saremail.com (cu01176b.smtpx.saremail.com [195.16.151.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 44EDA86C72 for ; Thu, 9 May 2019 09:41:23 +0000 (UTC) (envelope-from borjam@sarenet.es) Received: from [172.16.8.250] (unknown [192.148.167.11]) by proxypop01.sare.net (Postfix) with ESMTPA id AD5C39DDE5C; Thu, 9 May 2019 11:41:14 +0200 (CEST) Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.8\)) Subject: Re: ZFS... From: Borja Marcos In-Reply-To: <7D18A234-E7BF-4855-BD51-4AE2253DB1E4@sorbs.net> Date: Thu, 9 May 2019 11:41:12 +0200 Cc: Walter Parker , freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <30506b3d-64fb-b327-94ae-d9da522f3a48@sorbs.net> <56833732-2945-4BD3-95A6-7AF55AB87674@sorbs.net> <3d0f6436-f3d7-6fee-ed81-a24d44223f2f@netfence.it> <17B373DA-4AFC-4D25-B776-0D0DED98B320@sorbs.net> <70fac2fe3f23f85dd442d93ffea368e1@ultra-secure.de> <70C87D93-D1F9-458E-9723-19F9777E6F12@sorbs.net> <5ED8BADE-7B2C-4B73-93BC-70739911C5E3@sorbs.net> <2e4941bf-999a-7f16-f4fe-1a520f2187c0@sorbs.net> <20190430102024.E84286@mulder.mintsol.com> <41FA461B-40AE-4D34-B280-214B5C5868B5@punkt.de> <20190506080804.Y87441@mulder.mintsol.com> <08E46EBF-154F-4670-B411-482DCE6F395D@sorbs.net> <33D7EFC4-5C15-4FE0-970B-E6034EF80BEF@gromit.dlib.vt.edu> <7D18A234-E7BF-4855-BD51-4AE2253DB1E4@sorbs.net> To: Michelle Sullivan X-Mailer: Apple Mail (2.3445.104.8) X-Rspamd-Queue-Id: 44EDA86C72 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.29 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip4:195.16.151.0/24]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[smtp.sarenet.es,smtp.sarenet.es,smtp.sarenet.es]; DMARC_POLICY_ALLOW(-0.50)[sarenet.es,reject]; RCVD_IN_DNSWL_NONE(0.00)[151.151.16.195.list.dnswl.org : 127.0.10.0]; SUBJ_ALL_CAPS(0.45)[6]; IP_SCORE(-2.50)[ip: (-6.93), ipnet: 195.16.128.0/19(-3.22), asn: 3262(-2.39), country: ES(0.04)]; NEURAL_HAM_SHORT(-0.93)[-0.931,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3262, ipnet:195.16.128.0/19, country:ES]; FREEMAIL_CC(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 May 2019 09:41:25 -0000 > On 9 May 2019, at 00:55, Michelle Sullivan wrote: >=20 >=20 >=20 > This is true, but I am of the thought in alignment with the zFs devs = this might not be a good idea... if zfs can=E2=80=99t work it out = already, the best thing to do will probably be get everything off it and = reformat=E2=80=A6 =20 That=E2=80=99s true, I would rescue what I could and create the pool = again but after testing the setup thoroughly. It would be worth to have a look at the excellent guide offered by the = FreeNAS people. It=E2=80=99s full of excellent advice and a priceless list of =E2=80=9Cdonts=E2=80=9D such as SATA port multipliers, = etc.=20 >=20 >> That sound not be hard to write if everything else on the disk has no >> issues. Don't you say in another message that the system is now = returning >> 100's of drive errors. >=20 > No, one disk in the 16 disk zRAID2 ... previously unseen but it could = be the errors have occurred in the last 6 weeks... everytime I reboot it = started resilvering, gets to 761M resilvered and then stops. That=E2=80=99s a really bad sign. It shouldn=E2=80=99t happen.=20 >> How does that relate the statement =3D>Everything on >> the disk is fine except for a little bit of corruption in the = freespace map? >=20 > Well I think it goes through until it hits that little bit of = corruption at stops it mounting... then stops again.. >=20 > I=E2=80=99m seeing 100s of hard errors at the beginning of one of the = drives.. they were reported in syslog but only just so could be a new = thing. Could be previously undetected.. no way to know. As for disk monitoring, smartmontools can be pretty good although only = as an indicator. I also monitor my systems using Orca (I wrote a crude = =E2=80=9Cdevilator=E2=80=9D many years ago) and I gather disk I/O statistics using GEOM of which the = read/write/delete/flush times are very valuable. An ailing disk can be = returning valid data but become very slow due to retries.=20 Borja.