From owner-freebsd-questions@freebsd.org Thu Aug 29 08:37:33 2019 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 707E2CF41A for ; Thu, 29 Aug 2019 08:37:33 +0000 (UTC) (envelope-from SRS0=yEE7=WZ=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 46JwwD1hhlz4PQ4 for ; Thu, 29 Aug 2019 08:37:31 +0000 (UTC) (envelope-from SRS0=yEE7=WZ=perdition.city=julien@bebif.be) Received: from home.lan (unknown [77.109.105.33]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id D2EFA1D4FC23; Thu, 29 Aug 2019 10:37:29 +0200 (CEST) Date: Thu, 29 Aug 2019 10:37:28 +0200 From: Julien Cigar To: Albert Shih Cc: freebsd-questions@freebsd.org Subject: Re: Verry serious problem with ZFS & 12.0 Message-ID: <20190829083727.GC38457@home.lan> References: <20190828224547.GA1557@io.chezmoi.fr> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="5QAgd0e35j3NYeGe" Content-Disposition: inline In-Reply-To: <20190828224547.GA1557@io.chezmoi.fr> User-Agent: Mutt/1.11.4 (2019-03-13) X-Rspamd-Queue-Id: 46JwwD1hhlz4PQ4 X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of SRS0=yEE7=WZ=perdition.city=julien@bebif.be designates 193.191.208.90 as permitted sender) smtp.mailfrom=SRS0=yEE7=WZ=perdition.city=julien@bebif.be X-Spamd-Result: default: False [-7.79 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[perdition.city]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.985,0]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.208.191.193.list.dnswl.org : 127.0.10.0]; SIGNED_PGP(-2.00)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=yEE7=WZ=perdition.city=julien@bebif.be]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[33.105.109.77.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=yEE7=WZ=perdition.city=julien@bebif.be]; IP_SCORE(-2.81)[ip: (-8.49), ipnet: 193.191.192.0/19(-4.24), asn: 2611(-1.30), country: BE(-0.00)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Aug 2019 08:37:33 -0000 --5QAgd0e35j3NYeGe Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Aug 29, 2019 at 12:45:47AM +0200, Albert Shih wrote: > Hi >=20 > After update 4 servers from 11.2 to 12.0 without any problem, wait few > weeks to see if everything work well, and it did. I just upgrade my mail > server.=20 >=20 > During the upgrade I also upgrade all firmware for the hardware. >=20 > And now I got a very serious issue with my server.=20 >=20 > Configuration : >=20 > Dell PowerEdge R740Xd with H730P, 192 Go Ram, 2 SAS mechanical disk for= the system, > 2 SSD (in a zfs pool) for the mail index (cyrus), and 28 mechanical disk > (in a second zfs pool) for the mailbox.=20 >=20 > The problem: >=20 > After running few days the zfs pool with the 2 SSD are not responding.= =20 >=20 > The system are perfectly working.=20 >=20 > The second zpool (mechanical disk) are perfectly working.=20 > =20 > I got zero log, zero message in the console or in dmesg. >=20 > The arc_size are correct, it's around 70-75 %.=20 >=20 > The moment the zfs pool become not responding are random, not related to > any activity (human or cron). >=20 > The only option I pass for the kernel related to ZFS are vfs.zfs.min_au= to_ashift=3D12 and=20 > vfs.zfs.prefetch_disable=3D1. Without the second one the system no > responding (under 11.2) when the server send (through zfs send) the dat= a to another > server. >=20 > After the first problem I make a zfs upgrade, thinking maybe that's the > problem so I'm not sure I can downgrade to 11.2 (and 11.2 are EOL)=20 >=20 > In your opinion : >=20 > 1/ What should I do to try to find the problem ? >=20 > 2/ Do you think that's a hardware/firmware problem or FreeBSD problem, > the point is the second zpool are working perfectly so I'm thinking at > some firmware/hardware/compatibility problem. >=20 >=20 > Regards. looks like PR 236480 see https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D236480 >=20 >=20 > -- > Albert SHIH > DIO b=C3=A2timent 15 > Observatoire de Paris > Heure local/Local time: > Thu 29 Aug 2019 12:26:55 AM CEST > _______________________________________________ > freebsd-questions@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.o= rg" --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --5QAgd0e35j3NYeGe Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEE7vn2l0to0nV7EWolsrs3EKIEI8AFAl1njsMACgkQsrs3EKIE I8D21A//V4v3BeceoWUHM5KsYdP+tElxNVoE4npCVzXj5Vjgwy/Z+ogWEw5wB3Ze ALTN3YLbv1wQBPqs5zII53JHoFTzV2U0G9/rZrxAlMEmUz6xDAD2StirWblOLfXe tW4HMvOQCJszaOoYX9giaziLbzx3Ca7fOa9HYWK074MdPmMcZYGdH4Qx1KTne7nC J6+SgLB4FbBjqfvS7DsfONW1OSQcoIdf3gjiA3cKaIlZhxCQzBraJaqvYkqxpRY/ k/lJMhiZv4B6mljvngCanWm3C814g9yjU0nOy58iKFrT82M981K09jQ1m7zYqCxd IYmXcjiMZ6GA46uSBJvpuQWdwpoGVpEDiFDo43XdebNBAa3LUwJ+bHgDv64tfVDR sbvSRt+sjOhjkWPP2aWFtQdM+jvClozPdRVUDHarPqdygMp1op/upUU8LEoWbqlk /1SNAa4dk7HRIxgL6j2e47gCgqIlvUQbfEnVA7mr0TsEhpmpx2ECbvBU1vDPP0W9 mYsMQe2aFADNJxoUoToGD5xzz6s2Z2q5gHdxToM6PoTEi8SkVE+R69MVD/h6PmuE TiDezOzOLhyAgu8w0CE+tgVuvFtVaxN/IjoLFH/8861cqIts0msMwpoo/QREKeha DW3IzPsQhNtSS5pMQFRQiwi7me9mmVh49qn/TvJJ5TD/IQHWX/0= =gLLp -----END PGP SIGNATURE----- --5QAgd0e35j3NYeGe--