From owner-freebsd-stable@freebsd.org Tue Dec 10 16:09:07 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5DF2C1DD3D8 for ; Tue, 10 Dec 2019 16:09:07 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from mail.ijs.si (mail.ijs.si [IPv6:2001:1470:ff80::25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47XQ3j6XkWz3Jrm for ; Tue, 10 Dec 2019 16:09:05 +0000 (UTC) (envelope-from Mark.Martinec+freebsd@ijs.si) Received: from amavis-ori.ijs.si (localhost [IPv6:::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.ijs.si (Postfix) with ESMTPS id 47XQ3d6tLlzm46; Tue, 10 Dec 2019 17:09:01 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=ijs.si; h= user-agent:message-id:references:in-reply-to:organization :subject:subject:from:from:date:date:content-transfer-encoding :content-type:content-type:mime-version:received:received :received:received; s=jakla4; t=1575994138; x=1578586139; bh=wdq bMNaFYZibkabxBCaNm/iemWN30ypgPU52UOL1qdg=; b=b20ajeEz2Xax6gUtcPb Y256Xsi3AJ5H9bLaJi0GIRrK8x/9o3eedhYYyP7jhdI/A49wYTM78Je9or+CULla fRZTCnSY91ZKxGSusP4375lDZR5l/gFJZiEtECJQ7xzIq8WQPYzuHaXiPUC4Ka9Q O5pKLUEPRh8TyQIQpFYGL8Z4= X-Virus-Scanned: amavisd-new at ijs.si Received: from mail.ijs.si ([IPv6:::1]) by amavis-ori.ijs.si (mail.ijs.si [IPv6:::1]) (amavisd-new, port 10026) with LMTP id qCKlhnTzPHR9; Tue, 10 Dec 2019 17:08:58 +0100 (CET) Received: from mildred.ijs.si (mailbox.ijs.si [IPv6:2001:1470:ff80::143:1]) by mail.ijs.si (Postfix) with ESMTP id 47XQ3Z50BPzm43; Tue, 10 Dec 2019 17:08:58 +0100 (CET) Received: from nabiralnik.ijs.si (nabiralnik.ijs.si [IPv6:2001:1470:ff80::80:16]) by mildred.ijs.si (Postfix) with ESMTP id 47XQ3Z4j7zzNc; Tue, 10 Dec 2019 17:08:58 +0100 (CET) Received: from neli.ijs.si (2001:1470:ff80:88:21c:c0ff:feb1:8c91) by webmail.ijs.si with HTTP (HTTP/2.0 POST); Tue, 10 Dec 2019 17:08:58 +0100 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Tue, 10 Dec 2019 17:08:58 +0100 From: Mark Martinec To: freebsd-stable@freebsd.org Cc: Marc Branchaud Subject: Re: Boot loader stuck after first stage upgrading 11.2 to 12.0-RC2 Organization: Jozef Stefan Institute In-Reply-To: References: <22f5b92a09ea4d62ac3feb74457067f7@ijs.si> <5EEBAFC0-4FA3-4219-A918-7376F4223656@me.com> <0F5FCC70-EADB-4F9E-A391-F1A73BE5608F@me.com> <1543954753.1860.243.camel@freebsd.org> <53ceda24-fa1b-8546-3511-bd500b440dfe@digiware.nl> <4c4019102b63054f8de93324dba0e776@ijs.si> Message-ID: X-Sender: Mark.Martinec+freebsd@ijs.si User-Agent: Roundcube Webmail/1.3.1 X-Rspamd-Queue-Id: 47XQ3j6XkWz3Jrm X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=ijs.si header.s=jakla4 header.b=b20ajeEz; dmarc=pass (policy=none) header.from=ijs.si; spf=pass (mx1.freebsd.org: domain of Mark.Martinec@ijs.si designates 2001:1470:ff80::25 as permitted sender) smtp.mailfrom=Mark.Martinec@ijs.si X-Spamd-Result: default: False [-3.51 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[ijs.si:s=jakla4]; RCVD_COUNT_FIVE(0.00)[6]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:1470:ff80::25]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[ijs.si.dwl.dnswl.org : 127.0.11.0]; HAS_ORG_HEADER(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[ijs.si:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[5.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.8.f.f.0.7.4.1.1.0.0.2.list.dnswl.org : 127.0.11.0]; DMARC_POLICY_ALLOW(-0.50)[ijs.si,none]; IP_SCORE(-0.51)[asn: 2107(-2.55), country: SI(0.01)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:2107, ipnet:2001:1470::/32, country:SI]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[freebsd]; FREEMAIL_CC(0.00)[gmail.com] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Dec 2019 16:09:07 -0000 2019-12-10 16:35, Marc Branchaud wrote: > On 2019-12-10 9:18 a.m., Mark Martinec wrote: >> Commenting on a thread from 2018-12 and from 2019-09-20, with my >> solution >> to the boot problem at the end, in case anyone is still interested. > > Thank you very much for this. A couple of questions: > > (1) Why do you say "raw devices for historical reasons"? Glancing > through the zpool man page and the Handbook, I see nothing > recommending or requiring GPT partitions. Apparently using raw devices for zpool is now discouraged, although I don't think it has ever become officially unsupported. > (2) Just to be 100% clear, my 11.3 non-root zpool looks like this: > NAME STATE READ WRITE CKSUM > storage ONLINE 0 0 0 > raidz2-0 ONLINE 0 0 0 > ada2 ONLINE 0 0 0 > ada3 ONLINE 0 0 0 > ada4 ONLINE 0 0 0 > ada5 ONLINE 0 0 0 > ada6 ONLINE 0 0 0 > ada7 ONLINE 0 0 0 > > So this is using raw devices. Are you saying that if I upgrade this > machine to 12 that it won't be able to boot? It is possible it won't boot under 12, although not necessary. Try booting from a 12.0 (or 12.0) memory stick - it that boots, it is probably a safe bet that it will survive an upgrade. Of the bunch of machines that I have upgraded from 11.2 to 12, only three failed to boot under 12.0 loader. There were a couple of others which upgraded and booted fine even though they had a zfs pool on raw devices. I never had a problem of booting on hosts that had zfs pool on a gpt partition. So it's a lottery: a few raw devices in a zpool seem to do fine, while many raw devices in a zpool is asking for trouble under 12.0 and later. Mark