From owner-freebsd-questions@freebsd.org Mon Aug 6 19:10:53 2018 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6326D10624C0 for ; Mon, 6 Aug 2018 19:10:53 +0000 (UTC) (envelope-from doug@fledge.watson.org) Received: from cyrus.watson.org (cyrus.watson.org [204.107.128.30]) by mx1.freebsd.org (Postfix) with ESMTP id 085DC85065 for ; Mon, 6 Aug 2018 19:10:53 +0000 (UTC) (envelope-from doug@fledge.watson.org) Received: from fledge.watson.org (fledge.watson.org [198.74.231.63]) by cyrus.watson.org (Postfix) with ESMTPS id 37D3CA81CD; Mon, 6 Aug 2018 19:10:52 +0000 (UTC) Received: from fledge.watson.org (doug@localhost.watson.org [127.0.0.1]) by fledge.watson.org (8.15.2/8.15.2) with ESMTP id w76JApYU072234; Mon, 6 Aug 2018 15:10:51 -0400 (EDT) (envelope-from doug@fledge.watson.org) Received: from localhost (doug@localhost) by fledge.watson.org (8.15.2/8.15.2/Submit) with ESMTP id w76JAp3O072231; Mon, 6 Aug 2018 15:10:51 -0400 (EDT) (envelope-from doug@fledge.watson.org) Date: Mon, 6 Aug 2018 15:10:51 -0400 (EDT) From: doug Reply-To: doug@safeport.com To: Matthias Fechner cc: freebsd-questions@freebsd.org Subject: Re: 11.2 cannot boot with root on ZFS In-Reply-To: <7415d752-21ab-a397-f90b-afe9945b2585@fechner.net> Message-ID: References: <7415d752-21ab-a397-f90b-afe9945b2585@fechner.net> User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (fledge.watson.org [127.0.0.1]); Mon, 06 Aug 2018 15:10:51 -0400 (EDT) Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Aug 2018 19:10:53 -0000 On Sun, 5 Aug 2018, Matthias Fechner wrote: > Hi Kyle, > > sry that it took longer, but I had a harddisk failure and it took some > time to resilver the pool to a new disc. > > Am 16.07.2018 um 19:45 schrieb Kyle Evans: >> To be clear- the kernel can't find the zfs pool, or one of the earlier >> stages? Giving the pool manually meaning at a mountroot prompt, or >> somewhere else? > > I'm not sure what the problem is. > If I update the kernel from 11.1 to 11.2 with freebsd-update and reboot, > it could be a kernel panic with an immediate reboot. > It is that fast, that it is impossible to see anything on the screen, so > I cannot give you a clear error message for this. > > If I try then to boot the old kernel in the bootloader with: > unload > load /boot/kernel.working/kernel > > it is not able to mount the zroot pool. > > To fix this, I need to boot mfsbsd from an USB stick and do: > zpool import -o altroot=/mnt zroot > cd /mnt > tar xjvf boot_111_working.tar.bz2 > cd / > zpool export zroot > reboot > >> This is for specifically for aarch64, but you've not specifically >> mentioned it- you're on aarch64, right? > you are right, I'm on a normal amd64 platform. > >> I think we'll need a little more information about where and >> specifically how it's failing for you to determine that. Others have >> reported successful upgrades from 11.1 to 11.2 with root-on-ZFS >> setups. > > is it maybe the way the disc are partitioned? > > I have an empty EFI partition on the harddisk (to have later space for EFI): > gpart show ada0 > =>        40  5860533088  ada0  GPT  (2.7T) >           40      262144     1  efi  (128M) >       262184         512     2  freebsd-boot  (256K) >       262696  5860270424     3  freebsd-zfs  (2.7T) >   5860533120           8        - free -  (4.0K) > > The bootloader is correctly installed using: > > gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 2 ada0 > I have an amd64 ZFS install from the USB file taking all the defaults. Here's what my disk looks like: => 40 1953525088 ada1 GPT (932G) 40 409600 1 efi (200M) 409640 1024 2 freebsd-boot (512K) 410664 984 - free - (492K) 411648 4194304 3 freebsd-swap (2.0G) 4605952 1948917760 4 freebsd-zfs (929G) 1953523712 1416 - free - (708K) mount_msdosfs /dev/ada1p1 /mnt cd /mnt/efi/boot/ ls -l total 385 -rwxr-xr-x 1 root wheel 393216 Apr 16 10:12 BOOTx64.efi -rwxr-xr-x 1 root wheel 12 Apr 16 10:12 startup.nsh cat startup.nsh BOOTx64.efi