Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 2 Feb 2016 01:19:51 +0900
From:      Tomoaki AOKI <junchoon@dec.sakura.ne.jp>
To:        freebsd-current@freebsd.org
Cc:        killing@multiplay.co.uk
Subject:   Re: ZFSROOT UEFI boot
Message-ID:  <20160202011951.fac68e935a3f0b414a8f34cb@dec.sakura.ne.jp>
In-Reply-To: <20160201233627.b02ada486133cca3c2eec9ad@dec.sakura.ne.jp>
References:  <CALfReyeY3=L9O81AX7xMKj3Ai2DTvBpXtbqepTZc2%2BGEsrT3vA@mail.gmail.com> <8991747525093115430@unknownmsgid> <20160124215300.4cd7f1207f5a4c7b28ef7ffc@dec.sakura.ne.jp> <56A51A4C.1040808@multiplay.co.uk> <20160129000344.feaf5f828e5d43d5fbbb652a@dec.sakura.ne.jp> <CACA0VUiwF=40n0TNSfTAnbHY-1xLMytOzeXjnufF%2BoPKRbvBew@mail.gmail.com> <56AAD552.9090202@multiplay.co.uk> <20160130155755.485736c8e12868663b9ccfbc@dec.sakura.ne.jp> <56AD0B22.1050704@multiplay.co.uk> <20160131204356.f863901e7125456b5586b215@dec.sakura.ne.jp> <56AE12FF.9080404@multiplay.co.uk> <20160201233627.b02ada486133cca3c2eec9ad@dec.sakura.ne.jp>

next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.

--Multipart=_Tue__2_Feb_2016_01_19_51_+0900_g3T6sGuW0hoQBFfK
Content-Type: text/plain; charset=ISO-2022-JP
Content-Transfer-Encoding: 7bit

Woops! Found mistype in Diff8 report. Sorry. :-(
Attached is the fixed one. [imagepath line of 1) is fixed.]


On Mon, 1 Feb 2016 23:36:27 +0900
Tomoaki AOKI <junchoon@dec.sakura.ne.jp> wrote:

> Thanks in advance.
> But unfortunately, the boot behavior of Diff7 and Diff8 are changed
> from Diff6. Back to old problematic behavior.
> 
> FYI, I re-tested Diff6 (previously built binary) and reproduced the
> behavior I already reported. (So no new logs for it.)
> 
> Please see attached 2 files (for Diff7 and Diff8 respectively).
> In addition to test 2) and 3), 5) [USB boot] for Diff7 and 1) [single
> drive] for Diff8 are done.
> 
> Regards.
> 
> 
> On Sun, 31 Jan 2016 13:58:23 +0000
> Steven Hartland <killing@multiplay.co.uk> wrote:
> 
> > Thanks for doing that it was very helpful, and I know transcribing from 
> > video would have been quite a time consuming task.
> > 
> > I noticed a few interesting facts:
> > 1. It looks like when you boot from ada0 and ada1 its still picking the 
> > same device (according to device order).
> > Its not 100% clear as your devices are sata which Diff 6 didn't have 
> > decoding for. I've added that now so hopefully we can confirm, also 
> > added output of boot1 imgpath: so we can see what the EFI thinks the 
> > boot device is.
> > 2. Your usb device path has two message path entries which means 
> > msg_paths_match would result in a false positive for usb devices, this 
> > is now fixed by matching until we see a media path.
> > 
> > If you can now re-test the following two cases:
> > 2) Boot from ada0 without USB memstick attached (2 drives).
> > 3) Boot from ada1 without USB memstick attached (2 drives).
> > 
> > I'm interested to confirm two things:
> > 1. If the boot1 imgpath lines do indeed vary
> > 2. If the "load: '/boot/loader.efi'" line devpath matches the boot1 imgpath.
> > 
> > The changes from Diff 7 shouldn't effect the outcome of the other tests, 
> > but confirming that too wouldn't hurt but no need for the output.
> > 
> >      Regards
> >      Steve
> > On 31/01/2016 11:43, Tomoaki AOKI wrote:
> > > I found Diff6 you uploaded to PHABRICATOR. So my report below is based
> > > on it.
> > >
> > > The patched boot1.efi runs as expected (== as you wrote) for me.
> > >    *boot1.efi without -DEFI_DEBUG isn't tested. Needed?
> > >
> > > As I mentioned in my previous post, I have no serial console
> > > environment. So I took movie of limited tests and typed it.
> > >
> > > Which of the tests are typed:
> > >
> > >    1) Boot from ada0 removing ada1, no USB memstick attached, ZFS in
> > >       ada0 has loader.efi. (Single drive config.)
> > >
> > >    2) Boot from ada0, no USB memstick attached, ZFS in ada0 has
> > >       loader.efi.
> > >
> > >    3) Boot from ada1, no USB memstick attached, ZFS in ada1 has
> > >       loader.efi.
> > >
> > >    4) Boot from ada1, no USB memstick attached, only UFS in ada0 has
> > >       loader.efi.
> > >
> > >    5) Boot from da0 (USB memstick with memstick.img of head).
> > >       UFS in da0 has loader.efi and ZFS isn't present in da0.
> > >       (3 drives [2 drives + USB memstick] config.)
> > >
> > > Please see attached text for detail. Are more outputs needed?
> > >
> > > Thanks in advance! I'm looking forward to see this MFC'ed before
> > > releng/10.3 is branched. (Relies on imp@'s test?)
> > >
> > >   *Will need to be in conjunction with changes after r294265 in head, as
> > >    currently Diff6 doesn't apply to stable/10.
> > >
> > > Regards.
> > >
> > >
> > > On Sat, 30 Jan 2016 19:12:34 +0000
> > > Steven Hartland <killing@multiplay.co.uk> wrote:
> > >
> > >> I believe, based on testing, that the from Diff 5 onwards of
> > >> https://reviews.freebsd.org/D5108 this should work as you expect it i.e.
> > >>
> > >> If boot1 is loaded from a device which has either a UFS or ZFS bootable
> > >> install then this is the device that will be used to boot.
> > >>
> > >> If said device has both then the ZFS setup will still be tried first.
> > >>
> > >> If you can test in your setup and confirm either way that would be most
> > >> appreciated.
> > >>
> > >>       Regards
> > >>       Steve
> > >>
> > >> On 30/01/2016 06:57, Tomoaki AOKI wrote:
> > >>> Thanks for your quick support!
> > >>> I tried your patch [Diff1] (built with head r295032 world/kernel) and
> > >>> now have good and bad news.
> > >>>
> > >>> Good news is that without USB memstick boot1.efi runs as expected.
> > >>> Great!
> > >>>
> > >>> Bad news is that when booting from USB memstick (the one I used my
> > >>> previous test, boot1.efi [bootx64.efi] and loader.efi is replaced) and
> > >>> whichever of internal disk (ada[01]) have loader.efi in its ZFS pool,
> > >>> ada[01] is booted instead of da0 (USB memstick).
> > >>>
> > >>>     *If ada0 has loader.efi, always booted from ada0 (stable/10).
> > >>>     *If ada0 doesn't have loader.efi and ada1 has, booted from ada1
> > >>>      (head).
> > >>>     *If both ada0 and ada1 don't have loader.efi, da0 (USB memstick) is
> > >>>      booted (head, installer is invoked).
> > >>>
> > >>>    *Whichever ada[01] has loader.efi in their UFS or not didn't matter.
> > >>>
> > >>> These behaviour would be because ZFS thoughout all disks is tried
> > >>> before trying UFS throughout all disks, if I understood correctly.
> > >>>
> > >>> Changing boot order (ZFS to UFS per each disk, instead of each
> > >>> ZFS to each UFS) would help.
> > >>> But providing ZFS-disabled boot1.efi (boot1ufs.efi?) for installation
> > >>> media (memstick, dvd, ...) helps, too. I built ZFS-disabled boot1.efi
> > >>> and it worked fine for USB memstick for me.
> > >>>
> > >>>    *`make clean && make -DMK_ZFS=no` in sys/boot/efi/boot1 didn't disabled
> > >>>      ZFS module, so I must edit the definition of *boot_modules[] in
> > >>>      boot1.c. I'd have been missing something.
> > >>>
> > >>> Regards.
> > >>>
> > >>>
> > >>> On Fri, 29 Jan 2016 02:58:26 +0000
> > >>> Steven Hartland <killing@multiplay.co.uk> wrote:
> > >>>
> > >>>> On 28/01/2016 16:22, Doug Rabson wrote:
> > >>>>> On 28 January 2016 at 15:03, Tomoaki AOKI <junchoon@dec.sakura.ne.jp> wrote:
> > >>>>>
> > >>>>>> It's exactly the NO GOOD point. The disk where boot1 is read from
> > >>>>>> should be where loader.efi and loader.conf are first read.
> > >>>>>>
> > >>>>> I just wanted to note that gptzfsboot and zfsboot behaves this way. Boot1
> > >>>>> looks for loader in the pool which contains the disk that the BIOS booted.
> > >>>>> It passes through the ID of that pool to loader which uses that pool as the
> > >>>>> default for loading kernel and modules. I believe this is the correct
> > >>>>> behaviour. For gptzfsboot and zfsboot, it is possible to override by
> > >>>>> pressing space at the point where it is about to load loader.
> > >>>> I believe I understand at least some of your issue now, could you please
> > >>>> test the code on the following review to see if it fixes your issue please:
> > >>>> https://reviews.freebsd.org/D5108
> > >>>>
> > >>>>        Regards
> > >>>>        Steve
> > >>>> _______________________________________________
> > >>>> freebsd-current@freebsd.org mailing list
> > >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-current
> > >>>> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"
> > >>>>
> > >> _______________________________________________
> > >> freebsd-current@freebsd.org mailing list
> > >> https://lists.freebsd.org/mailman/listinfo/freebsd-current
> > >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"
> > >>
> > >
> > >
> > >
> > > _______________________________________________
> > > freebsd-current@freebsd.org mailing list
> > > https://lists.freebsd.org/mailman/listinfo/freebsd-current
> > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"
> > 
> > _______________________________________________
> > freebsd-current@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-current
> > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"
> > 
> 
> 
> -- 
> Tomoaki AOKI    junchoon@dec.sakura.ne.jp


-- 
青木 知明  [Tomoaki AOKI]
    junchoon@dec.sakura.ne.jp
    MXE02273@nifty.com

--Multipart=_Tue__2_Feb_2016_01_19_51_+0900_g3T6sGuW0hoQBFfK
Content-Type: text/plain;
 name="boot1.efi-Diff8-bootlogs.txt"
Content-Disposition: attachment;
 filename="boot1.efi-Diff8-bootlogs.txt"
Content-Transfer-Encoding: 7bit

Trial with Diff8.

Oddly, with Diff7 and Diff8, old behavior came back.

With Diff7, boot1.efi claimes that loading /boot/loader.efi failed,
and loaded one from the next drive, although actually /boot/loader.efi
exists in first drive (specified one, boot1.efi is read from).

With Diff8, first load failure message disappears, but the boot behavior
was the same as Diff7.

With both Diffs, "probe: * supported (preferred)" line wasn't shown
at all.

To ease comparing with previous test, test No. is matched as before.
So you would feel odd reading this file only.

For internal disks, ZFS only have loader.efi.
USB memstick has no ZFS and has loader.efi in UFS.

========================================================================

Output of gpart show with USB memstick attached.
  Note) diskid/DISK-S21MNXAG821947P is ada1.

=>        34  2000409197  ada0  GPT  (954G)
          34        2014        - free -  (1.0M)
        2048      409600     1  efi  (200M)
      411648        1024     2  freebsd-boot  (512K)
      412672        1024        - free -  (512K)
      413696    20971520     3  freebsd-swap  (10G)
    21385216    10485760     4  freebsd-ufs  (5.0G)
    31870976  1968537600     5  freebsd-zfs  (939G)
  2000408576         655        - free -  (328K)

=>       34  488397101  ada1  GPT  (233G)
         34       2014        - free -  (1.0M)
       2048     204800     1  efi  (100M)
     206848       1024     2  freebsd-boot  (512K)
     207872       1024        - free -  (512K)
     208896   20971520     3  freebsd-swap  (10G)
   21180416   16777216     4  freebsd-ufs  (8.0G)
   37957632  450439168     5  freebsd-zfs  (215G)
  488396800        335        - free -  (168K)

=>       34  488397101  diskid/DISK-S21MNXAG821947P  GPT  (233G)
         34       2014                               - free -  (1.0M)
       2048     204800                            1  efi  (100M)
     206848       1024                            2  freebsd-boot  (512K)
     207872       1024                               - free -  (512K)
     208896   20971520                            3  freebsd-swap  (10G)
   21180416   16777216                            4  freebsd-ufs  (8.0G)
   37957632  450439168                            5  freebsd-zfs  (215G)
  488396800        335                               - free -  (168K)

=>      3  1617794  da0  GPT  (1.9G) [CORRUPT]
        3     1600    1  efi  (800K)
     1603       34    2  freebsd-boot  (17K)
     1637  1614112    3  freebsd-ufs  (788M)
  1615749     2048    4  freebsd-swap  (1.0M)

========================================================================

1) Boot from ada0 WITHOUT USB memstick and ada1 attached (single drive).
   ada0 boots fine.

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Probing 6 block devices...
boot1 imagepath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(1)
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(1)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(2)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(3)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(4)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
probe: + supported
 done
    ZFS found the following pool: zsysS01
    UFS found 1 partitions
load: '/boot/loader.efi' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
load: '/boot.config' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
Failed to find '/boot.config' on pool 'zsysS01' (2)
load: '/boot/config' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
Failed to find '/boot/config' on pool 'zsysS01' (2)
Starting '/boot/loader.efi' in 5 seconds.......

========================================================================

2) Boot from ada0 without USB memstick attached (2 drives). 
   ada0 should boot, but ada1 boots.

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Probing 12 block devices...
boot1 imagepath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(1)
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(1)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(2)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(3)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(4)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(5)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(1)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(2)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(3)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(4)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
probe: + supported
 done
    ZFS found the following pool: zsysS02 zsysS01
    UFS found 2 partitions
load: '/boot/loader.efi' spa: 'zsysS02', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(5)
load: '/boot.config' spa: 'zsysS02', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(5)
Failed to find '/boot.config' on pool 'zsysS02' (2)
load: '/boot/config' spa: 'zsysS02', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(5)
Failed to find '/boot/config' on pool 'zsysS02' (2)
Starting '/boot/loader.efi' in 5 seconds.......

========================================================================

3) Boot from ada1 without USB memstick attached (2 drives). 
   ada1 should boot, but ada0 boots.

>> FreeBSD EFI boot block
   Loader path: /boot/loader.efi

   Initializing modules: ZFS UFS
   Probing 12 block devices...
boot1 imagepath: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(1)
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(1)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(2)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(3)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(4)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(1)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(2)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(3)
probe: . not supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(4)
probe: + supported
probing: pciroot(0x0):pci(0x1f,0x02):sata(0x1,0x0,0x0):hd(5)
probe: + supported
 done
    ZFS found the following pool: zsysS01 zsysS02
    UFS found 2 partitions
load: '/boot/loader.efi' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
load: '/boot.config' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
Failed to find '/boot.config' on pool 'zsysS01' (2)
load: '/boot/config' spa: 'zsysS01', devpath: pciroot(0x0):pci(0x1f,0x02):sata(0x0,0x0,0x0):hd(5)
Failed to find '/boot/config' on pool 'zsysS01' (2)
Starting '/boot/loader.efi' in 5 seconds.......

========================================================================

5) Boot from da0 [USB memstick] (3 drives).
   Currently not enough time to test... Sorry.

--Multipart=_Tue__2_Feb_2016_01_19_51_+0900_g3T6sGuW0hoQBFfK--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20160202011951.fac68e935a3f0b414a8f34cb>