Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 18 Apr 2024 09:37:43 -0400
From:      mike tancsa <mike@sentex.net>
To:        FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>
Subject:   zfs boot error on mirrored drive
Message-ID:  <82761f2b-475f-43ab-b045-95c60c330db7@sentex.net>

next in thread | raw e-mail | index | archive | help
I have a strange bootup issue on a test box that I just updated from 11, 
to 12 and now RELENG13.

Its a simple mirror. But if I boot up with ada0, I get an error and 
cannot boot further. Where as if I boot up with ada1, I get some errors 
and then proceeds to boot normally.

For one thing, I dont get where zbackup1 is coming from. The pool I boot 
from is zroot ?!? Where would that reference be stored ? I think ada0 
was part of another pool long ago (zbackup1).


Here is the error when booting from disk 0

BIOS drive C: is disk0
BIOS drive D: is disk1
zio_read error: 5
zio_read error: 5
ZFS: i/o error - all block copies unavailable
ZFS: can't read MOS of pool zbackup1
ZFS: can't find pool by guid

Can't find /boot/zfsloader

Can't find /boot/loader

Can't find /boot/kernel/kernel

FreeBSD/x86 boot
Default: /boot/kernel/kernel
boot:


Here are the messages when booting from disk 1

Loading /boot/d| disk1
zio_read error: 5
zio_read error: 5
ZFS: i/o error - all block copies unavailable
ZFS: can't read MOS of pool zbackup1
BIOS 615kB/3363840kB available memory

FreeBSD/x86 bootstrap loader, Revision 1.1

and it continues on from there and boots

After I did the zpool upgrade zroot, I did

gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada0
gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot -i 1 ada1


   pool: zroot
  state: ONLINE
   scan: resilvered 195G in 01:04:31 with 0 errors on Mon May 25 
16:08:21 2020
config:

         NAME        STATE     READ WRITE CKSUM
         zroot       ONLINE       0     0     0
           mirror-0  ONLINE       0     0     0
             ada0p3  ONLINE       0     0     0
             ada1p3  ONLINE       0     0     0

errors: No known data errors

Whats odd is that zbackup1 is not the name of the pool.  Where is that 
coming from ?  The pool I boot from is zroot on this box

Loading /boot/defaults/loader.conf Loading /boot/loader.conf.local
Loading /boot/d| disk1
zio_read error: 5
zio_read error: 5
ZFS: i/o error - all block copies unavailable
ZFS: can't read MOS of pool zbackup1
BIOS 615kB/3363840kB available memory

1(nanobsd2)# gpart list ada0
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
    Mediasize: 524288 (512K)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 20480
    Mode: r0w0e0
    efimedia: HD(1,GPT,55d32563-9eba-11ea-87ad-0007430611a8,0x28,0x400)
    rawuuid: 55d32563-9eba-11ea-87ad-0007430611a8
    rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
    label: (null)
    length: 524288
    offset: 20480
    type: freebsd-boot
    index: 1
    end: 1063
    start: 40
2. Name: ada0p2
    Mediasize: 21474836480 (20G)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 1048576
    Mode: r1w1e0
    efimedia: HD(2,GPT,55d3938d-9eba-11ea-87ad-0007430611a8,0x800,0x2800000)
    rawuuid: 55d3938d-9eba-11ea-87ad-0007430611a8
    rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
    label: (null)
    length: 21474836480
    offset: 1048576
    type: freebsd-swap
    index: 2
    end: 41945087
    start: 2048
3. Name: ada0p3
    Mediasize: 1978922958848 (1.8T)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 21475885056
    Mode: r1w1e1
    efimedia: 
HD(3,GPT,563d7775-9eba-11ea-87ad-0007430611a8,0x2800800,0xe6608000)
    rawuuid: 563d7775-9eba-11ea-87ad-0007430611a8
    rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
    label: (null)
    length: 1978922958848
    offset: 21475885056
    type: freebsd-zfs
    index: 3
    end: 3907028991
    start: 41945088
Consumers:
1. Name: ada0
    Mediasize: 2000398934016 (1.8T)
    Sectorsize: 512
    Mode: r2w2e3

0(nanobsd2)# gpart list ada1
Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
    Mediasize: 524288 (512K)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 20480
    Mode: r0w0e0
    efimedia: HD(1,GPT,25a0d50e-4207-11e6-8ebd-003048d6ef12,0x28,0x400)
    rawuuid: 25a0d50e-4207-11e6-8ebd-003048d6ef12
    rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
    label: gptboot1
    length: 524288
    offset: 20480
    type: freebsd-boot
    index: 1
    end: 1063
    start: 40
2. Name: ada1p2
    Mediasize: 21474836480 (20G)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 1048576
    Mode: r1w1e0
    efimedia: HD(2,GPT,25b0e143-4207-11e6-8ebd-003048d6ef12,0x800,0x2800000)
    rawuuid: 25b0e143-4207-11e6-8ebd-003048d6ef12
    rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
    label: swap1
    length: 21474836480
    offset: 1048576
    type: freebsd-swap
    index: 2
    end: 41945087
    start: 2048
3. Name: ada1p3
    Mediasize: 1978922958848 (1.8T)
    Sectorsize: 512
    Stripesize: 0
    Stripeoffset: 21475885056
    Mode: r1w1e1
    efimedia: 
HD(3,GPT,25c584a8-4207-11e6-8ebd-003048d6ef12,0x2800800,0xe6608000)
    rawuuid: 25c584a8-4207-11e6-8ebd-003048d6ef12
    rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
    label: zfs1
    length: 1978922958848
    offset: 21475885056
    type: freebsd-zfs
    index: 3
    end: 3907028991
    start: 41945088
Consumers:
1. Name: ada1
    Mediasize: 2000398934016 (1.8T)
    Sectorsize: 512
    Mode: r2w2e3


It looks like if I do just a

0(nanobsd2)# zpool import
    pool: zbackup1
      id: 5819795054093255811
   state: UNAVAIL
status: The pool was last accessed by another system.
  action: The pool cannot be imported due to damaged devices or data.
    see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-EY
  config:

         zbackup1                  UNAVAIL  insufficient replicas
           raidz2-2                UNAVAIL  insufficient replicas
             da5                   UNAVAIL  cannot open
             mfisyspd8             UNAVAIL  cannot open
             mfisyspd7             UNAVAIL  cannot open
             mfisyspd6             UNAVAIL  cannot open
             ada0                  UNAVAIL  cannot open
             17460231907795801757  UNAVAIL  cannot open
0(nanobsd2)#

it thinks ada0 is/was part of an old pool.  How do I get rid of that 
reference ?

     ---Mike




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?82761f2b-475f-43ab-b045-95c60c330db7>