Date: Sun, 11 Oct 2009 15:34:05 +0300 (EEST) From: Heikki Suonsivu <hsu@bbnetworks.net> To: FreeBSD-gnats-submit@FreeBSD.org Subject: kern/139510: gmirror disappears after boot on 2T disks Message-ID: <200910111234.n9BCY5hA001229@news.bbnetworks.net> Resent-Message-ID: <200910111240.n9BCe2Ra029658@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 139510
>Category: kern
>Synopsis: gmirror disappears after boot on 2T disks
>Confidential: no
>Severity: serious
>Priority: medium
>Responsible: freebsd-bugs
>State: open
>Quarter:
>Keywords:
>Date-Required:
>Class: sw-bug
>Submitter-Id: current-users
>Arrival-Date: Sun Oct 11 12:40:02 UTC 2009
>Closed-Date:
>Last-Modified:
>Originator: Heikki Suonsivu
>Release: FreeBSD 7.2-STABLE amd64
>Organization:
bbnetworks.net
>Environment:
System: FreeBSD news.bbnetworks.net 7.2-STABLE FreeBSD 7.2-STABLE #0: Fri Aug 21 20:00:56 EEST 2009 root@news.bbnetworks.net:/usr/obj/usr/src/sys/BBNETWORKS7NEWS amd64
Copyright (c) 1992-2009 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 7.2-STABLE #0: Fri Aug 21 20:00:56 EEST 2009
root@news.bbnetworks.net:/usr/obj/usr/src/sys/BBNETWORKS7NEWS
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: AMD Athlon(tm) 64 Processor 3000+ (1809.28-MHz K8-class CPU)
Origin = "AuthenticAMD" Id = 0x20ff2 Stepping = 2
Features=0x78bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2>
Features2=0x1<SSE3>
AMD Features=0xe2500800<SYSCALL,NX,MMX+,FFXSR,LM,3DNow!+,3DNow!>
AMD Features2=0x1<LAHF>
usable memory = 2133803008 (2034 MB)
avail memory = 2057379840 (1962 MB)
ACPI APIC Table: <Nvidia AWRDACPI>
ioapic0 <Version 1.1> irqs 0-23 on motherboard
kbd1 at kbdmux0
acpi0: <Nvidia AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 7fef0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pci0: <memory> at device 0.0 (no driver attached)
isab0: <PCI-ISA bridge> at device 1.0 on pci0
isa0: <ISA bus> on isab0
pci0: <serial bus, SMBus> at device 1.1 (no driver attached)
ohci0: <OHCI (generic) USB controller> mem 0xdc004000-0xdc004fff irq 21 at device 2.0 on pci0
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0, legacy support
usb0: SMM does not respond, resetting
usb0: <OHCI (generic) USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 10 ports with 10 removable, self powered
ehci0: <NVIDIA nForce4 USB 2.0 controller> mem 0xfeb00000-0xfeb000ff irq 22 at device 2.1 on pci0
ehci0: [GIANT-LOCKED]
ehci0: [ITHREAD]
usb1: EHCI version 1.0
usb1: companion controller, 4 ports each: usb0
usb1: <NVIDIA nForce4 USB 2.0 controller> on ehci0
usb1: USB revision 2.0
uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1
uhub1: 10 ports with 10 removable, self powered
pci0: <multimedia, audio> at device 4.0 (no driver attached)
atapci0: <nVidia nForce CK804 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 6.0 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
atapci1: <nVidia nForce CK804 SATA300 controller> port 0x9f0-0x9f7,0xbf0-0xbf3,0x970-0x977,0xb70-0xb73,0xd800-0xd80f mem 0xdc002000-0xdc002fff irq 21 at device 7.0 on pci0
atapci1: [ITHREAD]
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
atapci2: <nVidia nForce CK804 SATA300 controller> port 0x9e0-0x9e7,0xbe0-0xbe3,0x960-0x967,0xb60-0xb63,0xc400-0xc40f mem 0xdc001000-0xdc001fff irq 22 at device 8.0 on pci0
atapci2: [ITHREAD]
ata4: <ATA channel 0> on atapci2
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci2
ata5: [ITHREAD]
pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0
pci5: <ACPI PCI bus> on pcib1
atapci3: <SiI SiI 3114 SATA150 controller> port 0x8000-0x8007,0x8400-0x8403,0x8800-0x8807,0x8c00-0x8c03,0x9000-0x900f mem 0xdb008000-0xdb0083ff irq 19 at device 10.0 on pci5
atapci3: [ITHREAD]
ata6: <ATA channel 0> on atapci3
ata6: [ITHREAD]
ata7: <ATA channel 1> on atapci3
ata7: [ITHREAD]
ata8: <ATA channel 2> on atapci3
ata8: [ITHREAD]
ata9: <ATA channel 3> on atapci3
ata9: [ITHREAD]
fwohci0: <Texas Instruments TSB43AB22/A> mem 0xdb009000-0xdb0097ff,0xdb000000-0xdb003fff irq 16 at device 11.0 on pci5
fwohci0: [FILTER]
fwohci0: OHCI version 1.10 (ROM=1)
fwohci0: No. of Isochronous channels is 4.
fwohci0: EUI64 00:11:d8:00:00:5e:cf:a9
fwohci0: Phy 1394a available S400, 2 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
dcons_crom0: <dcons configuration ROM> on firewire0
dcons_crom0: bus_addr 0x7c314000
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 02:11:d8:5e:cf:a9
fwe0: Ethernet address: 02:11:d8:5e:cf:a9
fwip0: <IP over FireWire> on firewire0
fwip0: Firewire address: 00:11:d8:00:00:5e:cf:a9 @ 0xfffe00000000, S400, maxrec 2048
sbp0: <SBP-2/SCSI over FireWire> on firewire0
fwohci0: Initiate bus reset
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode
skc0: <Marvell Gigabit Ethernet> port 0x9400-0x94ff mem 0xdb004000-0xdb007fff irq 17 at device 12.0 on pci5
skc0: Marvell Yukon Lite Gigabit Ethernet rev. (0x9)
sk0: <Marvell Semiconductor, Inc. Yukon> on skc0
sk0: Ethernet address: 00:13:d4:b8:48:56
miibus0: <MII bus> on sk0
e1000phy0: <Marvell 88E1011 Gigabit PHY> PHY 0 on miibus0
e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
skc0: [ITHREAD]
nfe0: <NVIDIA nForce4 CK804 MCP9 Networking Adapter> port 0xb000-0xb007 mem 0xdc000000-0xdc000fff irq 23 at device 10.0 on pci0
miibus1: <MII bus> on nfe0
e1000phy1: <Marvell 88E1111 Gigabit PHY> PHY 1 on miibus1
e1000phy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto
nfe0: Ethernet address: 00:13:d4:b8:3c:b8
nfe0: [FILTER]
pcib2: <ACPI PCI-PCI bridge> at device 11.0 on pci0
pci4: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> at device 12.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 13.0 on pci0
pci2: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 14.0 on pci0
pci1: <ACPI PCI bus> on pcib5
vgapci0: <VGA-compatible display> port 0xa000-0xa0ff mem 0xd0000000-0xd7ffffff,0xd9000000-0xd900ffff irq 18 at device 0.0 on pci1
vgapci1: <VGA-compatible display> mem 0xd9010000-0xd901ffff at device 0.1 on pci1
acpi_tz0: <Thermal Zone> on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: configured irq 4 not in bitmap of probed irqs 0
sio0: port may not be enabled
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A
sio0: [FILTER]
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77b irq 7 drq 3 on acpi0
ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
ppc0: FIFO with 16/16/16 bytes threshold
ppbus0: <Parallel port bus> on ppc0
ppbus0: [ITHREAD]
plip0: <PLIP network interface> on ppbus0
plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
ppc0: [GIANT-LOCKED]
ppc0: [ITHREAD]
cpu0: <ACPI CPU> on acpi0
powernow0: <Cool`n'Quiet K8> on cpu0
device_attach: powernow0 attach returned 6
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcffff,0xd0000-0xd3fff,0xd4000-0xd8fff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 1809281007 Hz quality 800
Timecounters tick every 1.000 msec
IP Filter: v4.1.28 initialized. Default = pass all, Logging = enabled
ipfw2 (+ipv6) initialized, divert enabled, nat loadable, rule-based forwarding enabled, default to accept, logging limited to 1000 packets/entry by firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me)
firewire0: bus manager 0 (me)
default
ad4: 953869MB <Seagate ST31000340AS SD01> at ata2-master SATA150
ad6: 239372MB <WDC WD2500YD-01NVB1 10.02E01> at ata3-master SATA150
ad8: 239372MB <WDC WD2500YD-01NVB1 10.02E01> at ata4-master SATA150
GEOM_MIRROR: Device mirror/boot launched (2/2).
ad10: 953869MB <Seagate ST31000340AS SD04> at ata5-master SATA150
ad12: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata6-master SATA150
GEOM_MIRROR: Device mirror/overview launched (2/2).
ad14: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata7-master SATA150
ad16: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata8-master SATA150
ad18: 1907729MB <WDC WD20EADS-00R6B0 01.00A01> at ata9-master SATA150
Trying to mount root from ufs:/dev/mirror/boots1a
sk0: link state changed to UP
gmirror output after boot
Name Status Components
mirror/overview COMPLETE ad4
ad10
mirror/boot COMPLETE ad6
ad8
I have tried several setups, changed partition sizes to keep the end
of disk free, etc.
A simplest gmirror commands I used were:
gmirror label goodnews ad18
gmirror insert goodnews ad14
I tried changing slize sizes and balance algorithms, no effect.
The mirror seems to work like the other mirrors until reboot.
>Description:
I have a system which already has 2 mirrors using gmirror, one for
boot, two 250G disks, another with a pair of 1T disks. Now, I am
trying to gmirror a 2T disk pair, with less success.
Labeling the disks works fine, and as long as the system will be up,
there is no apparent problem. However, if I reboot, the new gmirror
disappears. The partition tables and bsd label are all there, so it
seems to have been mirroring, so boot process is the first suspect
here. The two other mirrors come up fine, and there are no boot-time
errors.
I partition I have been mirroring is live and has a filesystem, so I
first created a 1-disk gmirror, and inserted the other disk to it. It
does not seem to matter whether reboot happens before or after the
mirror becomes COMPLETE.
Non-mirrored partitions on same type of disks seem to work fine.
>How-To-Repeat:
My first guess would be that this is related to disk size. The
problem disks are WDC 2T disks.
>Fix:
>Release-Note:
>Audit-Trail:
>Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200910111234.n9BCY5hA001229>