Date: Fri, 28 Dec 2007 08:05:31 +0100 From: "Nikolaj Hansen" <barnabasdk@gmail.com> To: freebsd-stable@freebsd.org Subject: Re: Failure of gvinum after panic Message-ID: <59d23e060712272305y3f27f909ue6eff0369cbf6883@mail.gmail.com> In-Reply-To: <59d23e060712271706v7dbbdee5v9dcb3f8c5d652b3a@mail.gmail.com> References: <59d23e060712271706v7dbbdee5v9dcb3f8c5d652b3a@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
A little more info on the config and how it should be: current config dump: # Vinum configuration of , saved at Fri Dec 28 07:31:54 2007 drive elben device /dev/da1s1h drive donau device /dev/da0s1h drive raid5_4_ad11 device /dev/ad11 drive raid5_3_ad10 device /dev/ad10 drive raid5_2_ad9 device /dev/ad9 drive raid5_1_ad8 device /dev/ad8 drive spree device /dev/ad4a volume data01 volume usr volume home volume tmp volume var volume media plex name data01.p0 org concat vol data01 plex name usr.p1 org concat plex name home.p1 org concat plex name tmp.p1 org concat plex name var.p1 org concat plex name usr.p0 org concat plex name home.p0 org concat plex name tmp.p0 org concat plex name var.p0 org concat plex name media.p0 org raid5 1024s vol media sd name data01.p0.s0 drive spree len 234434560s driveoffset 265s plex data01.p0 plexoffset 0s sd name usr.p1.s0 drive elben len 11521427s driveoffset 4505865s sd name home.p1.s0 drive elben len 2048000s driveoffset 2457865s sd name tmp.p1.s0 drive elben len 1228800s driveoffset 1229065s sd name var.p1.s0 drive elben len 1228800s driveoffset 265s sd name usr.p0.s0 drive donau len 11521427s driveoffset 4505865s sd name home.p0.s0 drive donau len 2048000s driveoffset 2457865s sd name tmp.p0.s0 drive donau len 1228800s driveoffset 1229065s sd name var.p0.s0 drive donau len 1228800s driveoffset 265s sd name media.p0.s0 drive raid5_1_ad8 len 398282752s driveoffset 265s plex media.p0 plexoffset 0s sd name media.p0.s1 drive raid5_2_ad9 len 398282752s driveoffset 265s plex media.p0 plexoffset 1024s sd name media.p0.s2 drive raid5_3_ad10 len 398282752s driveoffset 265s plex media.p0 plexoffset 2048s sd name media.p0.s3 drive raid5_4_ad11 len 398282752s driveoffset 265s How the plexes should read out: P usr.p1 C State: up Subdisks: 1 Size: 5625 MB P home.p1 C State: up Subdisks: 1 Size: 1000 MB P tmp.p1 C State: up Subdisks: 1 Size: 600 MB P var.p1 C State: up Subdisks: 1 Size: 600 MB P usr.p0 C State: up Subdisks: 1 Size: 5625 MB P home.p0 C State: up Subdisks: 1 Size: 1000 MB P tmp.p0 C State: up Subdisks: 1 Size: 600 MB P var.p0 C State: up Subdisks: 1 Size: 600 MB The way it reads out: P usr.p1 C State: up Subdisks: 0 Size: 0 B P home.p1 C State: up Subdisks: 0 Size: 0 B P tmp.p1 C State: up Subdisks: 0 Size: 0 B P var.p1 C State: up Subdisks: 0 Size: 0 B P usr.p0 C State: up Subdisks: 0 Size: 0 B P home.p0 C State: up Subdisks: 0 Size: 0 B P tmp.p0 C State: up Subdisks: 0 Size: 0 B P var.p0 C State: up Subdisks: 0 Size: 0 B The difference is obvious - somehow gvinum lost track of the plex to subdisk relations. Is there any way of restoring these? What would happen if I where to re-create the Plexes? (Drop/create) and then saveconfig? Thanks Nikolaj Hansen On Dec 28, 2007 2:06 AM, Nikolaj Hansen <barnabasdk@gmail.com> wrote: > Hi all, > > I have some problems with my gvinum setup after the system panic'ed. > Afterwards the system fails finding the plexes to the subdisks (or at > least that is what I can understand after having searched the gvinum > source code for the error string in the DMESG log..) > > The machine is an IBM Netfinity 5000 and the internal HW self tests > does not find any errors in the hw. > > Luckily my root is not on a gvinum drive, so I am able to boot the > server in single user. > > Does anyone have any hints as to what I can do to get gvinum to > recognize the disks correctly? > > The system is 6.3 stable > > Dont worry about the media disks or anything right now - I am trying > to revive the system disks for now. > > Thanks > > Nikolaj Hansen > > 7 drives: > D elben State: up /dev/da1s1h A: 0/7825 MB (0%) > D donau State: up /dev/da0s1h A: 0/7825 MB (0%) > D raid5_4_ad11 State: up /dev/ad11 A: 6/194480 MB (0%) > D raid5_3_ad10 State: up /dev/ad10 A: 6/194480 MB (0%) > D raid5_2_ad9 State: up /dev/ad9 A: 6/194480 MB (0%) > D raid5_1_ad8 State: up /dev/ad8 A: 6/194480 MB (0%) > D spree State: up /dev/ad4a A: 3/114473 MB (0%) > > 6 volumes: > V data01 State: up Plexes: 1 Size: 111 GB > V usr State: up Plexes: 0 Size: 0 B > V home State: up Plexes: 0 Size: 0 B > V tmp State: up Plexes: 0 Size: 0 B > V var State: up Plexes: 0 Size: 0 B > V media State: up Plexes: 1 Size: 379 GB > > 10 plexes: > P data01.p0 C State: up Subdisks: 1 Size: 111 GB > P usr.p1 C State: up Subdisks: 0 Size: 0 B > P home.p1 C State: up Subdisks: 0 Size: 0 B > P tmp.p1 C State: up Subdisks: 0 Size: 0 B > P var.p1 C State: up Subdisks: 0 Size: 0 B > P usr.p0 C State: up Subdisks: 0 Size: 0 B > P home.p0 C State: up Subdisks: 0 Size: 0 B > P tmp.p0 C State: up Subdisks: 0 Size: 0 B > P var.p0 C State: up Subdisks: 0 Size: 0 B > P media.p0 R5 State: degraded Subdisks: 3 Size: 379 GB > > 13 subdisks: > S data01.p0.s0 State: up D: spree Size: 111 GB > S usr.p1.s0 State: up D: elben Size: 5625 MB > S home.p1.s0 State: up D: elben Size: 1000 MB > S tmp.p1.s0 State: up D: elben Size: 600 MB > S var.p1.s0 State: up D: elben Size: 600 MB > S usr.p0.s0 State: up D: donau Size: 5625 MB > S home.p0.s0 State: up D: donau Size: 1000 MB > S tmp.p0.s0 State: up D: donau Size: 600 MB > S var.p0.s0 State: up D: donau Size: 600 MB > S media.p0.s0 State: up D: raid5_1_ad8 Size: 189 GB > S media.p0.s1 State: up D: raid5_2_ad9 Size: 189 GB > S media.p0.s2 State: stale D: raid5_3_ad10 Size: 189 GB > S media.p0.s3 State: up D: raid5_4_ad11 Size: 189 GB > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p6 #0: Wed Jul 18 23:33:58 CEST 2007 > root@sauron.barnabas.dk:/usr/src/sys/i386/compile/KERNEL_6_2 > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Pentium III/Pentium III Xeon/Celeron (498.67-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0x673 Stepping = 3 > Features=0x387fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,PN,MMX,FXSR,SSE> > real memory = 536854528 (511 MB) > avail memory = 515715072 (491 MB) > ACPI APIC Table: <IBM SERMOHIC> > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 1 > cpu1 (AP): APIC ID: 0 > MADT: Forcing active-low polarity and level trigger for SCI > ioapic0 <Version 1.1> irqs 0-23 on motherboard > kbd1 at kbdmux0 > acpi0: <IBM SERMOHIC> on motherboard > acpi0: Power Button (fixed) > Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 > acpi_timer0: <24-bit timer at 3.579545MHz> port 0xfe88-0xfe8b on acpi0 > cpu0: <ACPI CPU> on acpi0 > cpu1: <ACPI CPU> on acpi0 > pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 > pci0: <ACPI PCI bus> on pcib0 > skc0: <3Com 3C940 Gigabit Ethernet> port 0x2000-0x20ff mem > 0xfebfc000-0xfebfffff irq 18 at device 1.0 on pci0 > skc0: 3Com Gigabit NIC (3C2000) rev. (0x1) > sk0: <Marvell Semiconductor, Inc. Yukon> on skc0 > sk0: Ethernet address: 00:0a:5e:5c:c0:83 > miibus0: <MII bus> on sk0 > e1000phy0: <Marvell 88E1000 Gigabit PHY> on miibus0 > e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto > ahc0: <Adaptec aic7895 Ultra SCSI adapter> port 0x2200-0x22ff mem > 0xfebfb000-0xfebfbfff irq 16 at device 6.0 on pci0 > ahc0: [GIANT-LOCKED] > aic7895C: Ultra Wide Channel A, SCSI Id=7, 32/253 SCBs > ahc1: <Adaptec aic7895 Ultra SCSI adapter> port 0x2300-0x23ff mem > 0xfebfa000-0xfebfafff irq 16 at device 6.1 on pci0 > ahc1: [GIANT-LOCKED] > aic7895C: Ultra Wide Channel B, SCSI Id=15, 32/253 SCBs > s3pci0: <S3 graphic card> port 0x3c0-0x3df,0x4ae8 mem > 0xf8000000-0xfbffffff irq 9 at device 10.0 on pci0 > isab0: <PCI-ISA bridge> port 0xfe00-0xfe0f at device 15.0 on pci0 > isa0: <ISA bus> on isab0 > atapci0: <GENERIC ATA controller> port > 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376 irq 18 at device 15.1 on pci0 > ata0: <ATA channel 0> on atapci0 > ata1: <ATA channel 1> on atapci0 > ohci0: <OHCI (generic) USB controller> mem 0xff700000-0xff700fff irq > 18 at device 15.2 on pci0 > ohci0: [GIANT-LOCKED] > usb0: OHCI version 1.0, legacy support > usb0: <OHCI (generic) USB controller> on ohci0 > usb0: USB revision 1.0 > uhub0: (0x1166) OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub0: 2 ports with 2 removable, self powered > pcib1: <ACPI Host-PCI bridge> on acpi0 > pci1: <ACPI PCI bus> on pcib1 > atapci1: <CMD 649 UDMA100 controller> port > 0x4af0-0x4af7,0x4aec-0x4aef,0x4af8-0x4aff,0x4b00-0x4b03,0x4b10-0x4b1f > irq 19 at device 2.0 on pci1 > ata2: <ATA channel 0> on atapci1 > ata3: <ATA channel 1> on atapci1 > atapci2: <Promise PDC20268 UDMA100 controller> port > 0x4b08-0x4b0f,0x4b04-0x4b07,0x4b20-0x4b27,0x4b28-0x4b2b,0x4b30-0x4b3f > mem 0xc0fdc000-0xc0fdffff irq 19 at device 3.0 on pci1 > ata4: <ATA channel 0> on atapci2 > ata5: <ATA channel 1> on atapci2 > atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 > atkbd0: <AT Keyboard> irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > fdc0: <floppy drive controller> port 0x3f2-0x3f7,0x3f7 irq 6 drq 2 on acpi0 > fdc0: No FDOUT register! > device_attach: fdc0 attach returned 6 > ppc0: <ECP parallel printer port> port 0x378-0x37f,0x778-0x77f irq 7 > drq 1 on acpi0 > ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode > ppc0: FIFO with 16/16/8 bytes threshold > ppbus0: <Parallel port bus> on ppc0 > ppbus0: IEEE1284 device found /NIBBLE/ECP > Probing for PnP devices on ppbus0: > ppbus0: <HEWLETT-PACKARD DESKJET 930C> MLC,PCL,PML > plip0: <PLIP network interface> on ppbus0 > lpt0: <Printer> on ppbus0 > lpt0: Interrupt-driven port > ppi0: <Parallel I/O> on ppbus0 > sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > sio0: type 16550A > sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 > sio1: type 16550A > fdc0: <floppy drive controller> port 0x3f2-0x3f7,0x3f7 irq 6 drq 2 on acpi0 > fdc0: No FDOUT register! > device_attach: fdc0 attach returned 6 > pmtimer0 on isa0 > orm0: <ISA Option ROMs> at iomem > 0xc0000-0xc7fff,0xc8000-0xccfff,0xcd000-0xcd7ff,0xcd800-0xd17ff,0xd1800-0xd3fff > on isa0 > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > sc0: <System console> at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > umass0: Kingston DataTraveler II, rev 2.00/1.00, addr 2 > Timecounters tick every 1.000 msec > ad4: 114473MB <WDC WD1200JB-00FUA0 15.05R15> at ata2-master UDMA100 > ad6: 114473MB <WDC WD1200JB-00CRA1 17.07W17> at ata3-master UDMA100 > ad8: 194481MB <Maxtor 6Y200P0 YAR41BW0> at ata4-master UDMA100 > ad9: 194481MB <Maxtor 6Y200P0 YAR41BW0> at ata4-slave UDMA100 > ad10: 194481MB <Maxtor 6Y200P0 YAR41BW0> at ata5-master UDMA100 > ad11: 194481MB <Maxtor 6Y200P0 YAR41BW0> at ata5-slave UDMA100 > Waiting 5 seconds for SCSI devices to settle > gv_plex_taste: NULL p for 'media.p0.s3' > ses0 at ahc1 bus 0 target 14 lun 0 > ses0: <SDR GEM200 2> Fixed Processor SCSI-2 device > ses0: 3.300MB/s transfers > ses0: SAF-TE Compliant Device > da0 at ahc1 bus 0 target 0 lun 0 > da0: <IBM-PSG ST39103LC !# B227> Fixed Direct Access SCSI-2 device > da0: 40.000MB/s transfers (20.000MHz, offset 8, 16bit), Tagged Queueing Enabled > da0: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) > da1 at ahc1 bus 0 target 1 lun 0 > da1: <IBM-PSG DMVS09D !# 01B0> Fixed Direct Access SCSI-3 device > da1: 40.000MB/s transfers (20.000MHz, offset 8, 16bit), Tagged Queueing Enabled > da1: 8678MB (17774160 512 byte sectors: 255H 63S/T 1106C) > SMP: AP CPU #1 Launched! > da2 at umass-sim0 bus 0 target 0 lun 0 > da2: <Kingston DataTraveler II PMAP> Removable Direct Access SCSI-0 device > da2: 1.000MB/s transfers > da2: 983MB (2014208 512 byte sectors: 64H 32S/T 983C) > gv_plex_taste: NULL p for 'var.p0.s0' > gv_plex_taste: NULL p for 'tmp.p0.s0' > gv_plex_taste: NULL p for 'home.p0.s0' > gv_plex_taste: NULL p for 'usr.p0.s0' > gv_plex_taste: NULL p for 'var.p1.s0' > gv_plex_taste: NULL p for 'tmp.p1.s0' > gv_plex_taste: NULL p for 'home.p1.s0' > gv_plex_taste: NULL p for 'usr.p1.s0' > Trying to mount root from ufs:/dev/da0s1a > WARNING: / was not properly dismounted > WARNING: R/W mount of / denied. Filesystem is not clean - run fsck > > Subdisk usr.p0.s0: > Size: 5898970624 bytes (5625 MB) > State: up > Drive donau (donau) at offset 2307002880 (2200 MB) > > /dev/da0s1b none swap sw 0 0 > /dev/da1s1b none swap sw 0 0 > /dev/da0s1a / ufs rw 1 5 > /dev/gvinum/home /home ufs rw 2 5 > /dev/da1s1a /rootback ufs rw 2 6 > /dev/gvinum/tmp /tmp ufs rw 2 1 > /dev/gvinum/usr /usr ufs rw 2 2 > /dev/gvinum/var /var ufs rw 2 3 > /dev/cd0 /cdrom cd9660 ro,noauto 0 0 > /dev/acd0 /cdrom1 cd9660 ro,noauto 0 0 > #/dev/ad6s1 /mnt/media ufs rw 1 1 > #/dev/gvinum/data01 /mnt/data2 ufs rw,noauto 0 0 > #/dev/gvinum/media /mnt/media ufs rw,noauto 1 4 >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?59d23e060712272305y3f27f909ue6eff0369cbf6883>