From owner-freebsd-bugs@FreeBSD.ORG Sun Oct 11 12:40:03 2009 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2CA291065670 for ; Sun, 11 Oct 2009 12:40:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id E00C38FC12 for ; Sun, 11 Oct 2009 12:40:02 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n9BCe2Nt029660 for ; Sun, 11 Oct 2009 12:40:02 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n9BCe2Ra029658; Sun, 11 Oct 2009 12:40:02 GMT (envelope-from gnats) Resent-Date: Sun, 11 Oct 2009 12:40:02 GMT Resent-Message-Id: <200910111240.n9BCe2Ra029658@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Heikki Suonsivu Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5EBA01065672 for ; Sun, 11 Oct 2009 12:34:08 +0000 (UTC) (envelope-from hsu@news.bbnetworks.net) Received: from news.bbnetworks.net (news.bbnetworks.net [212.16.96.3]) by mx1.freebsd.org (Postfix) with ESMTP id 875948FC08 for ; Sun, 11 Oct 2009 12:34:06 +0000 (UTC) Received: from news.bbnetworks.net (localhost [127.0.0.1]) by news.bbnetworks.net (8.14.3/8.14.3) with ESMTP id n9BCY5rw001230 for ; Sun, 11 Oct 2009 15:34:05 +0300 (EEST) (envelope-from hsu@news.bbnetworks.net) Received: (from root@localhost) by news.bbnetworks.net (8.14.3/8.14.3/Submit) id n9BCY5hA001229; Sun, 11 Oct 2009 15:34:05 +0300 (EEST) (envelope-from hsu) Message-Id: <200910111234.n9BCY5hA001229@news.bbnetworks.net> Date: Sun, 11 Oct 2009 15:34:05 +0300 (EEST) From: Heikki Suonsivu To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Cc: Subject: kern/139510: gmirror disappears after boot on 2T disks X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Heikki Suonsivu List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 11 Oct 2009 12:40:03 -0000 >Number: 139510 >Category: kern >Synopsis: gmirror disappears after boot on 2T disks >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Sun Oct 11 12:40:02 UTC 2009 >Closed-Date: >Last-Modified: >Originator: Heikki Suonsivu >Release: FreeBSD 7.2-STABLE amd64 >Organization: bbnetworks.net >Environment: System: FreeBSD news.bbnetworks.net 7.2-STABLE FreeBSD 7.2-STABLE #0: Fri Aug 21 20:00:56 EEST 2009 root@news.bbnetworks.net:/usr/obj/usr/src/sys/BBNETWORKS7NEWS amd64 Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.2-STABLE #0: Fri Aug 21 20:00:56 EEST 2009 root@news.bbnetworks.net:/usr/obj/usr/src/sys/BBNETWORKS7NEWS Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) 64 Processor 3000+ (1809.28-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x20ff2 Stepping = 2 Features=0x78bfbff Features2=0x1 AMD Features=0xe2500800 AMD Features2=0x1 usable memory = 2133803008 (2034 MB) avail memory = 2057379840 (1962 MB) ACPI APIC Table: ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, 7fef0000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: at device 0.0 (no driver attached) isab0: at device 1.0 on pci0 isa0: on isab0 pci0: at device 1.1 (no driver attached) ohci0: mem 0xdc004000-0xdc004fff irq 21 at device 2.0 on pci0 ohci0: [GIANT-LOCKED] ohci0: [ITHREAD] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: on ohci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 10 ports with 10 removable, self powered ehci0: mem 0xfeb00000-0xfeb000ff irq 22 at device 2.1 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb1: EHCI version 1.0 usb1: companion controller, 4 ports each: usb0 usb1: on ehci0 usb1: USB revision 2.0 uhub1: on usb1 uhub1: 10 ports with 10 removable, self powered pci0: at device 4.0 (no driver attached) atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 6.0 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] atapci1: port 0x9f0-0x9f7,0xbf0-0xbf3,0x970-0x977,0xb70-0xb73,0xd800-0xd80f mem 0xdc002000-0xdc002fff irq 21 at device 7.0 on pci0 atapci1: [ITHREAD] ata2: on atapci1 ata2: [ITHREAD] ata3: on atapci1 ata3: [ITHREAD] atapci2: port 0x9e0-0x9e7,0xbe0-0xbe3,0x960-0x967,0xb60-0xb63,0xc400-0xc40f mem 0xdc001000-0xdc001fff irq 22 at device 8.0 on pci0 atapci2: [ITHREAD] ata4: on atapci2 ata4: [ITHREAD] ata5: on atapci2 ata5: [ITHREAD] pcib1: at device 9.0 on pci0 pci5: on pcib1 atapci3: port 0x8000-0x8007,0x8400-0x8403,0x8800-0x8807,0x8c00-0x8c03,0x9000-0x900f mem 0xdb008000-0xdb0083ff irq 19 at device 10.0 on pci5 atapci3: [ITHREAD] ata6: on atapci3 ata6: [ITHREAD] ata7: on atapci3 ata7: [ITHREAD] ata8: on atapci3 ata8: [ITHREAD] ata9: on atapci3 ata9: [ITHREAD] fwohci0: mem 0xdb009000-0xdb0097ff,0xdb000000-0xdb003fff irq 16 at device 11.0 on pci5 fwohci0: [FILTER] fwohci0: OHCI version 1.10 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:11:d8:00:00:5e:cf:a9 fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 dcons_crom0: on firewire0 dcons_crom0: bus_addr 0x7c314000 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:11:d8:5e:cf:a9 fwe0: Ethernet address: 02:11:d8:5e:cf:a9 fwip0: on firewire0 fwip0: Firewire address: 00:11:d8:00:00:5e:cf:a9 @ 0xfffe00000000, S400, maxrec 2048 sbp0: on firewire0 fwohci0: Initiate bus reset fwohci0: BUS reset fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode skc0: port 0x9400-0x94ff mem 0xdb004000-0xdb007fff irq 17 at device 12.0 on pci5 skc0: Marvell Yukon Lite Gigabit Ethernet rev. (0x9) sk0: on skc0 sk0: Ethernet address: 00:13:d4:b8:48:56 miibus0: on sk0 e1000phy0: PHY 0 on miibus0 e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto skc0: [ITHREAD] nfe0: port 0xb000-0xb007 mem 0xdc000000-0xdc000fff irq 23 at device 10.0 on pci0 miibus1: on nfe0 e1000phy1: PHY 1 on miibus1 e1000phy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto nfe0: Ethernet address: 00:13:d4:b8:3c:b8 nfe0: [FILTER] pcib2: at device 11.0 on pci0 pci4: on pcib2 pcib3: at device 12.0 on pci0 pci3: on pcib3 pcib4: at device 13.0 on pci0 pci2: on pcib4 pcib5: at device 14.0 on pci0 pci1: on pcib5 vgapci0: port 0xa000-0xa0ff mem 0xd0000000-0xd7ffffff,0xd9000000-0xd900ffff irq 18 at device 0.0 on pci1 vgapci1: mem 0xd9010000-0xd901ffff at device 0.1 on pci1 acpi_tz0: on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FILTER] sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] ppc0: port 0x378-0x37f,0x778-0x77b irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/16 bytes threshold ppbus0: on ppc0 ppbus0: [ITHREAD] plip0: on ppbus0 plip0: WARNING: using obsoleted IFF_NEEDSGIANT flag lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 ppc0: [GIANT-LOCKED] ppc0: [ITHREAD] cpu0: on acpi0 powernow0: on cpu0 device_attach: powernow0 attach returned 6 orm0: at iomem 0xc0000-0xcffff,0xd0000-0xd3fff,0xd4000-0xd8fff on isa0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounter "TSC" frequency 1809281007 Hz quality 800 Timecounters tick every 1.000 msec IP Filter: v4.1.28 initialized. Default = pass all, Logging = enabled ipfw2 (+ipv6) initialized, divert enabled, nat loadable, rule-based forwarding enabled, default to accept, logging limited to 1000 packets/entry by firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me) firewire0: bus manager 0 (me) default ad4: 953869MB at ata2-master SATA150 ad6: 239372MB at ata3-master SATA150 ad8: 239372MB at ata4-master SATA150 GEOM_MIRROR: Device mirror/boot launched (2/2). ad10: 953869MB at ata5-master SATA150 ad12: 1907729MB at ata6-master SATA150 GEOM_MIRROR: Device mirror/overview launched (2/2). ad14: 1907729MB at ata7-master SATA150 ad16: 1907729MB at ata8-master SATA150 ad18: 1907729MB at ata9-master SATA150 Trying to mount root from ufs:/dev/mirror/boots1a sk0: link state changed to UP gmirror output after boot Name Status Components mirror/overview COMPLETE ad4 ad10 mirror/boot COMPLETE ad6 ad8 I have tried several setups, changed partition sizes to keep the end of disk free, etc. A simplest gmirror commands I used were: gmirror label goodnews ad18 gmirror insert goodnews ad14 I tried changing slize sizes and balance algorithms, no effect. The mirror seems to work like the other mirrors until reboot. >Description: I have a system which already has 2 mirrors using gmirror, one for boot, two 250G disks, another with a pair of 1T disks. Now, I am trying to gmirror a 2T disk pair, with less success. Labeling the disks works fine, and as long as the system will be up, there is no apparent problem. However, if I reboot, the new gmirror disappears. The partition tables and bsd label are all there, so it seems to have been mirroring, so boot process is the first suspect here. The two other mirrors come up fine, and there are no boot-time errors. I partition I have been mirroring is live and has a filesystem, so I first created a 1-disk gmirror, and inserted the other disk to it. It does not seem to matter whether reboot happens before or after the mirror becomes COMPLETE. Non-mirrored partitions on same type of disks seem to work fine. >How-To-Repeat: My first guess would be that this is related to disk size. The problem disks are WDC 2T disks. >Fix: >Release-Note: >Audit-Trail: >Unformatted: