From owner-freebsd-questions@FreeBSD.ORG Wed Dec 17 14:48:28 2003 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8F96D16A4CE for ; Wed, 17 Dec 2003 14:48:28 -0800 (PST) Received: from thunder.trej.net (as3-3-6.orby.s.bonet.se [217.215.33.185]) by mx1.FreeBSD.org (Postfix) with ESMTP id D8BF943D36 for ; Wed, 17 Dec 2003 14:48:22 -0800 (PST) (envelope-from freebsd@dagerot.nu) Received: from mailgw.trej.net (localhost [127.0.0.1])hBHMmDq31360 for ; Wed, 17 Dec 2003 23:48:13 +0100 Message-Id: <200312172248.hBHMmDq31360@thunder.trej.net> Date: Wed, 17 Dec 2003 23:48:12 +0100 Content-Transfer-Encoding: 8bit From: Joachim Dagerot Content-Type: text/plain; charset=utf-8 MIME-Version: 1.0 To: freebsd-questions@freebsd.org User-Agent: IMHO/0.98.3t (Webmail for Roxen) 3j-MailScanner-Information: Please contact the ISP for more information 3j-MailScanner: Found to be clean Subject: Vinum problem. Full error report attached. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Dec 2003 22:48:28 -0000 This is an old thread, that I have cleaned up to maybe get an answer. ********************************************* > What problems are you having? One of my drives are flagged down. Vinum reports that drive as "referenced". The other two drives in the RAID-5 is up. According to "vinum list" my subdisks are: s0 State: R 0% s1 State: crashed s2 State: stale ********************************************* ********************************************* > Which version of FreeBSD are you running? FreeBSD 5.1 > Have you made any changes to the system sources, including Vinum? Nope > Supply the output of the vinum list command. 2 drives: D b State: up /dev/ad4s1e A: 36/117796 MB (0%) D a State: up /dev/ad1s1e A: 36/117796 MB (0%) D c State: referenced unknown A: 0/0 MB 1 volumes: V raid State: down Plexes: 1 Size: 230GB 1 plexes: P raid.p0 R5 State: faulty Subdisks: 3 Size: 230 GB 3 subdisks: S raid.p0.s0 State: R 0% D: a Size: 115GB *** Start raid.p0.s0 with 'start' command *** S raid.p0.s1 State: crashed D: b Size: 115GB S raid.p0.s2 State: stale D: c Size: 115GB ********************************************* ********************************************* > Supply an extract of the Vinum history file Can't do that, can't run an editor now. (TMP drive read-only) ********************************************* ********************************************* > Supply an extract of the file /var/log/messages /var/log/messages: Dec 13 09:00:00 big newsyslog[786]: logfile turned over due to size>100K Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 237565992 of 237565992-237566023 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 237565992 of 237565992-237566023 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: raid.p0.s1 is crashed by force Dec 13 12:46:05 big kernel: vinum: raid.p0 is corrupt Dec 13 12:46:05 big kernel: fatal:raid.p0.s1 read error, block 237565929 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 475130592 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 238506216 of 238506216-238506247 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 238506216 of 238506216-238506247 status=7f error=7f Dec 13 12:46:05 big kernel: fatal:raid.p0.s1 read error, block 238506153 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 477011872 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=write fsbn 71 Dec 13 12:46:05 big kernel: ad4: hard error cmd=write fsbn 71 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: Can't write config to /dev/ad4s1e, error 5 Dec 13 12:46:05 big kernel: vinum: drive b is down Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=write fsbn 237565992 of 237565992-237566023 Dec 13 12:46:05 big kernel: ad4: hard error cmd=write fsbn 237565992 of 237565992-237566023 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: raid.p0.s1 is stale by force Dec 13 12:46:05 big kernel: fatal :raid.p0.s1 write error, block 237565929 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 475130592 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=write fsbn 238506216 of 238506216-238506247 Dec 13 12:46:05 big kernel: ad4: hard error cmd=write fsbn 238506216 of 238506216-238506247 status=7f error=7f Dec 13 12:46:05 big kernel: fatal :raid.p0.s1 write error, block 238506153 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 477011872 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 238506280 of 238506280-238506311 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 238506280 of 238506280-238506311 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: raid.p0.s1 is crashed by force Dec 13 12:46:05 big kernel: fatal:raid.p0.s1 read error, block 238506217 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 477011936 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=write fsbn 238506280 of 238506280-238506311 Dec 13 12:46:05 big kernel: ad4: hard error cmd=write fsbn 238506280 of 238506280-238506311 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: raid.p0.s1 is stale by force Dec 13 12:46:05 big kernel: fatal :raid.p0.s1 write error, block 238506217 for 16384 bytes Dec 13 12:46:05 big kernel: raid.p0.s1: user buffer block 477011936 for 16384 bytes Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 1 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 1 status=7f error=7f Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 0 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 0 status=7f error=7f Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 64 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 64 status=7f error=7f Dec 13 12:46:05 big kernel: ad4: soft error (ECC corrected) cmd=read fsbn 63 Dec 13 12:46:05 big kernel: ad4: hard error cmd=read fsbn 63 status=7f error=7f Dec 13 12:46:05 big kernel: vinum: raid.p0.s0 is stale by force Dec 13 12:46:05 big kernel: vinum: raid.p0 is faulty Dec 13 12:46:05 big kernel: vinum: raid is down … cut … Dec 16 00:25:28 big kernel: atapci1: port 0x1060-0x106f,0x1018-0x101b,0x1070-0x1077,0x101c-0x101f,0x1078-0x107f mem 0xe8004000-0xe8007fff irq 3 at device 17.0 on pci0 Dec 16 00:25:28 big kernel: ata2: at 0x1078 on atapci1 Dec 16 00:25:28 big kernel: ata3: at 0x1070 on atapci1 Dec 16 00:25:28 big kernel: fdc0: port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on acpi0 Dec 16 00:25:28 big kernel: fdc0: FIFO enabled, 8 bytes threshold Dec 16 00:25:28 big kernel: fd0: <1440-KB 3.5" drive> on fdc0 drive 0 Dec 16 00:25:28 big kernel: sio0 port 0x3f8-0x3ff irq 4 on acpi0 Dec 16 00:25:28 big kernel: sio0: type 16550A Dec 16 00:25:28 big kernel: atkbdc0: port 0x64,0x60 irq 1 on acpi0 Dec 16 00:25:28 big kernel: atkbd0: flags 0x1 irq 1 on atkbdc0 Dec 16 00:25:28 big kernel: kbd0 at atkbd0 Dec 16 00:25:28 big kernel: orm0: