From owner-freebsd-questions@FreeBSD.ORG Tue May 6 10:41:43 2003 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D747E37B401 for ; Tue, 6 May 2003 10:41:43 -0700 (PDT) Received: from mail.seekingfire.com (coyote.seekingfire.com [24.72.10.212]) by mx1.FreeBSD.org (Postfix) with ESMTP id EE7A643FAF for ; Tue, 6 May 2003 10:41:41 -0700 (PDT) (envelope-from tillman@seekingfire.com) Received: from blues.seekingfire.prv (blues.seekingfire.prv [192.168.23.211]) by mail.seekingfire.com (Postfix) with ESMTP id A72D662 for ; Tue, 6 May 2003 11:41:40 -0600 (CST) Received: (from tillman@localhost) by blues.seekingfire.prv (8.11.6/8.11.6) id h46HhEY18696 for freebsd-questions@freebsd.org; Tue, 6 May 2003 11:43:14 -0600 Date: Tue, 6 May 2003 11:43:14 -0600 From: Tillman To: FreeBSD-Questions Message-ID: <20030506114314.F1517@seekingfire.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5.1i X-Urban-Legend: There is lots of hidden information in headers Subject: Vinum: after kernel panic, incorrect avail shown on drives (long) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 May 2003 17:41:44 -0000 (Warning: long and verbose message. I'm following the directions on http://www.vinumvm.org/, so there's lots of details here). Quick problem summary ===================== `vinum ld` reports 5120M of available free space on a drive that is actually full. This occurred after I made two sets of mistakes while trying to expand a volume (something I still find complex, apparantly). The details of the mistakes are given as paragraph above the 'vinum history' below. Vinum appears to be working correctly, and all filesystems pass a fsck check (required, as the computer went down dirty). I'm worried about the inconsistency, though, as it doesn't bode well for the future. Version info ============ I'm running FreeBSD 4.8-STABLE (Tue Apr 29 10:26:03 CST 2003), with no changes to kernel or vinum sources. Confirming that the drive really is full ======================================== I've confirmed that the drive is, indeed, full by using `vinum printconfig | grep yin` ("yin" is one of the two drives in the mirror, no points for guessing the other drives name) to get teh names of the subdisks that are on one of those identical drives and then running: vinum ls mp3.p0.s0 iso.p0.s0 tillman.p0.s0 pub.p0.s0 syslog.p0.s0 \ www.p0.s0 ad.p0.s0 backups.p0.s0 usr.obj.p0.s0 iso.p0.s0 \ www.rw.p0.s0 named.p0.s0 usr.local.p0.s0 | \ awk -v ORS=" + " '{print $9}END{print "0\n"}' | bc Which results in "38172". Comparing that to `vinum ld yin`: D yin State: up Device /dev/ad0s1e Avail: 5120/38172 MB (13%) Thus 38172 should represent a full drive. vinum list (warning: wide) ========================== [root@athena root]# vinum list 4 drives: D yin State: up Device /dev/ad0s1e Avail: 5120/38172 MB (13%) D yang State: up Device /dev/ad2s1e Avail: 5120/38172 MB (13%) D heaven State: up Device /dev/da3s1e Avail: 20172/44876 MB (44%) D earth State: up Device /dev/da4s1e Avail: 20172/44876 MB (44%) 17 volumes: V mp3 State: up Plexes: 2 Size: 5120 MB V iso State: up Plexes: 2 Size: 5596 MB V tillman State: up Plexes: 2 Size: 5120 MB V pub State: up Plexes: 2 Size: 4096 MB V syslog State: up Plexes: 2 Size: 5120 MB V www State: up Plexes: 2 Size: 1024 MB V ad State: up Plexes: 2 Size: 9216 MB V backups State: up Plexes: 2 Size: 5120 MB V usr.obj State: up Plexes: 2 Size: 1024 MB V tillman.backup1 State: up Plexes: 1 Size: 5120 MB V www.rw State: up Plexes: 2 Size: 500 MB V named State: up Plexes: 2 Size: 10 MB V usr.local State: up Plexes: 2 Size: 1346 MB V homes State: up Plexes: 2 Size: 10 GB V ports State: up Plexes: 2 Size: 4096 MB V tillman.backup2 State: up Plexes: 1 Size: 5120 MB V cache State: up Plexes: 2 Size: 128 MB 34 subdisks: S mp3.p0.s0 State: up PO: 0 B Size: 5120 MB S mp3.p1.s0 State: up PO: 0 B Size: 5120 MB S iso.p0.s0 State: up PO: 0 B Size: 4096 MB S iso.p1.s0 State: up PO: 0 B Size: 4096 MB S tillman.p0.s0 State: up PO: 0 B Size: 5120 MB S tillman.p1.s0 State: up PO: 0 B Size: 5120 MB S pub.p0.s0 State: up PO: 0 B Size: 4096 MB S pub.p1.s0 State: up PO: 0 B Size: 4096 MB S syslog.p0.s0 State: up PO: 0 B Size: 5120 MB S syslog.p1.s0 State: up PO: 0 B Size: 5120 MB S www.p0.s0 State: up PO: 0 B Size: 1024 MB S www.p1.s0 State: up PO: 0 B Size: 1024 MB S ad.p0.s0 State: up PO: 0 B Size: 4096 MB S ad.p1.s0 State: up PO: 0 B Size: 4096 MB S backups.p0.s0 State: up PO: 0 B Size: 5120 MB S backups.p1.s0 State: up PO: 0 B Size: 5120 MB S usr.obj.p0.s0 State: up PO: 0 B Size: 1024 MB S usr.obj.p1.s0 State: up PO: 0 B Size: 1024 MB S iso.p0.s1 State: up PO: 4096 MB Size: 1500 MB S iso.p1.s1 State: up PO: 4096 MB Size: 1500 MB S www.rw.p0.s0 State: up PO: 0 B Size: 500 MB S www.rw.p1.s0 State: up PO: 0 B Size: 500 MB S named.p0.s0 State: up PO: 0 B Size: 10 MB S named.p1.s0 State: up PO: 0 B Size: 10 MB S usr.local.p0.s0 State: up PO: 0 B Size: 1346 MB S usr.local.p1.s0 State: up PO: 0 B Size: 1346 MB S homes.p0.s0 State: up PO: 0 B Size: 10 GB S homes.p1.s0 State: up PO: 0 B Size: 10 GB S ports.p0.s0 State: up PO: 0 B Size: 4096 MB S ports.p1.s0 State: up PO: 0 B Size: 4096 MB S tillman.backup1.p0.s0 State: up PO: 0 B Size: 5120 MB S tillman.backup2.p0.s0 State: up PO: 0 B Size: 5120 MB S cache.p0.s0 State: up PO: 0 B Size: 128 MB S cache.p1.s0 State: up PO: 0 B Size: 128 MB S ad.p0.s1 State: up PO: 4096 MB Size: 5120 MB S ad.p1.s1 State: up PO: 4096 MB Size: 5120 MB vinum history ============= Note that vinum10.conf was first name of the config file I was intended to use with 'vinum create -f'. My first mistake (besides having having a completely wrong approach to growing volumes) was that I forgot to change the volume name (and which resulted in my first ever kernel panic). Next, I had edited it show the correct volume name (and neglected to figure out that I still didn't want to create a new volume, just make new subdisks and attach them to the existing volume). Lastly, vinum10.conf is the working config file where I had things correct. Third try's the charm, I guess :-) 5 May 2003 18:45:01.977785 *** vinum started *** 5 May 2003 18:45:06.788381 create -f /etc/vinum10.conf volume cache setupstate plex org concat sd length 5120m drive heaven plex org concat sd length 5120m drive earth 5 May 2003 18:45:06.790121 *** Created devices *** 5 May 2003 18:45:36.382621 help 5 May 2003 18:48:21.229082 *** vinum started *** 5 May 2003 18:48:21.864657 list 5 May 2003 18:48:32.012001 rm -rf cache.p2 5 May 2003 18:48:33.705788 rm -rf cache.p3 5 May 2003 18:48:34.884671 list 5 May 2003 18:48:40.700523 exit 5 May 2003 18:48:46.619180 create -f /etc/vinum10.conf volume ad setupstate plex org concat sd length 5120m drive heaven plex org concat sd length 5120m drive earth 5 May 2003 18:48:46.620862 *** Created devices *** 5 May 2003 18:49:46.928880 rm -rf ad.p2.s0 5 May 2003 13:04:04.116544 *** vinum started *** 5 May 2003 13:04:04.163722 start 5 May 2003 13:04:08.148507 *** Created devices *** 5 May 2003 19:14:10.810116 *** vinum started *** 5 May 2003 19:14:11.546075 list 5 May 2003 19:14:22.073064 rm -rf ad.p2 5 May 2003 19:14:25.738567 rm -rf ad.p3 5 May 2003 19:14:26.553543 list 5 May 2003 19:14:33.809775 lv 5 May 2003 19:14:39.222651 lp 5 May 2003 19:14:52.711902 quit 5 May 2003 19:17:24.060960 *** vinum started *** 5 May 2003 19:17:25.979662 lp 5 May 2003 19:17:26.560207 ls 5 May 2003 19:17:37.935742 quit 5 May 2003 19:19:15.977739 *** vinum started *** 5 May 2003 19:19:15.978251 ls 5 May 2003 19:19:21.942660 *** vinum started *** 5 May 2003 19:19:48.708374 list 5 May 2003 19:19:57.650730 create -f /etc/vinum10.conf subdisk name ad.p0.s1 length 5120m plex ad.p0 drive heaven subdisk name ad.p1.s1 length 5120m plex ad.p1 drive earth 5 May 2003 19:19:57.652350 *** Created devices *** 5 May 2003 19:20:14.993509 lv 5 May 2003 19:20:26.257590 quit 5 May 2003 19:24:11.059268 *** vinum started *** The matching time in /var/log/messages appears to be: May 5 18:48:46 athena /kernel: vinum: ad.p2 is faulty May 5 18:48:46 athena /kernel: vinum: ad.p3 is faulty May 5 18:49:47 athena /kernel: vinum: removing ad.p2.s0 May 5 19:09:49 athena /kernel: Copyright (c) 1992-2003 The FreeBSD Project. Looks like the kernel panic was right around 18:49:48. TIA for any help, - Tillman -- "The gods too, are fond of a joke." - Aristotle