From owner-freebsd-current@FreeBSD.ORG Sun Jun 13 13:19:58 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AA46816A4CE for ; Sun, 13 Jun 2004 13:19:58 +0000 (GMT) Received: from chello080110061116.502.15.vie.surfer.at (chello080110061116.502.15.vie.surfer.at [80.110.61.116]) by mx1.FreeBSD.org (Postfix) with SMTP id 1E89143D41 for ; Sun, 13 Jun 2004 13:19:55 +0000 (GMT) (envelope-from 4711@chello.at) Received: (qmail 41216 invoked from network); 13 Jun 2004 13:19:12 -0000 Received: from matrix010.matrix.net (192.168.123.10) by ns.matrix.net with SMTP; 13 Jun 2004 13:19:12 -0000 From: Christian Hiris <4711@chello.at> To: freebsd-current@freebsd.org Date: Sun, 13 Jun 2004 15:18:59 +0200 User-Agent: KMail/1.6.2 References: <20040612232725.N35614@leelou.in.tern> In-Reply-To: <20040612232725.N35614@leelou.in.tern> MIME-Version: 1.0 Content-Type: multipart/signed; protocol="application/pgp-signature"; micalg=pgp-sha1; boundary="Boundary-02=_PRFzAzb88+iyri2"; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Message-Id: <200406131519.11988.4711@chello.at> cc: Lukas Ertl Subject: Re: HEADSUP: geom_vinum committed [Fatal trap 12 (g_event)] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Jun 2004 13:19:59 -0000 --Boundary-02=_PRFzAzb88+iyri2 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Saturday 12 June 2004 23:28, Lukas Ertl wrote: > Dear hackers, > > I've just committed a first geomified version of vinum, surprisingly > called geom_vinum. > > Bug reports, suggestions, critics and flames are happily awaited, even > more so when they have patches attached. :-) > > Thanks, > le =46irst - many, many thanks for such a nice surprise :-)) and your work! I really must gave our brand new geomified gvinum module a first try on a t= est=20 machine. This machine holds on an existing vinum striped volume, which was= =20 created by old, ungeomfied vinum. =46irst fsck and mounting the filesystem went fine and I could read data fr= om=20 the vinum volume's ufs2 filesystem. Unmounting the filesystem then panics the machine. I rebooted, did a 'fsck = =2Dt=20 ufs /dev/gvinum/vinum0', which results in a Fatal trap 12. So next I=20 recompiled kernel with the geom_subr.c.diff patch and debugging symbols.=20 After installing the new kernels I tried fscking again: Sometimes fsck on t= he=20 gvinum volume's filesystem works and i can mount the filesystem, but mostly= =20 I'm lost in the fatal trap before fsck could issue any of it's messages. Th= e=20 old vinum kld still works fine, even after the panics of the geomified kld. Some of the output and config data: =20 Vinum config: matrix020# cat /etc/vinum.config # Vinum configuration of matrix020.matrix.net, saved at Sat May 29 22:46:40= =20 2004 drive vinumdrive1 device /dev/da1s1h drive vinumdrive0 device /dev/da0s1h volume vinum0 plex name vinum0.p0 org striped 558s vol vinum0 sd name vinum0.p0.s0 drive vinumdrive0 plex vinum0.p0 len 35840340s=20 driveoffset 265s plexoffset 0s sd name vinum0.p0.s1 drive vinumdrive1 plex vinum0.p0 len 35840340s=20 driveoffset 265s plexoffset 558s Console Output: =20 Sun Jun 13 13:20:36 CEST 2004 =46OO: sd vinum0.p0.s1 is up =46OO: sd vinum0.p0.s0 is up (from 'gvinum start') =46OO: sd vinum0.p0.s1 is up =46OO: plex vinum0.p0 is up =46OO: sd vinum0.p0.s0 is up =46OO: plex vinum0.p0 is up (from 'fsck -t ufs /dev/gvinum/vinum0') ddb output: =46atal trap 12: page fault while in kernel mode cpuid =3D 0; apic id =3D 00 fault virtual address =3D 0xe fault code =3D supervisor read, page not present instruction pointer =3D 0x8:0xc051bafc stack pointer =3D 0x10:0xd7e65c7c frame pointer =3D 0x10:0xd7e65c88 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, def32 1, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 2 (g_event) kernel: type 12 trap, code=3D0 Stopped at redo_rank+0x70: cmpl $0,0xc(%edx) db> trace redo_rank(c2398e80,c1e63d80,d7e65cb0,c051b783,c1e63d80) at redo_rank+0x70 g_detach(c1e63d80,c2398e80,4,0,d7e65cd8) at g_detach+0x67 g_wither_geom(c2398e80,6,c20fc660,1,c06eb40d) at g_wither_geom+0xab g_slice_spoiled(c1e63d80) at g_slice_spoiled+0x30 g_spoil_event(c1e09400,0) at g_spoil_event+0x30 one_event(d7e65d20,c051a58d,4b0,320,c1bf1898) at one_event+0x192 g_run_events(4b0,320,c1bf1898,c051a56c,d7e65d34) at g_run_events+0x9 g_event_procbody(0,d7e65d48) at g_event_procbody+0x21 fork_exit(c051a56c,0,d7e65d48) at fork_exit+0x71 fork_trampoline() at fork_trampoline+0x8 =2D-- trap 0x1, eip =3D 0, esp =3D 0xd7e65d7c, ebp =3D 0 --- db> show registers cs 0x8 ds 0xd7e60010 es 0x10 fs 0xd7e60018 ss 0x10 eax 0xc22fac18 ecx 0xc22fcd00 edx 0x2 ebx 0x1 esp 0xd7e65c7c ebp 0xd7e65c88 esi 0xc22fcd00 edi 0xc2398e80 eip 0xc051bafc redo_rank+0x70 efl 0x10202 dr0 0 dr1 0 dr2 0 dr3 0 dr4 0xffff0ff0 dr5 0x400 dr6 0xffff0ff0 dr7 0x400 redo_rank+0x70: cmpl $0,0xc(%edx) db> ps pid proc uarea uid ppid pgrp flag stat wmesg wchan cmd 699 c22d7000 df092000 0 679 699 0004002 [SLPQ g_waitidle 0xc0764ec= 0] [SLP] fsck_ffs 679 c20856e0 df036000 0 663 679 0004002 [SLPQ pause 0xc2085718][SL= P]=20 csh 678 c2085898 df037000 92 604 678 0004000 [SLPQ select 0xc0774584][S= LP]=20 gdmgreeter 670 c22d76e0 df096000 0 1 670 0004002 [SLPQ ttyin 0xc1cb5c10][SL= P]=20 getty 669 c22d7898 df097000 0 1 669 0004002 [SLPQ ttyin 0xc1cb5e10][SL= P]=20 getty 668 c22d7a50 df098000 0 1 668 0004002 [SLPQ ttyin 0xc1ced010][SL= P]=20 getty 667 c22d7c08 df099000 0 1 667 0004002 [SLPQ ttyin 0xc1ced210][SL= P]=20 getty 666 c22d7dc0 df09a000 0 1 666 0004002 [SLPQ ttyin 0xc1ced410][SL= P]=20 getty 665 c22d9000 df09b000 0 1 665 0004002 [SLPQ ttyin 0xc1ced610][SL= P]=20 getty 664 c2082dc0 df031000 0 1 664 0004002 [SLPQ ttyin 0xc1ced810][SL= P]=20 getty 663 c1e761b8 dd9ca000 0 1 663 0004102 [SLPQ wait 0xc1e761b8][SLP= ]=20 login 653 c2085000 df032000 0 1 653 0000000 [SLPQ select 0xc0774584][S= LP]=20 inetd 626 c1e76c08 dd9d0000 0 1 626 0000000 [SLPQ select 0xc0774584][S= LP]=20 moused 609 c2082c08 df00f000 0 604 609 0004000 [SLPQ select 0xc0774584][S= LP]=20 XFree86 604 c2082a50 df00e000 0 601 604 0000100 [SLPQ piperd 0xc1eac2f0][S= LP]=20 gdm-binary 601 c1e76dc0 dd9d1000 0 1 601 0000100 [SLPQ select 0xc0774584][S= LP]=20 gdm-binary 600 c1e76a50 dd9cf000 80 540 540 0000100 [SLPQ accept 0xc1f59c92][S= LP]=20 httpd 599 c20821b8 df009000 80 540 540 0000100 [SLPQ accept 0xc1f59c92][S= LP]=20 httpd 598 c2085370 df034000 80 540 540 0000100 [SLPQ accept 0xc1f59c92][S= LP]=20 httpd 597 c1c8ac08 d9487000 80 540 540 0000100 [SLPQ accept 0xc1f59c92][S= LP]=20 httpd 596 c2082000 df008000 80 540 540 0000100 [SLPQ accept 0xc1f59c92][S= LP]=20 httpd 589 c2082898 df00d000 88 551 51 000c102 (threaded) mysqld thread 0xc1e78840 ksegrp 0xc1bf2e80 [SLPQ kserel 0xc1bf2edc][SLP] thread 0xc20ff2c0 ksegrp 0xc1bf2680 [SLPQ kserel 0xc1bf26dc][SLP] thread 0xc20fb2c0 ksegrp 0xc1bf2e80 [SLPQ select 0xc0774584][SLP] thread 0xc20fbc60 ksegrp 0xc1bf2700 [SLPQ sigwait 0xdf05cc2c][SLP] thread 0xc1e789a0 ksegrp 0xc1bf2780 [SLPQ ksesigwait 0xc2082998][SLP] 551 c2082528 df00b000 0 1 51 0004002 [SLPQ wait 0xc2082528][SLP= ]=20 sh 540 c20826e0 df00c000 0 1 540 0000000 [SLPQ select 0xc0774584][S= LP]=20 httpd 534 c20851b8 df033000 80 1 533 000c002 (threaded) java thread 0xc22db160 ksegrp 0xc1bf2c00 [RUNQ][kse 0xc1ba5480] thread 0xc22db2c0 ksegrp 0xc1bf2c00 [SLPQ accept 0xc202cdce][SLP] thread 0xc22db420 ksegrp 0xc1bf2c00 [SLPQ accept 0xc235203a][SLP] thread 0xc20fb420 ksegrp 0xc1bf2c00 [SLPQ accept 0xc23523ee][SLP] thread 0xc1e78b00 ksegrp 0xc1bf2800 [SLPQ ksesigwait 0xc20852b8][SLP] 507 c1c8a1b8 d9481000 0 1 507 0000000 [SLPQ nanslp 0xc076a91c][S= LP]=20 cron 487 c1c8a6e0 d9484000 0 1 487 0000100 [SLPQ select 0xc0774584][S= LP]=20 sshd 337 c1c8a898 d9485000 0 1 337 0000000 [SLPQ select 0xc0774584][S= LP]=20 rpcbind 322 c1c8aa50 d9486000 0 1 322 0000000 [RUNQ] syslogd 199 c1e76000 dd987000 0 1 199 0000000 [SLPQ pause 0xc1e76038][SL= P]=20 adjkerntz 50 c1e76370 dd9cb000 0 0 0 0000204 [SLPQ - 0xc077c00c][SLP]=20 nfsiod 3 49 c1e76528 dd9cc000 0 0 0 0000204 [SLPQ - 0xc077c008][SLP]=20 nfsiod 2 48 c1e766e0 dd9cd000 0 0 0 0000204 [SLPQ - 0xc077c004][SLP]=20 nfsiod 1 47 c1e76898 dd9ce000 0 0 0 0000204 [SLPQ - 0xc077c000][SLP]=20 nfsiod 0 46 c1bf1a50 d944f000 0 0 0 0000204 [SLPQ syncer 0xc076a6a4][S= LP]=20 syncer 45 c1bf1c08 d9450000 0 0 0 0000204 [SLPQ vlruwt 0xc1bf1c08][S= LP]=20 vnlru 44 c1bf1dc0 d9451000 0 0 0 0000204 [SLPQ psleep 0xc0774b70][S= LP]=20 bufdaemon 43 c1c87000 d9456000 0 0 0 000020c [SLPQ pgzero 0xc07827e8][S= LP]=20 pagezero 42 c1c871b8 d9457000 0 0 0 0000204 [SLPQ psleep 0xc0782840][S= LP]=20 vmdaemon 41 c1c87370 d9458000 0 0 0 0000204 [SLPQ psleep 0xc078282c][S= LP]=20 pagedaemon 40 c1c87528 d9459000 0 0 0 0000204 [IWAIT] swi0: tty:sio 39 c1c876e0 d947b000 0 0 0 0000204 [SLPQ idle 0xc1c69c00][SLP= ]=20 aic_recovery0 9 c1c87898 d947c000 0 0 0 0000204 [SLPQ idle 0xc1c69c00][SLP= ]=20 aic_recovery0 38 c1c87a50 d947d000 0 0 0 0000204 [SLPQ usbtsk 0xc076292c][S= LP]=20 usbtask 37 c1c87c08 d947e000 0 0 0 0000204 [SLPQ usbevt 0xc1c9f210][S= LP]=20 usb0 8 c1c87dc0 d947f000 0 0 0 0000204 [SLPQ actask 0xc088c4cc][S= LP]=20 acpi_task2 7 c1c8a000 d9480000 0 0 0 0000204 [SLPQ actask 0xc088c4cc][S= LP]=20 acpi_task1 6 c1be6528 d9422000 0 0 0 0000204 [SLPQ actask 0xc088c4cc][S= LP]=20 acpi_task0 36 c1be66e0 d9423000 0 0 0 0000204 [IWAIT] swi5:+ 5 c1be6898 d9424000 0 0 0 0000204 [SLPQ - 0xc1c45180][SLP]=20 taskqueue 35 c1be6a50 d9425000 0 0 0 0000204 [IWAIT] swi7: acpitaskq 34 c1be6c08 d9426000 0 0 0 0000204 [IWAIT] swi6:+ 33 c1be6dc0 d9448000 0 0 0 0000204 [IWAIT] swi7: task queue 32 c1bf1000 d9449000 0 0 0 0000204 [IWAIT] swi3: cambio 31 c1bf11b8 d944a000 0 0 0 0000204 [IWAIT] swi2: camnet 30 c1bf1370 d944b000 0 0 0 0000204 [RUNQ] yarrow 4 c1bf1528 d944c000 0 0 0 0000204 [SLPQ - 0xc0765050][SLP]=20 g_down 3 c1bf16e0 d944d000 0 0 0 0000204 [SLPQ - 0xc076504c][SLP] g= _up 2 c1bf1898 d944e000 0 0 0 0000204 [CPU 0] g_event 29 c1ba81b8 d7e45000 0 0 0 0000204 [IWAIT] swi4: vm 28 c1ba8370 d7e46000 0 0 0 000020c [RUNQ] swi8: tty:sio clock 27 c1ba8528 d7e47000 0 0 0 0000204 [IWAIT] swi1: net 26 c1ba86e0 d7e69000 0 0 0 0000204 [IWAIT] irq15: ata1 25 c1ba8898 d7e6a000 0 0 0 0000204 [IWAIT] irq14: ata0 24 c1ba8a50 d7e6b000 0 0 0 0000204 [IWAIT] irq13: 23 c1ba8c08 d7e6c000 0 0 0 0000204 [IWAIT] irq12: 22 c1ba8dc0 d7e6d000 0 0 0 0000204 [IWAIT] irq11: 21 c1be6000 d941f000 0 0 0 0000204 [IWAIT] irq10: pcm0 20 c1be61b8 d9420000 0 0 0 0000204 [IWAIT] irq9: ahc0 bktr0++ 19 c1be6370 d9421000 0 0 0 0000204 [IWAIT] irq8: rtc 18 c1b9f000 d7df9000 0 0 0 0000204 [IWAIT] irq7: ppc0 17 c1b9f1b8 d7e3c000 0 0 0 0000204 [IWAIT] irq6: 16 c1b9f370 d7e3d000 0 0 0 0000204 [IWAIT] irq5: xl0 uhci0+ 15 c1b9f528 d7e3e000 0 0 0 0000204 [IWAIT] irq4: sio0 14 c1b9f6e0 d7e3f000 0 0 0 0000204 [IWAIT] irq3: sio1 13 c1b9f898 d7e40000 0 0 0 0000204 [IWAIT] irq1: atkbd0 12 c1b9fa50 d7e41000 0 0 0 0000204 [IWAIT] irq0: clk 11 c1b9fc08 d7e42000 0 0 0 000020c [Can run] idle: cpu0 1 c1b9fdc0 d7e43000 0 0 1 0004200 [SLPQ wait 0xc1b9fdc0][SLP= ]=20 init 10 c1ba8000 d7e44000 0 0 0 0000204 [SLPQ ktrace 0xc07688b8][S= LP]=20 ktrace 0 c0765140 c0c1f000 0 0 0 0000200 [SLPQ sched 0xc0765140][SL= P]=20 swapper db> panic panic: from debugger cpuid =3D 0; Debugger("panic") =46atal trap 3: breakpoint instruction fault while in kernel mode cpuid =3D 0; apic id =3D 00 instruction pointer =3D 0x8:0xc06983a2 stack pointer =3D 0x10:0xd7e65a64 frame pointer =3D 0x10:0xd7e65a68 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, def32 1, gran 1 processor eflags =3D IOPL =3D 0 current process =3D 2 (g_event) Stopped at redo_rank+0x70: cmpl $0,0xc(%edx) db> panic panic: from debugger cpuid =3D 0; Uptime: 4m24s Hardware: The vinum striped volume resides on da0 and da1. They are connected to =20 ahc0, an Adaptec 2940 Ultra2 SCSI adapter. Type '?' for a list of commands, 'help' for more detailed help. OK boot /boot/kernel/kernel.debug /boot/kernel/kernel.debug text=3D0x309d24 data=3D0x528ac+0x3f930=20 syms=3D[0x4+0x503a0+0 x4+0x6259c] /boot/kernel/acpi.ko text=3D0x39d0c data=3D0x19e4+0x116c=20 syms=3D[0x4+0x6810+0x4+0x8a33 ] Copyright (c) 1992-2004 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. =46reeBSD 5.2-CURRENT #2: Sun Jun 13 12:08:06 CEST 2004 pfnu@matrix010.matrix.net:/usr/obj/usr/src/sys/MATRIX020 Preloaded elf kernel "/boot/kernel/kernel.debug" at 0xc089d000. Preloaded elf module "/boot/kernel/acpi.ko" at 0xc089d1fc. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel Pentium III (851.94-MHz 686-class CPU) Origin =3D "GenuineIntel" Id =3D 0x683 Stepping =3D 3 Features=3D0x383f9ff real memory =3D 671072256 (639 MB) avail memory =3D 647147520 (617 MB) random: Pentium Pro MTRR support enabled npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: [GIANT-LOCKED] pcibios: BIOS version 2.10 acpi0: Power Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0 cpu0: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib0: slot 4 INTD is routed to irq 5 pcib0: slot 9 INTA is routed to irq 5 pcib0: slot 10 INTA is routed to irq 9 agp0: mem 0xe4000000-0xe7ffffff= at=20 d evice 0.0 on pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib0: slot 1 INTA is routed to irq 11 pcib1: slot 0 INTA is routed to irq 11 pci1: at device 0.0 (no driver attached) isab0: at device 4.0 on pci0 isa0: on isab0 atapci0: port=20 0xd800-0xd80f,0x376,0x170-0x177,0x 3f6,0x1f0-0x1f7 at device 4.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 uhci0: port 0xd400-0xd41f irq 5 a= t=20 dev ice 4.2 on pci0 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered ums0: IBM Corporation product 0x310b, rev 2.00/1.60, addr 2, iclass 3/1 ums0: 3 buttons and Z dir. intpm0: port 0xe800-0xe80f irq = 9=20 at device 4.3 on pci0 intpm0: I/O mapped e800 intpm0: intr IRQ 9 enabled revision 0 intpm0: [GIANT-LOCKED] intsmb0: on intpm0 smbus0: on intsmb0 intpm0: PM I/O mapped e400 atapci1: port=20 0xa800-0xa80f,0xb000-0xb003,0xb400-0 xb407,0xb800-0xb803,0xd000-0xd007 mem 0xde800000-0xde8000ff irq 5 at device= =20 9.0 on pci0 ata2: at 0xde800000 on atapci1 ata3: at 0xde800000 on atapci1 ahc0: port 0xa400-0xa4ff mem=20 0xde000000-0xde0 00fff irq 9 at device 10.0 on pci0 ahc0: [GIANT-LOCKED] aic7890/91: Ultra2 Wide Channel A, SCSI Id=3D7, 32/253 SCBs pcm0: port 0xa000-0xa03f at device 11.0 on pci0 pcm0: pcib0: slot 11 INTA is routed to irq 10 pcm0: [GIANT-LOCKED] xl0: <3Com 3c980C Fast Etherlink XL> port 0x9800-0x987f mem=20 0xdd800000-0xdd80007 f at device 13.0 on pci0 pcib0: slot 13 INTA is routed to irq 5 miibus0: on xl0 xlphy0: <3c905C 10/100 internal PHY> on miibus0 xlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto xl0: Ethernet address: 00:04:75:ec:d2:89 xl0: [GIANT-LOCKED] bktr0: mem 0xe1000000-0xe1000fff at device 14.0 on pci0 pcib0: slot 14 INTA is routed to irq 9 bktr0: [GIANT-LOCKED] bktr0: Hauppauge Model 61334 B2 bktr0: Detected a MSP3410D-B4 at 0x80 bktr0: Hauppauge WinCast/TV, Philips FR1216 PAL FM tuner, msp3400c stereo. pci0: at device 14.1 (no driver attached) ppc0 port 0x778-0x77b,0x378-0x37f irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/9 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 sio0 port 0x3f8-0x3ff irq 4 on acpi0 sio0: type 16550A, console sio1 port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A atkbdc0: port 0x64,0x60 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] orm0: