From owner-freebsd-stable@FreeBSD.ORG Mon Jan 22 19:02:23 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7343A16A400 for ; Mon, 22 Jan 2007 19:02:23 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from mx1.sitevalley.com (sitevalley.com [209.67.60.43]) by mx1.freebsd.org (Postfix) with SMTP id 2538413C4A6 for ; Mon, 22 Jan 2007 19:02:23 +0000 (UTC) (envelope-from quetzal@zone3000.net) Received: from unknown (HELO localhost) (217.144.69.37) by 209.67.61.254 with SMTP; 22 Jan 2007 19:02:18 -0000 Date: Mon, 22 Jan 2007 21:01:45 +0200 From: Nikolay Pavlov To: erich Message-ID: <20070122190145.GA61389@zone3000.net> Mail-Followup-To: Nikolay Pavlov , erich , freebsd-stable@freebsd.org References: <20070105165910.GA37906@zone3000.net> <00d001c73ded$b305e540$4e00a8c0@erich2003> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <00d001c73ded$b305e540$4e00a8c0@erich2003> User-Agent: Mutt/1.4.2.1i X-Operating-System: FreeBSD 6.1-RELEASE-p10 Cc: freebsd-stable@freebsd.org Subject: Re: kernel panic on 6.2-RC2 with GENERIC. X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Jan 2007 19:02:23 -0000 On Monday, 22 January 2007 at 14:22:29 +0800, erich wrote: > Dear Nikolay Pavlov, >=20 > Please update your RAID adapter firmware's version into 1.42. > I the problem still there please tell me again. > I am trying to reproduce this bug in my lab, > but till now I can not reproduce it. No luck, sir. After upgrade to 1.42 it's still very unstable: # kgdb kernel.debug /mnt/mnt2/crash/vmcore.5 [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.so:= Undefined symbol "ps_pglobal_lookup"] GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: panic: softdep_deallocate_dependencies: dangling deps Uptime: 5m11s Dumping 3583 MB (2 chunks) chunk 0: 1MB (156 pages) ... ok chunk 1: 3583MB (917216 pages) 3567 3551 3535 3519 3503 3487 3471 3455 34= 39 3423 3407 3391 3375 3359 3343 3327 3311 3295 3279 3263 3247 3231 3215 31= 99 3183 3167 3151 3135 3119 3103 3087 3071 3055 3039 3023 3007 2991 2975 29= 59 2943 2927 2911 2895 2879 2863 2847 2831 2815 2799 2783 2767 2751 2735 27= 19 2703 2687 2671 2655 2639 2623 2607 2591 2575 2559 2543 2527 2511 2495 24= 79 2463 2447 2431 2415 2399 2383 2367 2351 2335 2319 2303 2287 2271 2255 22= 39 2223 2207 2191 2175 2159 2143 2127 2111 2095 2079 2063 2047 2031 2015 19= 99 1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 1775 17= 59 1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 1535 15= 19 1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 1295 12= 79 1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 1055 10= 39 1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 75= 1 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 4= 47 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 = 143 127 111 95 79 63 47 31 15 #0 doadump () at pcpu.h:165 165 pcpu.h: No such file or directory. in pcpu.h (kgdb) bt #0 doadump () at pcpu.h:165 #1 0xc067005a in boot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:4= 09 #2 0xc06702f0 in panic (fmt=3D0xc08e0219 "softdep_deallocate_dependencies:= dangling deps") at /usr/src/sys/kern/kern_shutdown.c:565 #3 0xc079dc2e in softdep_deallocate_dependencies (bp=3D0x0) at /usr/src/sy= s/ufs/ffs/ffs_softdep.c:6255 #4 0xc06b73e3 in getnewbuf (slpflag=3D0, slptimeo=3D0, size=3D16384, maxsi= ze=3D16384) at buf.h:447 #5 0xc06b88dc in getblk (vp=3D0xcd2b2330, blkno=3D2115, size=3D16384, slpf= lag=3D0, slptimeo=3D0, flags=3D1) at /usr/src/sys/kern/vfs_bio.c:2497 #6 0xc06bc9b3 in cluster_rbuild (vp=3D0xcd2b2330, filesize=3D50608376, lbn= =3D2113, blkno=3D1819849504, size=3D16384, run=3D8, fbp=3D0x0) at /usr/src/sys/kern/vfs_cluster.c:374 #7 0xc06bc607 in cluster_read (vp=3D0xcd2b2330, filesize=3D50608376, lblkn= o=3D2113, size=3D16384, cred=3D0x0, totread=3D4096, seqcount=3D127, bpp=3D0= x0) at /usr/src/sys/kern/vfs_cluster.c:252 #8 0xc07a234b in ffs_read (ap=3D0x0) at /usr/src/sys/ufs/ffs/ffs_vnops.c:5= 03 #9 0xc086f924 in VOP_READ_APV (vop=3D0x0, a=3D0x0) at vnode_if.c:643 #10 0xc06d4209 in vn_read (fp=3D0xc9bbe3a8, uio=3D0xec89bcbc, active_cred= =3D0xccde6a00, flags=3D0, td=3D0xcba86480) at vnode_if.h:343 #11 0xc0691e0d in dofileread (td=3D0xcba86480, fd=3D5, fp=3D0xc9bbe3a8, aui= o=3D0xec89bcbc, offset=3DUnhandled dwarf expression opcode 0x93 ) at file.h:240 #12 0xc0691ca6 in kern_readv (td=3D0xcba86480, fd=3D5, auio=3D0xec89bcbc) a= t /usr/src/sys/kern/sys_generic.c:192 #13 0xc0691bd1 in read (td=3D0xcba86480, uap=3D0x0) at /usr/src/sys/kern/sy= s_generic.c:116 #14 0xc085e9f7 in syscall (frame=3D {tf_fs =3D 59, tf_es =3D -1078001605, tf_ds =3D -1078001605, tf_edi = =3D 8192, tf_esi =3D 672845424, tf_ebp =3D -1077951544, tf_isp =3D -3265174= 04, tf_ebx =3D 672769032, tf_edx =3D 0, tf_ecx =3D 1, tf_eax =3D 3, tf_trap= no =3D 32, tf_err =3D 2, tf_eip =3D 672715519, tf_cs =3D 51, tf_eflags =3D = 530, tf_esp =3D -1077951572, tf_ss =3D 59}) at /usr/src/sys/i386/i386/trap.c:983 #15 0xc084d0cf in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s= :200 #16 0x00000033 in ?? () Previous frame inner to this frame (corrupt stack?) >=20 > Best Regards > Erich Chen > ----- Original Message -----=20 > From: "Nikolay Pavlov" > To: > Sent: Saturday, January 06, 2007 12:59 AM > Subject: kernel panic on 6.2-RC2 with GENERIC. >=20 >=20 > Hello folks. > I have kernel panic on GENERIC kernel while executing postmark. >=20 > Before panic there were messages like this: > g_vfs_done():da1s1d[WRITE(offset=3D772363010048, length=3D16384)]error = =3D 5 > g_vfs_done():da1s1d[WRITE(offset=3D772363026432, length=3D16384)]error = =3D 5 > g_vfs_done():da1s1d[WRITE(offset=3D772363042816, length=3D16384)]error = =3D 5 > g_vfs_done():da1s1d[WRITE(offset=3D772363059200, length=3D16384)]error = =3D 5 >=20 > and >=20 > initiate_write_filepage: already started >=20 > And finaly here is a panic: >=20 > kgdb kernel.debug /mnt/mnt2/crash/vmcore.2 > [GDB will not be able to debug user-mode threads: /usr/lib/libthread_db.s= o:=20 > Undefined symbol "ps_pglobal_lookup"] > GNU gdb 6.1.1 [FreeBSD] > Copyright 2004 Free Software Foundation, Inc. > GDB is free software, covered by the GNU General Public License, and you = are > welcome to change it and/or distribute copies of it under certain=20 > conditions. > Type "show copying" to see the conditions. > There is absolutely no warranty for GDB. Type "show warranty" for detail= s. > This GDB was configured as "i386-marcel-freebsd". >=20 > Unread portion of the kernel message buffer: > panic: initiate_write_inodeblock_ufs2: already started > Uptime: 9m27s > Dumping 3583 MB (2 chunks) > chunk 0: 1MB (156 pages) ... ok > chunk 1: 3583MB (917216 pages) 3567 3551 3535 3519 3503 3487 3471 3455= =20 > 3439 3423 3407 3391 3375 3359 3343 3327 3311 3295 3279 3263 3247 3231 321= 5=20 > 3199 3183 3167 3151 3135 3119 3103 3087 3071 3055 3039 3023 3007 2991 297= 5=20 > 2959 2943 2927 2911 2895 2879 2863 2847 2831 2815 2799 2783 2767 2751 273= 5=20 > 2719 2703 2687 2671 2655 2639 2623 2607 2591 2575 2559 2543 2527 2511 249= 5=20 > 2479 2463 2447 2431 2415 2399 2383 2367 2351 2335 2319 2303 2287 2271 225= 5=20 > 2239 2223 2207 2191 2175 2159 2143 2127 2111 2095 2079 2063 2047 2031 201= 5=20 > 1999 1983 1967 1951 1935 1919 1903 1887 1871 1855 1839 1823 1807 1791 177= 5=20 > 1759 1743 1727 1711 1695 1679 1663 1647 1631 1615 1599 1583 1567 1551 153= 5=20 > 1519 1503 1487 1471 1455 1439 1423 1407 1391 1375 1359 1343 1327 1311 129= 5=20 > 1279 1263 1247 1231 1215 1199 1183 1167 1151 1135 1119 1103 1087 1071 105= 5=20 > 1039 1023 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 76= 7=20 > 751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 4= 63=20 > 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 1= 59=20 > 143 127 111 95 79 63 47 31 15 >=20 > #0 doadump () at pcpu.h:165 > 165 pcpu.h: No such file or directory. > in pcpu.h > (kgdb) bt > #0 doadump () at pcpu.h:165 > #1 0xc0672a26 in boot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c= :409 > #2 0xc0672cbc in panic (fmt=3D0xc0909c75 "initiate_write_inodeblock_ufs2= :=20 > already started") at /usr/src/sys/kern/kern_shutdown.c:565 > #3 0xc07c00ca in initiate_write_inodeblock_ufs2 (inodedep=3D0xc9c54000,= =20 > bp=3D0x0) at /usr/src/sys/ufs/ffs/ffs_softdep.c:4022 > #4 0xc07bf897 in softdep_disk_io_initiation (bp=3D0xdc9c63b8) at=20 > /usr/src/sys/ufs/ffs/ffs_softdep.c:3757 > #5 0xc07c8411 in ffs_geom_strategy (bo=3D0xc8c5a830, bp=3D0xdc9c63b8) at= =20 > buf.h:433 > #6 0xc06b8048 in bufwrite (bp=3D0xdc9c63b8) at buf.h:426 > #7 0xc07c82d2 in ffs_bufwrite (bp=3D0xdc9c63b8) at=20 > /usr/src/sys/ufs/ffs/ffs_vfsops.c:1740 > #8 0xc06b9a77 in vfs_bio_awrite (bp=3D0xdc9c63b8) at buf.h:410 > #9 0xc06ba8bd in flushbufqueues (flushdeps=3D0) at=20 > /usr/src/sys/kern/vfs_bio.c:2125 > #10 0xc06ba3bf in buf_daemon () at /usr/src/sys/kern/vfs_bio.c:1999 > #11 0xc065cc5c in fork_exit (callout=3D0xc06ba2d0 , arg=3D0x0= ,=20 > frame=3D0xe8f9fd38) at /usr/src/sys/kern/kern_fork.c:821 > #12 0xc087397c in fork_trampoline () at=20 > /usr/src/sys/i386/i386/exception.s:208 >=20 >=20 > This box is using ARECA RAID with GENERIC UP kernel: >=20 > arcmsr0@pci3:14:0: class=3D0x010400 card=3D0x116017d3 chip=3D0x11601= 7d3=20 > rev=3D0x00 hdr=3D0x00 > vendor =3D 'Areca Technology Corporation' > device =3D 'ARC-1160 16-Port PCI-X to SATA RAID Controller' > class =3D mass storage > subclass =3D RAID >=20 > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" --=20 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =20 - Best regards, Nikolay Pavlov. <<<----------------------------------- = =20 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =20