From owner-freebsd-current@FreeBSD.ORG Sat Apr 10 09:34:30 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 84D0316A4CE; Sat, 10 Apr 2004 09:34:30 -0700 (PDT) Received: from ftp.bjpu.edu.cn (ftp.bjpu.edu.cn [202.112.78.5]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7B35A43D1F; Sat, 10 Apr 2004 09:34:29 -0700 (PDT) (envelope-from delphij@frontfree.net) Received: from localhost (localhost [127.0.0.1]) by ftp.bjpu.edu.cn (Postfix) with ESMTP id 4B60352C8; Sun, 11 Apr 2004 00:34:28 +0800 (CST) Received: from ftp.bjpu.edu.cn ([127.0.0.1]) by localhost (ftp.bjpu.edu.cn [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 20374-10; Sun, 11 Apr 2004 00:34:24 +0800 (CST) Received: from beastie.frontfree.net (beastie.frontfree.net [218.107.145.7]) by ftp.bjpu.edu.cn (Postfix) with ESMTP id 10E7D5299; Sun, 11 Apr 2004 00:34:24 +0800 (CST) Received: from localhost (localhost [127.0.0.1]) by beastie.frontfree.net (Postfix) with ESMTP id D8382117DC; Sun, 11 Apr 2004 00:34:23 +0800 (CST) Received: from beastie.frontfree.net ([127.0.0.1]) by localhost (beastie.frontfree.net [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 00569-05; Sun, 11 Apr 2004 00:34:23 +0800 (CST) Received: by beastie.frontfree.net (Postfix, from userid 1001) id 391F011559; Sun, 11 Apr 2004 00:34:23 +0800 (CST) From: Xin LI To: Lukas Ertl Message-ID: <20040410163423.GA2092@frontfree.net> References: <20040409061800.GA2000@frontfree.net> <20040409184936.S8718@leelou.in.tern> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="LpQ9ahxlCli8rRTG" Content-Disposition: inline In-Reply-To: <20040409184936.S8718@leelou.in.tern> User-Agent: Mutt/1.4.2.1i X-GPG-key-ID/Fingerprint: 0xCAEEB8C0 / 43B8 B703 B8DD 0231 B333 DC28 39FB 93A0 CAEE B8C0 X-GPG-Public-Key: http://www.delphij.net/delphij.asc X-Operating-System: FreeBSD beastie.frontfree.net 5.2-CURRENT FreeBSD 5.2-CURRENT #18: Sun Apr 11 00:11:30 CST 2004 delphij@beastie.frontfree.net:/usr/obj/usr/src/sys/BEASTIE i386 X-URL: http://www.delphij.net X-By: delphij@beastie.frontfree.net X-Location: Beijing, China X-Virus-Scanned: by amavisd-new at frontfree.net X-Virus-Scanned: by amavisd-new at frontfree.net cc: freebsd-current@FreeBSD.org Subject: Re: How to produce effective backtraces from crashdump? X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 Date: Sat, 10 Apr 2004 16:34:30 -0000 X-Original-Date: Sat, 10 Apr 2004 16:34:30 -0000 X-List-Received-Date: Sat, 10 Apr 2004 16:34:30 -0000 --LpQ9ahxlCli8rRTG Content-Type: multipart/mixed; boundary="2oS5YaxWCcQjTEyO" Content-Disposition: inline --2oS5YaxWCcQjTEyO Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Apr 09, 2004 at 06:51:53PM +0200, Lukas Ertl wrote: > I'm seeing similar problems here. Could you please try the following: >=20 > Open /usr/src/gnu/usr.bin/binutils/libbfd/i386/bfd.h and change line 59 > from: >=20 > #define BFD_ARCH_SIZE 64 >=20 > to: >=20 > #define BFD_ARCH_SIZE 32 >=20 Thanks, I finally got the backtrace (as attached). I'll do some investigate on this issue. Best Regards, --=20 Xin LI http://www.delphij.net/ See complete headers for GPG key and other information. --2oS5YaxWCcQjTEyO Content-Type: text/plain; charset=unknown-8bit Content-Disposition: attachment; filename=backtrace Content-Transfer-Encoding: quoted-printable GNU gdb 5.2.1 (FreeBSD) Copyright 2002 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain condition= s. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-undermydesk-freebsd"... panic: vm_page_free: freeing wired page panic messages: --- panic: vm_page_free: freeing wired page at line 1058 in file /usr/src/sys/vm/vm_page.c cpuid =3D 0;=20 Stack backtrace: backtrace(c0675cae,0,422,c0685595,100) at backtrace+0x17 __panic(c0685595,422,c0685826,3f9,124) at __panic+0x150 vm_page_free_toq(c16651e8,40,c16651e8,eae0b910,c05fb453) at vm_page_free_to= q+0x126 vm_page_free(c16651e8,0,c0685072,5ef,0) at vm_page_free+0x24 vm_object_backing_scan(c6388e70,4,c0685072,63c,1e8) at vm_object_backing_sc= an+0x449 vm_object_collapse(c6388e70,0,c0685072,20d,c611db7c) at vm_object_collapse+= 0xc8 vm_object_deallocate(c627c528,0,c06847fa,825,eae0b9a0) at vm_object_dealloc= ate+0x2eb vm_map_entry_delete(c61ea938,c611db7c,c06847fa,882,c05f351c) at vm_map_entr= y_delete+0x17e vm_map_delete(c61ea938,0,bfc00000,c61ea938,c61ea938) at vm_map_delete+0x216 vm_map_remove(c61ea938,0,bfc00000,363,bfbfecfc) at vm_map_remove+0x55 exec_new_vmspace(eae0bb8c,c06b34c0,c066b260,296,eae0bb8c) at exec_new_vmspa= ce+0x230 exec_elf32_imgact(eae0bb8c,0,c066c0ce,145,c0704c20) at exec_elf32_imgact+0x= 1bc kern_execve(c61f47e0,804a419,bfbfebf0,bfbfec9c,0) at kern_execve+0x3af execve(c61f47e0,eae0bd14,c,2814d000,3) at execve+0x30 syscall(2f,2f,2f,bfbfec14,bfbfee5f) at syscall+0x271 Xint0x80_syscall() at Xint0x80_syscall+0x1d --- syscall (59), eip =3D 0x280d4083, esp =3D 0xbfbfe6fc, ebp =3D 0xbfbfeba= 8 --- syncing disks, buffers remaining... panic: _mtx_lock_sleep: recursed on non= -recursive mutex vm page queue mutex @ /usr/src/sys/kern/vfs_bio.c:3394 at line 437 in file /usr/src/sys/kern/kern_mutex.ccpuid =3D 0;=20 Uptime: 4m19s Dumping 1007 MB 16 32 48 64 80 96 112 128 144 160 176 192 208 224 240 256 272 288 304 320 = 336 352 368 384 400 416 432 448 464 480 496 512 528 544 560 576 592 608 624= 640 656 672 688 704 720 736 752 768 784 800 816 832 848 864 880 896 912 92= 8 944 960 976 992 --- #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:236 236 dumping++; (kgdb) bt full #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:236 No locals. #1 0xc04f7a1a in boot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:3= 70 No locals. #2 0xc04f7d96 in poweroff_wait (junk=3D0xc066dc1a, howto=3D437) at /usr/sr= c/sys/kern/kern_shutdown.c:548 td =3D (struct thread *) 0xc61f47e0 bootopt =3D 260 newpanic =3D 0 ap =3D 0xeae0b654 "=AFUh=C0=CERg=C0B\r" buf =3D "vm_page_free: freeing wired page\n", '\0' #3 0xc04ee577 in _mtx_lock_sleep (m=3D0xeae0b654, opts=3D0, file=3D0x0, li= ne=3D0) at /usr/src/sys/kern/kern_mutex.c:483 ts =3D (struct turnstile *) 0x0 td =3D (struct thread *) 0xc066dd08 v =3D 0 #4 0xc04ee0d2 in _mtx_lock_flags (m=3D0xc0704c20, opts=3D0, file=3D0xc0675= 2ce "/usr/src/sys/kern/vfs_bio.c",=20 line=3D3394) at /usr/src/sys/kern/kern_mutex.c:252 No locals. #5 0xc05461fd in vfs_busy_pages (bp=3D0xd2546730, clear_modify=3D1) at /us= r/src/sys/kern/vfs_bio.c:3394 obj =3D 0xc0c408c4 foff =3D -1522016800224556000 i =3D -1066970418 bogus =3D 0 #6 0xc05414f8 in ibwrite (bp=3D0xd2546730) at /usr/src/sys/kern/vfs_bio.c:= 875 oldflags =3D 537002148 newbp =3D (struct buf *) 0xc5f2d000 #7 0xc054116d in bwrite (bp=3D0x0) at /usr/src/sys/kern/vfs_bio.c:771 No locals. #8 0xc05433d3 in vfs_bio_awrite (bp=3D0xd2546730) at /usr/src/sys/kern/vfs= _bio.c:1725 i =3D 0 j =3D -971028512 lblkno =3D 65664 vp =3D (struct vnode *) 0xc5f2d000 ncl =3D 16384 nwritten =3D 16384 size =3D 1 maxcl =3D -973942784 #9 0xc054b180 in vop_stdfsync (ap=3D0xeae0b7e8) at /usr/src/sys/kern/vfs_d= efault.c:574 vp =3D (struct vnode *) 0xd2546730 bp =3D (struct buf *) 0x4000 nbp =3D (struct buf *) 0xc5f2d000 error =3D 0 maxretry =3D 100 #10 0xc04c3bbe in spec_fsync (ap=3D0xeae0b7e8) at /usr/src/sys/fs/specfs/sp= ec_vnops.c:437 No locals. #11 0xc04c2e08 in spec_vnoperate (ap=3D0x0) at /usr/src/sys/fs/specfs/spec_= vnops.c:118 No locals. #12 0xc05dbfd2 in ffs_sync (mp=3D0xc5ddc400, waitfor=3D2, cred=3D0xc1e26200= , td=3D0xc06bf9c0) at vnode_if.h:627 nvp =3D (struct vnode *) 0x0 vp =3D (struct vnode *) 0xeae0b7e8 devvp =3D (struct vnode *) 0xeae0b7e8 ip =3D (struct inode *) 0x0 ump =3D (struct ufsmount *) 0xc5f03800 fs =3D (struct fs *) 0xc5dc0800 error =3D -1066665536 count =3D 0 lockreq =3D 65554 allerror =3D 0 #13 0xc05561d5 in sync (td=3D0xc06bf9c0, uap=3D0x0) at /usr/src/sys/kern/vf= s_syscalls.c:136 mp =3D (struct mount *) 0xc5ddc400 nmp =3D (struct mount *) 0x0 asyncflag =3D 0 #14 0xc04f7542 in boot (howto=3D256) at /usr/src/sys/kern/kern_shutdown.c:2= 77 bp =3D (struct buf *) 0x0 iter =3D -1042113268 nbusy =3D -1042113280 pbusy =3D -1066650464 subiter =3D 0 #15 0xc04f7d96 in poweroff_wait (junk=3D0xc0685595, howto=3D1058) at /usr/s= rc/sys/kern/kern_shutdown.c:548 td =3D (struct thread *) 0xc61f47e0 bootopt =3D 256 newpanic =3D 1 ap =3D 0xeae0b8b0 "=F9\003" buf =3D "vm_page_free: freeing wired page\n", '\0' #16 0xc05fd547 in vm_page_free_toq (m=3D0xeae0b8b0) at /usr/src/sys/vm/vm_p= age.c:1058 pq =3D (struct vpgqueues *) 0x1 object =3D 0x1 #17 0xc05fc825 in vm_page_free (m=3D0xc16651e8) at /usr/src/sys/vm/vm_page.= c:390 No locals. #18 0xc05fb453 in vm_object_backing_scan (object=3D0xc6388e70, op=3D4) at /= usr/src/sys/vm/vm_object.c:1521 pp =3D 0x0 r =3D 1 p =3D 0xc16651e8 backing_object =3D 0xc627c528 backing_offset_index =3D 0 #19 0xc05fb618 in vm_object_collapse (object=3D0xc6388e70) at /usr/src/sys/= vm/vm_object.c:1632 backing_object =3D 0xc627c528 #20 0xc05f996b in vm_object_deallocate (object=3D0xc6388e70) at /usr/src/sy= s/vm/vm_object.c:532 robject =3D 0xc6388e70 temp =3D 0xc6388e70 #21 0xc05f5c5f in vm_map_entry_delete (map=3D0xc61ea938, entry=3D0xc611db7c= ) at /usr/src/sys/vm/vm_map.c:2086 object =3D 0xc627c528 offidxstart =3D 0 offidxend =3D 250 count =3D 250 #22 0xc05f5e8e in vm_map_delete (map=3D0xc61ea938, start=3D3323059068, end= =3D3217031168) at /usr/src/sys/vm/vm_map.c:2186 next =3D 0xc611db7c entry =3D 0xc627c528 first_entry =3D 0xc61ea938 #23 0xc05f5f02 in vm_map_remove (map=3D0xc61ea938, start=3D0, end=3D3217031= 168) at /usr/src/sys/vm/vm_map.c:2208 result =3D 0 #24 0xc04dfb64 in exec_new_vmspace (imgp=3D0xeae0bb8c, sv=3D0xc06b34c0) at = /usr/src/sys/vm/vm_map.h:197 error =3D 0 p =3D (struct proc *) 0xc6382528 vmspace =3D (struct vmspace *) 0xc61ea938 stack_addr =3D 0 map =3D 0x0 #25 0xc04d07b0 in exec_elf32_imgact (imgp=3D0xeae0bb8c) at /usr/src/sys/ker= n/imgact_elf.c:717 hdr =3D (const Elf_Ehdr *) 0xdb6f2000 phdr =3D (const Elf_Phdr *) 0xdb6f2034 elf_auxargs =3D (Elf_Auxargs *) 0x0 vmspace =3D (struct vmspace *) 0xc5fea000 prot =3D 0 '\0' text_size =3D 0 data_size =3D 0 total_size =3D 0 text_addr =3D 0 data_addr =3D 0 seg_size =3D 0 seg_addr =3D 801 addr =3D 3940596412 entry =3D 0 proghdr =3D 0 error =3D 0 i =3D 6 interp =3D 0xdb6f20f4 "/libexec/ld-elf.so.1" brand_info =3D (Elf_Brandinfo *) 0xc06b3528 td =3D (struct thread *) 0xc61f47e0 sv =3D (struct sysentvec *) 0xc06b34c0 #26 0xc04deb21 in kern_execve (td=3D0xc61f47e0, fname=3D) at /usr/src/sys/k= ern/kern_exec.c:381 p =3D (struct proc *) 0xc6382528 nd =3D {ni_dirp =3D 0x804a419(kgdb)=20 --2oS5YaxWCcQjTEyO-- --LpQ9ahxlCli8rRTG Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (FreeBSD) iD8DBQFAeCIPOfuToMruuMARAnN8AJ46p3vtiWhrqr/XdKsjl+NIb+GSYQCfdhZZ RXX/aD2F1KxVQ9AS1iFtQWQ= =siMO -----END PGP SIGNATURE----- --LpQ9ahxlCli8rRTG--