Date: Tue, 19 Mar 2013 18:18:06 +0100 From: Michael Landin Hostbaek <mich@freebsd.org> To: freebsd-stable@freebsd.org Subject: Core Dump / panic sleeping thread Message-ID: <A6D4A877-2DBA-4E9D-996D-2E34834BF60E@freebsd.org>
next in thread | raw e-mail | index | archive | help
Hi,=20
I am running a FreeBSD 9.1-REL system with GENERIC kernel:
FreeBSD xxxxx 9.1-RELEASE FreeBSD 9.1-RELEASE #0: Fri Jan 4 12:28:48 =
CET 2013 root@xxxxx:/usr/obj/usr/src/sys/GENERIC amd64
It is crashing a couple of times per week, without any real pattern. =
There are no hints in the syslog, and I only have the core debug to work =
from... =20
It is a webserver, using a NFS mounted docroot (if it might help) - =
here's the backtrace:
<snip>
This GDB was configured as "amd64-marcel-freebsd"...
Unread portion of the kernel message buffer:
Sleeping thread (tid 100256, pid 85641) owns a non-sleepable lock
KDB: stack backtrace of thread 100256:
#0 0xffffffff808f2d46 at mi_switch+0x186
#1 0xffffffff8092bb52 at sleepq_wait+0x42
#2 0xffffffff808f34d6 at _sleep+0x376
#3 0xffffffff80b4f3ae at vm_object_page_remove+0x2ce
#4 0xffffffff80b5ac7d at vnode_pager_setsize+0x17d
#5 0xffffffff8082102c at nfscl_loadattrcache+0x2cc
#6 0xffffffff80818d37 at nfs_getattr+0x287
#7 0xffffffff8098f1c0 at vn_stat+0xb0
#8 0xffffffff809869d9 at kern_statat_vnhook+0xf9
#9 0xffffffff80986b55 at kern_statat+0x15
#10 0xffffffff80986c1a at sys_lstat+0x2a
#11 0xffffffff80bd7ae6 at amd64_syscall+0x546
#12 0xffffffff80bc3447 at Xfast_syscall+0xf7
panic: sleeping thread
cpuid =3D 0
KDB: stack backtrace:
#0 0xffffffff809208a6 at kdb_backtrace+0x66
#1 0xffffffff808ea8be at panic+0x1ce
#2 0xffffffff8092ed22 at propagate_priority+0x1d2
#3 0xffffffff8092fa4e at turnstile_wait+0x1be
#4 0xffffffff808d8d48 at _mtx_lock_sleep+0xd8
#5 0xffffffff80820fa4 at nfscl_loadattrcache+0x244
#6 0xffffffff8081758c at ncl_readrpc+0xac
#7 0xffffffff80824c45 at ncl_getpages+0x485
#8 0xffffffff80b5aa0c at vnode_pager_getpages+0x9c
#9 0xffffffff80b3fc93 at vm_fault_hold+0x673
#10 0xffffffff80b41cc3 at vm_fault+0x73
#11 0xffffffff80bd84b4 at trap_pfault+0x124
#12 0xffffffff80bd8c6c at trap+0x49c
#13 0xffffffff80bc315f at calltrap+0x8
Uptime: 8d0h54m10s
Dumping 2381 out of 24547 =
MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from =
/boot/kernel/geom_mirror.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_mirror.ko
Reading symbols from /boot/kernel/geom_stripe.ko...Reading symbols from =
/boot/kernel/geom_stripe.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_stripe.ko
Reading symbols from /boot/kernel/if_em.ko...Reading symbols from =
/boot/kernel/if_em.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/if_em.ko
Reading symbols from /boot/kernel/linprocfs.ko...Reading symbols from =
/boot/kernel/linprocfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/linprocfs.ko
Reading symbols from /boot/kernel/linux.ko...Reading symbols from =
/boot/kernel/linux.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/linux.ko
#0 doadump (textdump=3DVariable "textdump" is not available.
) at pcpu.h:224
224 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) bt
#0 doadump (textdump=3DVariable "textdump" is not available.
) at pcpu.h:224
#1 0xffffffff808ea3a1 in kern_reboot (howto=3D260) at =
/usr/src/sys/kern/kern_shutdown.c:448
#2 0xffffffff808ea897 in panic (fmt=3D0x1 <Address 0x1 out of bounds>) =
at /usr/src/sys/kern/kern_shutdown.c:636
#3 0xffffffff8092ed22 in propagate_priority (td=3DVariable "td" is not =
available.
) at /usr/src/sys/kern/subr_turnstile.c:227
#4 0xffffffff8092fa4e in turnstile_wait (ts=3DVariable "ts" is not =
available.
) at /usr/src/sys/kern/subr_turnstile.c:743
#5 0xffffffff808d8d48 in _mtx_lock_sleep (m=3D0xfffffe044a3c8238, =
tid=3D18446741888664231936, opts=3DVariable "opts" is not available.
)
at /usr/src/sys/kern/kern_mutex.c:471
#6 0xffffffff80820fa4 in nfscl_loadattrcache (vpp=3DVariable "vpp" is =
not available.
) at /usr/src/sys/fs/nfsclient/nfs_clport.c:379
#7 0xffffffff8081758c in ncl_readrpc (vp=3D0xfffffe044a6cd780, =
uiop=3D0xffffff86962fc650, cred=3DVariable "cred" is not available.
)
at /usr/src/sys/fs/nfsclient/nfs_clvnops.c:1369
#8 0xffffffff80824c45 in ncl_getpages (ap=3D0xffffff86962fc6f0) at =
/usr/src/sys/fs/nfsclient/nfs_clbio.c:171
#9 0xffffffff80b5aa0c in vnode_pager_getpages =
(object=3D0xfffffe016aa16570, m=3D0xffffff86962fc770, count=3DVariable =
"count" is not available.
)
at vnode_if.h:1154
#10 0xffffffff80b3fc93 in vm_fault_hold (map=3D0xfffffe007f7e3188, =
vaddr=3D34366988288, fault_type=3D1 '\001', fault_flags=3DVariable =
"fault_flags" is not available.
)
at vm_pager.h:128
#11 0xffffffff80b41cc3 in vm_fault (map=3D0xfffffe007f7e3188, =
vaddr=3D34366988288, fault_type=3DVariable "fault_type" is not =
available.
)
at /usr/src/sys/vm/vm_fault.c:229
#12 0xffffffff80bd84b4 in trap_pfault (frame=3D0xffffff86962fcc40, =
usermode=3D1) at /usr/src/sys/amd64/amd64/trap.c:740
#13 0xffffffff80bd8c6c in trap (frame=3D0xffffff86962fcc40) at =
/usr/src/sys/amd64/amd64/trap.c:358
#14 0xffffffff80bc315f in calltrap () at =
/usr/src/sys/amd64/amd64/exception.S:228
#15 0x0000000802091386 in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb)=20
</snip>
Dump header from device /dev/mirror/gm0s1b
Architecture: amd64
Architecture Version: 2
Dump Length: 2496667648B (2381 MB)
Blocksize: 512
Dumptime: Mon Mar 18 19:35:00 2013
Hostname: xxxxxxxxx
Magic: FreeBSD Kernel Dump
Version String: FreeBSD 9.1-RELEASE #0: Fri Jan 4 12:28:48 CET 2013
root@xxxxx:/usr/obj/usr/src/sys/GENERIC
Panic String: sleeping thread
Dump Parity: 826144189
Bounds: 5
Dump Status: good
Any ideas?=20
Thanks,=20
/mich
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?A6D4A877-2DBA-4E9D-996D-2E34834BF60E>