Date: Mon, 03 Mar 2014 20:49:39 -0600 From: Bryan Drewery <bdrewery@FreeBSD.org> To: John Baldwin <jhb@freebsd.org> Cc: freebsd-current@freebsd.org Subject: Re: panic: lockmgr still held [tmpfs] [vm_map_remove()->vdropl()] (r262186: Thu Feb 20) Message-ID: <53153F43.6010506@FreeBSD.org> In-Reply-To: <201403031306.59405.jhb@freebsd.org> References: <53109ACB.20102@FreeBSD.org> <201402281618.57291.jhb@freebsd.org> <53135535.30707@FreeBSD.org> <201403031306.59405.jhb@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--dVT2NJTwIR5rPstuNdhVumsAuNvvomOLa
Content-Type: text/plain; charset=ISO-8859-15
Content-Transfer-Encoding: quoted-printable
On 3/3/2014 12:06 PM, John Baldwin wrote:
> On Sunday, March 02, 2014 10:58:45 am Bryan Drewery wrote:
>> On 2/28/2014 3:18 PM, John Baldwin wrote:
>>> On Friday, February 28, 2014 9:18:51 am Bryan Drewery wrote:
>>>> While using poudriere:
>>>>
>>>>> Unread portion of the kernel message buffer:
>>>>> panic: lockmgr still held
>>>>> cpuid =3D 12
>>>>> KDB: stack backtrace:
>>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffff=
e124804f7a0
>>>>> kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe124804f850
>>>>> vpanic() at vpanic+0x126/frame 0xfffffe124804f890
>>>>> kassert_panic() at kassert_panic+0x139/frame 0xfffffe124804f900
>>>>> lockdestroy() at lockdestroy+0x3b/frame 0xfffffe124804f920
>>>>> vdropl() at vdropl+0x1c8/frame 0xfffffe124804f960
>>>>> vm_object_deallocate() at vm_object_deallocate+0x10b/frame 0xfffffe=
124804f9c0
>>>>> vm_map_process_deferred() at vm_map_process_deferred+0x89/frame 0xf=
ffffe124804f9f0
>>>>> vm_map_remove() at vm_map_remove+0xc8/frame 0xfffffe124804fa20
>>>>> vmspace_exit() at vmspace_exit+0xc9/frame 0xfffffe124804fa60
>>>>> exit1() at exit1+0x541/frame 0xfffffe124804fad0
>>>>> sys_sys_exit() at sys_sys_exit+0xe/frame 0xfffffe124804fae0
>>>>> ia32_syscall() at ia32_syscall+0x270/frame 0xfffffe124804fbf0
>>>>> Xint0x80_syscall() at Xint0x80_syscall+0x95/frame 0xfffffe124804fbf=
0
>>>>> --- syscall (1, FreeBSD ELF32, sys_sys_exit), rip =3D 0x281014df, r=
sp =3D 0xffffc45c, rbp =3D 0xffffc468 ---
>>>>
>>>>> #4 0xffffffff808c00db in lockdestroy (lk=3D0xfffff80a88a285f0) at =
/usr/src/sys/kern/kern_lock.c:440
>>>>> 440 KASSERT(lk->lk_lock =3D=3D LK_UNLOCKED, ("lockmgr s=
till held"));
>>>>> (kgdb) print *lk
>>>>> $1 =3D {lock_object =3D {lo_name =3D 0xffffffff8201a1bd "tmpfs", lo=
_flags =3D 116588552, lo_data =3D 0, lo_witness =3D 0xfffffe00006fec00}, =
lk_lock =3D=20
>>> 18446735288132049184, lk_exslpfail =3D 0,
>>>>> lk_timo =3D 51, lk_pri =3D 96}
>>>
>>> Can you please grab people.freebsd.org/~jhb/gdb/*
>>>
>>> and then do 'cd /path/to/files', 'source gdb6', 'frame 4', 'lockmgr_o=
wner lk'?
>>>
>>
>> (kgdb) lockmgr_owner lk
>> td: 0xfffff80272c61920
>> pid: 55040, p_comm: testprog
>=20
> Can you get a stack trace of that program? ('proc 55040', 'bt')
>=20
It's the same as original:
> Loaded symbols for /boot/kernel/sem.ko.symbols
> #0 doadump (textdump=3D1) at pcpu.h:219
> 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td)
> (kgdb) bt
> #0 doadump (textdump=3D1) at pcpu.h:219
> #1 0xffffffff808e33a7 in kern_reboot (howto=3D260) at /usr/src/sys/ker=
n/kern_shutdown.c:452
> #2 0xffffffff808e38b5 in vpanic (fmt=3D<value optimized out>, ap=3D<va=
lue optimized out>) at /usr/src/sys/kern/kern_shutdown.c:759
> #3 0xffffffff808e3749 in kassert_panic (fmt=3D<value optimized out>) a=
t /usr/src/sys/kern/kern_shutdown.c:647
> #4 0xffffffff808c00db in lockdestroy (lk=3D0xfffff80a88a285f0) at /usr=
/src/sys/kern/kern_lock.c:440
> #5 0xffffffff80990d38 in vdropl (vp=3D0xfffff80a88a28588) at /usr/src/=
sys/kern/vfs_subr.c:2417
> #6 0xffffffff80b73cbb in vm_object_deallocate (object=3D<value optimiz=
ed out>) at /usr/src/sys/vm/vm_object.c:539
> #7 0xffffffff80b6a3a9 in vm_map_process_deferred () at /usr/src/sys/vm=
/vm_map.c:2763
> #8 0xffffffff80b6e9c8 in vm_map_remove (map=3D<value optimized out>, s=
tart=3D<value optimized out>, end=3D<value optimized out>) at /usr/src/sy=
s/vm/vm_map.c:488
> #9 0xffffffff80b6a179 in vmspace_exit (td=3D0xfffff80272c61920) at /us=
r/src/sys/vm/vm_map.c:327
> #10 0xffffffff808a7411 in exit1 (td=3D0xfffff80272c61920, rv=3D<value o=
ptimized out>) at /usr/src/sys/kern/kern_exit.c:319
> #11 0xffffffff808a6ece in sys_sys_exit (td=3D0x0, uap=3D<value optimize=
d out>) at /usr/src/sys/kern/kern_exit.c:119
> #12 0xffffffff80dd2720 in ia32_syscall (frame=3D0xfffffe124804fc00) at =
subr_syscall.c:133
> #13 0xffffffff80cd6325 in Xint0x80_syscall () at ia32_exception.S:73
> #14 0x00000000281014df in ?? ()
> Previous frame inner to this frame (corrupt stack?)
> Current language: auto; currently minimal
> (kgdb) proc 55040
> [Switching to thread 668 (Thread 100898)]#0 doadump (textdump=3D1) at =
pcpu.h:219
> 219 __asm("movq %%gs:%1,%0" : "=3Dr" (td)
> (kgdb) bt
> #0 doadump (textdump=3D1) at pcpu.h:219
> #1 0xffffffff808e33a7 in kern_reboot (howto=3D260) at /usr/src/sys/ker=
n/kern_shutdown.c:452
> #2 0xffffffff808e38b5 in vpanic (fmt=3D<value optimized out>, ap=3D<va=
lue optimized out>) at /usr/src/sys/kern/kern_shutdown.c:759
> #3 0xffffffff808e3749 in kassert_panic (fmt=3D<value optimized out>) a=
t /usr/src/sys/kern/kern_shutdown.c:647
> #4 0xffffffff808c00db in lockdestroy (lk=3D0xfffff80a88a285f0) at /usr=
/src/sys/kern/kern_lock.c:440
> #5 0xffffffff80990d38 in vdropl (vp=3D0xfffff80a88a28588) at /usr/src/=
sys/kern/vfs_subr.c:2417
> #6 0xffffffff80b73cbb in vm_object_deallocate (object=3D<value optimiz=
ed out>) at /usr/src/sys/vm/vm_object.c:539
> #7 0xffffffff80b6a3a9 in vm_map_process_deferred () at /usr/src/sys/vm=
/vm_map.c:2763
> #8 0xffffffff80b6e9c8 in vm_map_remove (map=3D<value optimized out>, s=
tart=3D<value optimized out>, end=3D<value optimized out>) at /usr/src/sy=
s/vm/vm_map.c:488
> #9 0xffffffff80b6a179 in vmspace_exit (td=3D0xfffff80272c61920) at /us=
r/src/sys/vm/vm_map.c:327
> #10 0xffffffff808a7411 in exit1 (td=3D0xfffff80272c61920, rv=3D<value o=
ptimized out>) at /usr/src/sys/kern/kern_exit.c:319
> #11 0xffffffff808a6ece in sys_sys_exit (td=3D0x0, uap=3D<value optimize=
d out>) at /usr/src/sys/kern/kern_exit.c:119
> #12 0xffffffff80dd2720 in ia32_syscall (frame=3D0xfffffe124804fc00) at =
subr_syscall.c:133
> #13 0xffffffff80cd6325 in Xint0x80_syscall () at ia32_exception.S:73
> #14 0x00000000281014df in ?? ()
> (kgdb)
--=20
Regards,
Bryan Drewery
--dVT2NJTwIR5rPstuNdhVumsAuNvvomOLa
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (MingW32)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQEcBAEBAgAGBQJTFT9EAAoJEDXXcbtuRpfPyeAH/1Wb/BLBuaDVu2cn0PpfjKQ5
XhSmprWSUO8A6fHvGmPbEQuG2zzqwhXsCRUVKiXBvAlqFkB7PZWbOfL/3VJZP9Ul
WznJSogAqkHOZkGmokj4JEXdcQr7/moWAIo7cWoaGQVITMV2IcMTngwnqd12s5gU
j7UE+RA/PZaY9IRcQ2qJUQoQ+UHfWl10wyodTnYykMIfVi63oy1TAV14pWBjT89O
P9pjNlomeIzGSZw8FHnMkdD2tMquJwAPOwHq20owBPJa2Lzab5pVXEwbJv9Xavgg
9BrC1jOdd0lyRrhZA1Sm6g2ZTmgsEyQJ5eRMBTdXhtnI3kSp3AJkqTCJXPzKmao=
=v6DP
-----END PGP SIGNATURE-----
--dVT2NJTwIR5rPstuNdhVumsAuNvvomOLa--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53153F43.6010506>