Date: Mon, 13 Nov 2006 11:16:08 +0300 (MSK) From: Dmitriy Kirhlarov <dimma@higis.ru> To: FreeBSD-gnats-submit@FreeBSD.org Subject: kern/105464: panic under heavy load Message-ID: <200611130816.kAD8G8YD060213@dkirhlarov.mow.oilspace.com> Resent-Message-ID: <200611130930.kAD9U3PI081206@freefall.freebsd.org>
next in thread | raw e-mail | index | archive | help
>Number: 105464 >Category: kern >Synopsis: panic under heavy load >Confidential: no >Severity: critical >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Nov 13 09:30:02 GMT 2006 >Closed-Date: >Last-Modified: >Originator: Dmitriy Kirhlarov >Release: FreeBSD 6.2-PRERELEASE i386 >Organization: >Environment: System: FreeBSD lbsd02.lc.oilspace.net 6.2-PRERELEASE FreeBSD 6.2-PRERELEASE #0: Fri Nov 10 11:03:10 UTC 2006 root@jailhost1:/usr/obj/usr/src/sys/OILSPACE1DEB i386 >Description: I have reproduceble panic under heavy load. >How-To-Repeat: >Fix: unknown --- btfull.0 begins here --- GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i386-marcel-freebsd". Unread portion of the kernel message buffer: panic: thread 100083(nagios):1 holds process lock but isn't blocked on a lock cpuid = 0 KDB: enter: panic Physical memory: 1015 MB Dumping 125 MB: 110 94 78 62 46 30 14 #0 doadump () at pcpu.h:165 in pcpu.h (kgdb) #0 doadump () at pcpu.h:165 No locals. #1 0xd04897b6 in db_fncall (dummy1=1016, dummy2=0, dummy3=1016, dummy4=0xf66519cc "") at /usr/src/sys/ddb/db_command.c:492 fn_addr = -798992304 args = {0, 0, -797010818, -796751017, 0, -161146472, -800541819, 32, -796674272, 2} nargs = 0 retval = 32 t = 0 #2 0xd0489532 in db_command (last_cmdp=0xd08784a4, cmd_table=0x0, aux_cmd_tablep=0xd08328cc, aux_cmd_tablep_end=0xd08328e8) at /usr/src/sys/ddb/db_command.c:350 cmd = (struct command *) 0xd083b8c0 t = 0 modif = "\000\000\000\000ø\003\000\000è\031eööªwÐø\003\000\000ø\003\000\000\r\000\000\000\024\032eö5wÐü\031eöø\003\000\000\200%\000\000\f\000\017\003\v\206dÐx\000\000\000 \215\207Ð\000\000\000\000,\032eö\221¼HÐ0Ã\200Ð\020¹HÐ\000\000\000\000\020\000\000\000\000\000\000\000 \215\207Ð\026¯HÐ \215\207Ðà\204\207Ðx\000\000\000\220\032eö" addr = 1016 count = 1016 have_addr = 0 result = 0 #3 0xd0489645 in db_command_loop () at /usr/src/sys/ddb/db_command.c:458 No locals. #4 0xd048b845 in db_trap (type=3, code=0) at /usr/src/sys/ddb/db_main.c:222 jb = {{_jb = {-161146224, -161146252, -161146172, 1, 0, -800540698, 0, 0, 0, 0, -161146172, -798862896}}} prev_jb = (void *) 0x0 bkpt = 0 #5 0xd062527e in kdb_trap (type=0, code=0, tf=0xf6651b2c) at /usr/src/sys/kern/subr_kdb.c:473 did_stop_cpus = 1 handled = -161146068 #6 0xd07ac1a8 in trap (frame= {tf_fs = 8, tf_es = 40, tf_ds = -161152984, tf_edi = 256, tf_esi = 1, tf_ebp = -161145996, tf_isp = -161146024, tf_ebx = -161145936, tf_edx = 0, tf_ecx = -788320256, tf_eax = 18, tf_trapno = 3, tf_err = 0, tf_eip = -798863536, tf_cs = 32, tf_eflags = 150, tf_esp = -796858807, tf_ss = -796868175}) at /usr/src/sys/i386/i386/trap.c:594 td = (struct thread *) 0xd5be5d80 p = (struct proc *) 0xd5039430 sticks = 3496067121 i = 0 ucode = 0 type = 3 code = 0 eva = 0 #7 0xd07951ba in calltrap () at /usr/src/sys/i386/i386/exception.s:139 No locals. #8 0xd0624f50 in kdb_enter (msg=0x12 <Address 0x12 out of bounds>) at cpufunc.h:60 No locals. #9 0xd060625e in panic (fmt=0xd080f86c "thread %d(%s):%d holds %s but isn't blocked on a lock\n") at /usr/src/sys/kern/kern_shutdown.c:549 td = (struct thread *) 0xd5be5d80 bootopt = 256 newpanic = 1 ap = 0xf6651bb0 "ó\206\001" buf = "thread 100083(nagios):1 holds process lock but isn't blocked on a lock\n", '\0' <repeats 184 times> #10 0xd062f0f8 in propagate_priority (td=0xd5c73900) at /usr/src/sys/kern/subr_turnstile.c:239 tc = (struct turnstile_chain *) 0xd5c73900 ts = (struct turnstile *) 0xd51b71c0 pri = 197 #11 0xd062fe02 in turnstile_wait (lock=0xd5039498, owner=0xd5c73900) at /usr/src/sys/kern/subr_turnstile.c:643 tc = (struct turnstile_chain *) 0xd0885dc0 ts = (struct turnstile *) 0xd51b71c0 td = (struct thread *) 0xd5be5d80 td1 = (struct thread *) 0xd5c73900 #12 0xd05fae91 in _mtx_lock_sleep (m=0xd5039498, tid=3586022784, opts=0, file=0x12 <Address 0x12 out of bounds>, line=18) at /usr/src/sys/kern/kern_mutex.c:579 owner = (volatile struct thread *) 0xd5c73900 v = 0 #13 0xd05fa862 in _mtx_lock_flags (m=0xd5039498, opts=0, file=0xd080cfd0 "/usr/src/sys/kern/kern_thread.c", line=824) at /usr/src/sys/kern/kern_mutex.c:288 No locals. #14 0xd0613210 in thread_single (mode=0) at /usr/src/sys/kern/kern_thread.c:824 td = (struct thread *) 0xd5be5d80 td2 = (struct thread *) 0x0 p = (struct proc *) 0xd5039430 remaining = 18 #15 0xd05e9789 in fork1 (td=0xd5be5d80, flags=20, pages=0, procp=0xf6651ccc) at /usr/src/sys/kern/kern_fork.c:274 p1 = (struct proc *) 0xd5039430 p2 = (struct proc *) 0xd5be5d80 pptr = (struct proc *) 0xd1033000 newproc = (struct proc *) 0xd5039430 ok = -708944512 trypid = -721185640 curfail = 0 pidchecked = 85274 lastfail = {tv_sec = 0, tv_usec = 0} fd = (struct filedesc *) 0xd5039430 fdtol = (struct filedesc_to_leader *) 0x2de7afe9 td2 = (struct thread *) 0x45563fe4 kg2 = (struct ksegrp *) 0xd5039498 newsigacts = (struct sigacts *) 0xd50d1000 error = -726800032 #16 0xd05e93d9 in fork (td=0xd5be5d80, uap=0xf6651d04) at /usr/src/sys/kern/kern_fork.c:98 error = 0 p2 = (struct proc *) 0xd5be5d80 #17 0xd07acb90 in syscall (frame= {tf_fs = 59, tf_es = 59, tf_ds = -809566149, tf_edi = 137529352, tf_esi = 674594660, tf_ebp = -809526344, tf_isp = -161145500, tf_ebx = 673543348, tf_edx = 0, tf_ecx = 134975744, tf_eax = 2, tf_trapno = 12, tf_err = 2, tf_eip = 673966451, tf_cs = 51, tf_eflags = 646, tf_esp = -809526436, tf_ss = 59}) at /usr/src/sys/i386/i386/trap.c:983 params = 0xcfbf9b60 <Address 0xcfbf9b60 out of bounds> callp = (struct sysent *) 0xd084fef8 td = (struct thread *) 0xd5be5d80 p = (struct proc *) 0xd5039430 orig_tf_eflags = 646 sticks = 0 error = 0 narg = 0 args = {9, 135135232, 4096, 0, -721185744, 2, -708944512, 134962040} code = 2 #18 0xd079520f in Xint0x80_syscall () at /usr/src/sys/i386/i386/exception.s:200 No locals. #19 0x00000033 in ?? () No symbol table info available. (kgdb) --- btfull.0 ends here --- >Release-Note: >Audit-Trail: >Unformatted:
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200611130816.kAD8G8YD060213>