From owner-freebsd-threads@freebsd.org Sat Oct 3 03:13:28 2015 Return-Path: Delivered-To: freebsd-threads@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 34161A0FC61 for ; Sat, 3 Oct 2015 03:13:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 209791A88 for ; Sat, 3 Oct 2015 03:13:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id t933DSu3011786 for ; Sat, 3 Oct 2015 03:13:28 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-threads@FreeBSD.org Subject: [Bug 203521] MongoDB hangs during mi_switch Date: Sat, 03 Oct 2015 03:13:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: threads X-Bugzilla-Version: 10.2-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rwestlun@gmail.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-threads@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-threads@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Threading on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Oct 2015 03:13:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203521 Bug ID: 203521 Summary: MongoDB hangs during mi_switch Product: Base System Version: 10.2-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: threads Assignee: freebsd-threads@FreeBSD.org Reporter: rwestlun@gmail.com I'm running a webserver on 10.2-RELEASE with MongoDB-2.6.7 in a ZFS-backed jail. After rebooting after an unrelated crash, my jail is unable to fully start. ezjail-admin just blocks. I used jexec to get in to the jail and found this: PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 20928 mongodb 1 52 0 100M 40412K wait 0 0:00 0.00% mongod 26645 root 1 20 0 23588K 3408K pause 1 0:00 0.00% tcsh 20391 root 1 20 0 17084K 2480K wait 1 0:00 0.00% sh 20898 mongodb 1 52 0 23592K 2492K pause 0 0:00 0.00% csh 20821 root 1 20 0 14512K 1748K select 1 0:00 0.00% syslogd 20870 root 1 52 0 47724K 2252K wait 1 0:00 0.00% su 21003 mongodb 1 52 0 104M 41244K umtxn 1 0:00 0.00% mongod 20862 root 1 20 0 17084K 2580K wait 0 0:00 0.00% sh 73529 root 1 20 0 21936K 2292K CPU1 1 0:00 0.00% top 21000 mongodb 1 52 0 100M 40408K wait 0 0:00 0.00% mongod MongoDB is stuck in state 'umtxn'. And procstat: root@recipes:/ # procstat -kk 21003 PID TID COMM TDNAME KSTACK 21003 100205 mongod - mi_switch+0xe1 sleepq_catch_signals+0xab sleepq_wait_sig+0xf _sleep+0x27d umtxq_sleep+0x125 do_lock_umutex+0x1f74 __umtx_op_wait_umutex+0x78 amd64_syscall+0x357 Xfast_syscall+0xfb root@recipes:/ # procstat -r 21003 PID COMM RESOURCE VALUE 21003 mongod user time 00:00:00.000000 21003 mongod system time 00:00:00.007805 21003 mongod maximum RSS 40940 KB 21003 mongod integral shared memory 14588 KB 21003 mongod integral unshared data 360 KB 21003 mongod integral unshared stack 128 KB 21003 mongod page reclaims 324 21003 mongod page faults 0 21003 mongod swaps 0 21003 mongod block reads 1 21003 mongod block writes 1 21003 mongod messages sent 0 21003 mongod messages received 0 21003 mongod signals received 0 21003 mongod voluntary context switches 2 21003 mongod involuntary context switches 0 root@recipes:/ # procstat -t 21003 PID TID COMM TDNAME CPU PRI STATE WCHAN 21003 100205 mongod - 1 152 sleep umtxn root@recipes:/ # uname -a FreeBSD recipes 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 It looks like maybe a deadlock is preventing the context switch. This happens every time I reset the jail. -- You are receiving this mail because: You are the assignee for the bug.