From owner-freebsd-stable@FreeBSD.ORG Thu Aug 22 07:01:09 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 177031F6 for ; Thu, 22 Aug 2013 07:01:09 +0000 (UTC) (envelope-from jdavidlists@gmail.com) Received: from mail-ob0-x22d.google.com (mail-ob0-x22d.google.com [IPv6:2607:f8b0:4003:c01::22d]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id D8DF62363 for ; Thu, 22 Aug 2013 07:01:08 +0000 (UTC) Received: by mail-ob0-f173.google.com with SMTP id ta17so2847311obb.4 for ; Thu, 22 Aug 2013 00:01:08 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:content-type; bh=/GgubVQxQnq5svSlC0BiInRi+R8IAzu2yWvkPrCE57w=; b=OlGzXdJ/QFGN3PfpGSl0kZzxeXB331hQgMQALIE0/FNjtMJuc1LZUANyC+1EmWcj8o KYEth2sP8wPWeIgBGyf/M38/o50/k/dDz4YMzP3S90B42B5TZv4g/KplhEmzs9fjJAx+ Sp8F63j4SBdLCgquA+AnMTLiU6rXxxxgggBn7RLCVgvv2/Icji+CJqEcIjFlaB9jmWlN SZxwDRohjwyJmnd2JE0RtZByf5AoFnB1izd+CHXtijY9t2UUZymiuDMg0y1MHM13dnha xCYBuV/yu2zK/bpdJbZjbz4fyU2vy3m3YlXIFbjbw8T/01teAhlHRRaIfCC1As1Fx6Gn 1yQQ== MIME-Version: 1.0 X-Received: by 10.50.178.133 with SMTP id cy5mr6629316igc.26.1377154868005; Thu, 22 Aug 2013 00:01:08 -0700 (PDT) Sender: jdavidlists@gmail.com Received: by 10.42.150.196 with HTTP; Thu, 22 Aug 2013 00:01:07 -0700 (PDT) In-Reply-To: <461961460.12238255.1377133690607.JavaMail.root@uoguelph.ca> References: <20130821131032.GX4972@kib.kiev.ua> <461961460.12238255.1377133690607.JavaMail.root@uoguelph.ca> Date: Thu, 22 Aug 2013 03:01:07 -0400 X-Google-Sender-Auth: 3vX7ZlkCR216GAM_bXtc1A3qGLA Message-ID: Subject: Re: NFS deadlock on 9.2-Beta1 From: J David To: freebsd-stable Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Aug 2013 07:01:09 -0000 Now that a kernel with INVARIANTS/WITNESS is finally available on a machine with serial console I am having terrible trouble provoking this to happen. (Machine grinds to a halt if I put the usual test load on it due to all the debug code in the kernel.) Did get this interesting LOR, though it did not cause a deadlock: lock order reversal: 1st 0xfffffe000adb9f30 so_snd_sx (so_snd_sx) @ /usr/src/sys/kern/uipc_sockbuf.c:145 2nd 0xfffffe000aa5b098 newnfs (newnfs) @ /usr/src/sys/kern/uipc_syscalls.c:2062 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xffffff834c3995c0 kdb_backtrace() at kdb_backtrace+0x39/frame 0xffffff834c399670 witness_checkorder() at witness_checkorder+0xc0a/frame 0xffffff834c3996f0 __lockmgr_args() at __lockmgr_args+0x390/frame 0xffffff834c399810 nfs_lock1() at nfs_lock1+0x87/frame 0xffffff834c399840 VOP_LOCK1_APV() at VOP_LOCK1_APV+0xbe/frame 0xffffff834c399870 _vn_lock() at _vn_lock+0x63/frame 0xffffff834c3998d0 kern_sendfile() at kern_sendfile+0x812/frame 0xffffff834c399ac0 do_sendfile() at do_sendfile+0x92/frame 0xffffff834c399b20 amd64_syscall() at amd64_syscall+0x259/frame 0xffffff834c399c30 Xfast_syscall() at Xfast_syscall+0xfb/frame 0xffffff834c399c30 --- syscall (393, FreeBSD ELF64, sys_sendfile), rip = 0x801b24f4c, rsp = 0x7fffffffcf58, rbp = 0x7fffffffd290 --- Once the real deal pops up, collecting the full requested info should be no problem, but it could take awhile to happen with only one machine that can't run the full test battery. So if a "real" fix is dependent on this, reverting r250907 for 9.2-RELEASE is probably the way to go. With that configuration, releng/9.2 continues to be pretty solid for us. Thanks! (Since this doesn't contain the requested info, I heavily trimmed the Cc: list. It is not my intention to waste the time of everybody involved.)