From owner-freebsd-stable@FreeBSD.ORG Thu May 10 22:31:53 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2D2C416A400 for ; Thu, 10 May 2007 22:31:53 +0000 (UTC) (envelope-from scotts@inetz.com) Received: from garnet.inetz.com (mail.inetz.com [209.63.19.5]) by mx1.freebsd.org (Postfix) with ESMTP id 0BC1D13C45A for ; Thu, 10 May 2007 22:31:53 +0000 (UTC) (envelope-from scotts@inetz.com) Received: from localhost (localhost [127.0.0.1]) by garnet.inetz.com (Postfix) with ESMTP id 95D5B5656C; Thu, 10 May 2007 16:31:52 -0600 (MDT) X-Virus-Scanned: amavisd-new at inetz.com X-Spam-Score: -4.399 X-Spam-Level: X-Spam-Status: No, score=-4.399 required=4 tests=[ALL_TRUSTED=-1.8, BAYES_00=-2.599] Received: from garnet.inetz.com ([127.0.0.1]) by localhost (mail.inetz.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xhNbRnHm-i42; Thu, 10 May 2007 16:31:47 -0600 (MDT) Received: from [10.1.2.151] (unknown [10.2.2.52]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by garnet.inetz.com (Postfix) with ESMTP id BA24356569; Thu, 10 May 2007 16:31:47 -0600 (MDT) Message-ID: <46439D53.5070203@inetz.com> Date: Thu, 10 May 2007 16:31:47 -0600 From: Scott Swanson User-Agent: Thunderbird 2.0.0.0 (X11/20070326) MIME-Version: 1.0 To: Kris Kennaway References: <46438569.1000506@inetz.com> <20070510214348.GA68925@xor.obsecurity.org> In-Reply-To: <20070510214348.GA68925@xor.obsecurity.org> X-Enigmail-Version: 0.95.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: panic: spin lock held too long (w/ backtrace) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 May 2007 22:31:53 -0000 Kris Kennaway wrote: > On Thu, May 10, 2007 at 02:49:45PM -0600, Scott Swanson wrote: >> Hello all, >> >> I have a couple dozen SuperMicro servers in production and have had >> reoccurring crashing issues on a couple of them that are under higher >> load. >> >> After managing to pry one out of production, I have been able to >> re-create the problem fairly consistently just by looping a script that >> tars up a large directory and writes the the file to a different >> partition on the same raid array. >> >> Can anyone point me towards the next step to debug this issue? I can >> pursue any other debugging info that may be required. >> >> Regards; >> Scott Swanson >> Inetz Media >> >> >>> uname -a >> FreeBSD pyrite.inetz.com 6.2-RELEASE-p4 FreeBSD 6.2-RELEASE-p4 #3: Tue >> May 8 13:08:22 MDT 2007 >> root@biotite.inetz.com:/usr/obj/usr/src/sys/PYRITE i386 >> >> >> root@pyrite /usr/obj/usr/src/sys/PYRITE > kgdb kernel.debug >> /var/crash/vmcore.0 >> [GDB will not be able to debug user-mode threads: >> /usr/lib/libthread_db.so: Undefined symbol "ps_pglobal_lookup"] >> GNU gdb 6.1.1 [FreeBSD] >> >> Unread portion of the kernel message buffer: >> spin lock smp rendezvous held by 0xc95a5900 for > 5 seconds > > What is thread 0xc95a5900 doing? > > Kris > How can I determine the state of that thread? Do I need to be using DDB to glean that info, or can I use kgdb? Can't seem to track this down in the Developers Handbook... Regards; Scott