From owner-freebsd-stable@FreeBSD.ORG  Wed May  4 19:28:35 2011
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id DEC801065670
	for <freebsd-stable@freebsd.org>; Wed,  4 May 2011 19:28:35 +0000 (UTC)
	(envelope-from mi+thun@aldan.algebra.com)
Received: from smtp03.lnh.mail.rcn.net (smtp03.lnh.mail.rcn.net
	[207.172.157.103])
	by mx1.freebsd.org (Postfix) with ESMTP id 9BD148FC08
	for <freebsd-stable@freebsd.org>; Wed,  4 May 2011 19:28:35 +0000 (UTC)
Received: from mr16.lnh.mail.rcn.net ([207.172.157.36])
	by smtp02.lnh.mail.rcn.net with ESMTP; 04 May 2011 14:59:37 -0400
Received: from smtp01.lnh.mail.rcn.net (smtp01.lnh.mail.rcn.net [207.172.4.11])
	by mr16.lnh.mail.rcn.net (MOS 4.2.3-GA) with ESMTP id BBF68263;
	Wed, 4 May 2011 14:59:36 -0400
Received-SPF: None identity=pra; client-ip=209.6.61.133;
	receiver=smtp01.lnh.mail.rcn.net;
	envelope-from="mi+thun@aldan.algebra.com";
	x-sender="mi+thun@aldan.algebra.com";
	x-conformance=sidf_compatible
Received-SPF: None identity=mailfrom; client-ip=209.6.61.133;
	receiver=smtp01.lnh.mail.rcn.net;
	envelope-from="mi+thun@aldan.algebra.com";
	x-sender="mi+thun@aldan.algebra.com";
	x-conformance=sidf_compatible
Received-SPF: None identity=helo; client-ip=209.6.61.133;
	receiver=smtp01.lnh.mail.rcn.net;
	envelope-from="mi+thun@aldan.algebra.com";
	x-sender="postmaster@utka.zajac"; x-conformance=sidf_compatible
X-Auth-ID: anat
Received: from unknown (HELO utka.zajac) ([209.6.61.133])
	by smtp01.lnh.mail.rcn.net with ESMTP; 04 May 2011 14:59:37 -0400
Message-ID: <4DC1A1CC.4080901@aldan.algebra.com>
Date: Wed, 04 May 2011 14:58:20 -0400
From: "Mikhail T." <mi+thun@aldan.algebra.com>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US;
	rv:1.9.2.13) Gecko/20101229 Lightning/1.0b2 Thunderbird/3.1.7
MIME-Version: 1.0
To: freebsd-stable@freebsd.org
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Subject: syslogd spinning the CPU, not logging...
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 04 May 2011 19:28:36 -0000

On FreeBSD/amd64 8.2-STABLE as of Sun Feb 27. I dismissed this problem the first 
time (a week or two ago), but just saw it again. Something triggers syslogd into 
spinning all available CPU -- while not logging anything.

Attempts to log anything -- such as by invoking logger(1) -- simply hang. 
sendmail hangs too -- now new e-mail is coming. It is not pretty.

ktrace-ing the process yields empty file -- it is not doing system-calls, while 
spinning.

Attaching the debugger several times shows the same stack:

    #0  0x00000008007cb1d6 in _pthread_mutex_init_calloc_cb () from /lib/libc.so.7
    #1  0x00000008007cd9fb in _pthread_mutex_init_calloc_cb () from /lib/libc.so.7
    #2  0x00000008007d4825 in free () from /lib/libc.so.7
    #3  0x00000008007c5aab in catopen () from /lib/libc.so.7
    #4  0x00000008007c5410 in strerror_r () from /lib/libc.so.7
    #5  0x00000008007c556d in strerror () from /lib/libc.so.7
    #6  0x0000000000403c10 in ?? ()
    ...


Among the logging-destinations in my syslog.conf there is a program, that exits 
sometimes -- but never "too fast". Normally, syslogd simply restarts it without 
an issue...

Any ideas? Thanks!

    -mi