From owner-freebsd-questions@FreeBSD.ORG Tue Dec 4 03:26:05 2007 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 311A916A41A for ; Tue, 4 Dec 2007 03:26:05 +0000 (UTC) (envelope-from crapsh@monkeybrains.net) Received: from ape.monkeybrains.net (ape.monkeybrains.NET [208.69.40.11]) by mx1.freebsd.org (Postfix) with ESMTP id 26C8713C4D1 for ; Tue, 4 Dec 2007 03:26:05 +0000 (UTC) (envelope-from crapsh@monkeybrains.net) Received: from monchichi.monkeybrains.net (adsl-75-36-249-166.dsl.pltn13.sbcglobal.net [75.36.249.166]) (authenticated bits=0) by ape.monkeybrains.net (8.14.1/8.14.1) with ESMTP id lB42sq6U038968 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Mon, 3 Dec 2007 18:54:53 -0800 (PST) (envelope-from crapsh@monkeybrains.net) Message-ID: <4754C19E.5060708@monkeybrains.net> Date: Mon, 03 Dec 2007 18:55:26 -0800 From: Rudy User-Agent: Thunderbird 2.0.0.9 (X11/20071122) MIME-Version: 1.0 To: freebsd-questions@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV version 0.91.2, clamav-milter version 0.91.2 on pita.monkeybrains.net X-Virus-Status: Clean Subject: cron pile up! Lot's of "cron: running job (cron)" X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Dec 2007 03:26:05 -0000 cron jobs seem to get stuck. Not always, but within a day, there are at least 20 stuck. It is not always the same cronjob that does the sticking. :) When this occurs, I can run ps ax| grep cron and get a bunch of lines like this: 51921 ?? D 0:00.00 cron: running job (cron) 51922 ?? IVs 0:00.00 cron: running job (cron) 52544 ?? D 0:00.00 cron: running job (cron) 52545 ?? IVs 0:00.00 cron: running job (cron) 54418 ?? D 0:00.00 cron: running job (cron) 54419 ?? IVs 0:00.00 cron: running job (cron) 54667 ?? D 0:00.00 cron: running job (cron) 54668 ?? IVs 0:00.00 cron: running job (cron) 55835 ?? D 0:00.00 cron: running job (cron) 55836 ?? IVs 0:00.00 cron: running job (cron) What is going on? Please help me remedy this situation. The PID numbers next to cron's with a STATE of "IVs" show up in /var/log/cron, for example: # grep 54668 /var/log/cron Dec 2 22:32:00 pita /usr/sbin/cron[54668]: (root) CMD (/root/bin/raid-status.sh CRON) # grep 55836 /var/log/cron Dec 2 22:40:00 pita /usr/sbin/cron[55836]: (root) CMD (/root/bin/10minutes.mail.sh | mail -E -s "[ERROR] mail.monkeybrains.net" example@example.com) If I run 'lsof' I can find these open handles: cron 54668 root cwd VDIR 0,80 512 471040 /var/cron cron 54668 root rtd VDIR 0,77 512 2 / cron 54668 root txt VREG 0,82 32496 122864 /usr/sbin/cron cron 54668 root txt VREG 0,77 162712 49929 /libexec/ld-elf.so.1 cron 54668 root txt VREG 0,77 44788 49922 /lib/libutil.so.5 cron 54668 root txt VREG 0,77 941952 49923 /lib/libc.so.6 cron 54668 root txt VREG 0,82 19277 826439 /usr/local/lib/nss_mysql.so.1 cron 54668 root txt VREG 0,82 413626 826986 /usr/local/lib/mysql/libmysqlclient.so.15 cron 54668 root txt VREG 0,77 64604 49928 /lib/libz.so.3 cron 54668 root txt VREG 0,77 107432 49918 /lib/libm.so.4 cron 54668 root txt VREG 0,77 28648 49916 /lib/libcrypt.so.3 cron 54668 root 0u PIPE 0xca02c660 16384 ->0xca02c718 cron 54668 root 1u PIPE 0xcc473250 0 ->0xcc473198 cron 54668 root 2u PIPE 0xcc473250 0 ->0xcc473198 cron 54668 root 5u unix 0xc6665858 0t0 ->0xc67e89bc cron 54667 root cwd VDIR 0,80 512 471040 /var/cron cron 54667 root rtd VDIR 0,77 512 2 / cron 54667 root txt VREG 0,82 32496 122864 /usr/sbin/cron cron 54667 root txt VREG 0,77 162712 49929 /libexec/ld-elf.so.1 cron 54667 root txt VREG 0,77 44788 49922 /lib/libutil.so.5 cron 54667 root txt VREG 0,77 941952 49923 /lib/libc.so.6 cron 54667 root txt VREG 0,82 19277 826439 /usr/local/lib/nss_mysql.so.1 cron 54667 root txt VREG 0,82 413626 826986 /usr/local/lib/mysql/libmysqlclient.so.15 cron 54667 root txt VREG 0,77 64604 49928 /lib/libz.so.3 cron 54667 root txt VREG 0,77 107432 49918 /lib/libm.so.4 cron 54667 root txt VREG 0,77 28648 49916 /lib/libcrypt.so.3 cron 54667 root 0u VCHR 0,26 0t0 26 /dev/null cron 54667 root 1u VCHR 0,26 0t0 26 /dev/null cron 54667 root 2u VCHR 0,26 0t0 26 /dev/null cron 54667 root 3u PIPE 0xca02c660 16384 ->0xca02c718 cron 54667 root 4u PIPE 0xca02c718 0 ->0xca02c660 cron 54667 root 5u unix 0xc6665858 0t0 ->0xc67e89bc cron 54667 root 6u PIPE 0xcc473198 16384 ->0xcc473250 cron 54667 root 7u unix 0xc67e86f4 0t0 ->(none) cron 54667 root 8u PIPE 0xcc473250 0 ->0xcc473198 What is going on? Is my libnss_mysql acting up? Rudy