From owner-freebsd-stable@FreeBSD.ORG Wed Aug 11 01:55:28 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 61D8D106566C for ; Wed, 11 Aug 2010 01:55:28 +0000 (UTC) (envelope-from alan.bryan@yahoo.com) Received: from web50506.mail.re2.yahoo.com (web50506.mail.re2.yahoo.com [206.190.38.82]) by mx1.freebsd.org (Postfix) with SMTP id 118F18FC16 for ; Wed, 11 Aug 2010 01:55:27 +0000 (UTC) Received: (qmail 18654 invoked by uid 60001); 11 Aug 2010 01:28:46 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1281490126; bh=nyMUhW4LryhH7aHnavqsL4yhuInCuw/dtWh6o2weKtw=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=VMU/cfB8Mi1dkkZEWR0BVzzmQl3ftqH8x+zxYfwTpyGAIyyp+k5aA3KaIzykC4TX7E0kerKAyviJRe6uPH+JvpfMyoDXQIQkQQnZl8rltwibegLEICJDxbLOoi1wU5AnQOunQj2/k1mz5Ujn5LR6ap/YAS0DpHkfmiQORqhQDEg= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=Q/ozc9GGGyVIAPZv9BgEofEUjRufyWIRII8wnsyjXMhx8K2NglQGOH5NGr8ZDP6DxDQEi33BQtBweEtMmp63N2zpBDjSt3uWMj4wQroUXI9KEHQrIh4jrQKOpCDToTQ+7WnOK3VGbg1umzkAwRD/zGCPnSbwdYNdRLIGzTFmBn4=; Message-ID: <881208.18587.qm@web50506.mail.re2.yahoo.com> X-YMail-OSG: GmZTx2AVM1m4x9tpc1IaXH7PGF9odCNq8auUQgoRkkST9Fo dQ76Nbg282v4FI6D93IGVQ9P6ZBRnxu.OHQNDt.KSsGYO_HR4h4L1kZHonOn tzrvpTfHF_aQoHR2cBMvDinqEI9d6REZfkWFqdJysD44SHzuD0JourJcTRtt M0hhsw9CGz48yPQcPsWRfY6Buptc4wbOeLhGxgB.garJAJM2cwmMHixPj0RL 0N_g7O4AFGUEm8T05ksVPp7HfD5FsNu5w.WRtqmWr6hziGRLv_pvv7TXeyj3 NcpkpQG0Bhw.oriOr81XNy.pbER.6c2UCTnsnBG4b1nGI3epepT1H4qD2K_v Rgg-- Received: from [99.24.6.121] by web50506.mail.re2.yahoo.com via HTTP; Tue, 10 Aug 2010 18:28:46 PDT X-Mailer: YahooMailClassic/11.3.2 YahooMailWebService/0.8.105.279950 Date: Tue, 10 Aug 2010 18:28:46 -0700 (PDT) From: alan bryan To: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Subject: FreeBSD 8.1-Release NFSD hang in rc_lo state X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Aug 2010 01:55:28 -0000 I'm doing some testing with loading up a new storage server. I have couple ZFS filesystems exported via NFS over UDP. I have a client machine (8.1 also) that has mounted those filesystems along with some test PHP scripts that are doing a ton of read/write/fstat operations to load it up. If I ctrl-C to kill the scripts on the client I found that I can end up with nfsd on the server stuck at 100% CPU and in the rc_lo state. /etc/rc.d/nfsd restart does nothing. # nfsstat -s -w 1 -W GtAttr Lookup Rdlink Read Write Rename Access Rddir 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Client complaining with: kernel: nfs server 192.168.1.2:/tank/alantest2: not responding Top on the server: last pid: 4776; load averages: 1.24, 1.15, 1.15 up 0+23:04:46 18:25:26 53 processes: 2 running, 35 sleeping, 16 lock CPU: 0.0% user, 0.0% nice, 25.0% system, 0.0% interrupt, 75.0% idle Mem: 21M Active, 5812K Inact, 2029M Wired, 88K Cache, 8592K Buf, 5857M Free Swap: 3942M Total, 3942M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 922 root 44 0 5804K 1820K CPU2 2 63:52 100.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 1 30:23 0.00% {nfsd: service} 922 root 48 0 5804K 1820K rpcsvc 1 30:20 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 1 30:17 0.00% {nfsd: service} 922 root 48 0 5804K 1820K rpcsvc 1 30:17 0.00% {nfsd: service} 922 root 46 0 5804K 1820K rpcsvc 1 30:13 0.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 2 30:13 0.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 3 30:12 0.00% {nfsd: service} 922 root 44 0 5804K 1820K *rc_lo 0 30:10 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 2 30:07 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 0 30:03 0.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 1 30:03 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 2 30:03 0.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 2 30:02 0.00% {nfsd: service} 922 root 45 0 5804K 1820K *rc_lo 1 29:59 0.00% {nfsd: master} 922 root 45 0 5804K 1820K *rc_lo 2 29:54 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 0 29:54 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 0 29:52 0.00% {nfsd: service} 922 root 47 0 5804K 1820K *rc_lo 2 29:46 0.00% {nfsd: service} 922 root 46 0 5804K 1820K *rc_lo 1 29:44 0.00% {nfsd: service}