From owner-freebsd-stable@FreeBSD.ORG Wed May 13 17:18:32 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 934961065679 for ; Wed, 13 May 2009 17:18:32 +0000 (UTC) (envelope-from cswiger@mac.com) Received: from asmtpout021.mac.com (asmtpout021.mac.com [17.148.16.96]) by mx1.freebsd.org (Postfix) with ESMTP id 77AE68FC21 for ; Wed, 13 May 2009 17:18:28 +0000 (UTC) (envelope-from cswiger@mac.com) MIME-version: 1.0 Content-transfer-encoding: 7BIT Content-type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Received: from cswiger1.apple.com ([17.227.140.124]) by asmtp021.mac.com (Sun Java(tm) System Messaging Server 6.3-8.01 (built Dec 16 2008; 32bit)) with ESMTPSA id <0KJL00KIXEQSA120@asmtp021.mac.com>; Wed, 13 May 2009 10:18:28 -0700 (PDT) Message-id: <0ACD7522-58D7-4D70-8F79-77791DD98299@mac.com> From: Chuck Swiger To: John Baldwin , "Marc G. Fournier" In-reply-to: <200905131252.15171.jhb@freebsd.org> Date: Wed, 13 May 2009 10:18:27 -0700 References: <20090513040719.D17646@hub.org> <200905131009.00403.jhb@freebsd.org> <20090513133143.M17646@hub.org> <200905131252.15171.jhb@freebsd.org> X-Mailer: Apple Mail (2.930.3) Cc: FreeBSD Stable List Subject: Re: More data on 7.2-RELEASE "hangs" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 May 2009 17:18:33 -0000 Hi-- On May 13, 2009, at 9:52 AM, John Baldwin wrote: [ ... ] > Well, you had a whole lot of page faults and other VM activity, plus > 500k > syscalls. The 'w' is a count of swapped processes, so basically > your box is > swapping a whole lot it seems. I think your box is just overloaded. Yep. There's a classic failure mode with preforking Apache where if the number of requests exceeds the max number of children which can be run without sending the system into heavy swapping, the server will effectively grind to a halt. Start tuning by figuring out how much RAM you have available to Apache after system processes and things like your Postgres (and MySQL?) server are accounted for, divide by the the RES size, and set MaxChildren to that in httpd.conf. Also, the process size of named is fairly astonishing: PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 28752 root 5 96 0 427M 408M select 1 1:55 0.00% named 9720 nobody 19 97 0 402M 186M RUN 1 0:00 0.69% nsd ...even if you are running the process in 64-bit mode. This can be brought under control by tuning recursive-clients and max-cache-size options. Also, is nsd process from ports/dns/nsd-- ie, another nameserver? Your machine is being overloaded by running too much stuff that's duplicating functionality; it's just not a good idea to try to run different types of databases on the same machine; they'll fight with the VM system and each other, making your VM system trash.... -- -Chuck