From owner-freebsd-questions@FreeBSD.ORG  Fri Jun 30 12:00:47 2006
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
X-Original-To: questions@freebsd.org
Delivered-To: freebsd-questions@FreeBSD.ORG
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 0BF2416A5A3
	for <questions@freebsd.org>; Fri, 30 Jun 2006 12:00:47 +0000 (UTC)
	(envelope-from xfb52@dial.pipex.com)
Received: from smtp-out2.blueyonder.co.uk (smtp-out2.blueyonder.co.uk
	[195.188.213.5])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 390C14438E
	for <questions@freebsd.org>; Fri, 30 Jun 2006 11:34:10 +0000 (GMT)
	(envelope-from xfb52@dial.pipex.com)
Received: from [172.23.170.141] (helo=anti-virus02-08)
	by smtp-out2.blueyonder.co.uk with smtp (Exim 4.52)
	id 1FwHGB-00016b-Ar; Fri, 30 Jun 2006 12:34:07 +0100
Received: from [82.41.34.175] (helo=[192.168.0.2])
	by asmtp-out5.blueyonder.co.uk with esmtp (Exim 4.52)
	id 1FwHGA-0000a9-1N; Fri, 30 Jun 2006 12:34:06 +0100
Message-ID: <44A50C2E.7080500@dial.pipex.com>
Date: Fri, 30 Jun 2006 12:34:06 +0100
From: Alex Zbyslaw <xfb52@dial.pipex.com>
User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-GB; rv:1.7.13) Gecko/20060515
X-Accept-Language: en
MIME-Version: 1.0
To: Olivier Nicole <on@cs.ait.ac.th>
References: <200606300808.k5U88c42075685@banyan.cs.ait.ac.th>
In-Reply-To: <200606300808.k5U88c42075685@banyan.cs.ait.ac.th>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: questions@freebsd.org
Subject: Re: Slow server
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
	<mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 30 Jun 2006 12:00:47 -0000

Olivier Nicole wrote:

>2) as there are many connections comming from search engines siders
>   (90% of all the established connections), I'd like to limit the
>   ressources that spiders are using. One way would be through IPFW,
>   but are there better ways? Is there a way to limit/prioritize in
>   Apache (not that I know any).
>  
>
google robots.txt which ought to limit what the spiders look at (but 
consequently reduces what they index, as well).

Overall, though, your problem sounds more like a piece of software 
bloating as it runs; the longer it runs the more memory it consumes.

Does the machine end up swapping?  Try tracking memory usage.

--Alex