Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 30 Jun 2006 12:34:06 +0100
From:      Alex Zbyslaw <xfb52@dial.pipex.com>
To:        Olivier Nicole <on@cs.ait.ac.th>
Cc:        questions@freebsd.org
Subject:   Re: Slow server
Message-ID:  <44A50C2E.7080500@dial.pipex.com>
In-Reply-To: <200606300808.k5U88c42075685@banyan.cs.ait.ac.th>
References:  <200606300808.k5U88c42075685@banyan.cs.ait.ac.th>

next in thread | previous in thread | raw e-mail | index | archive | help
Olivier Nicole wrote:

>2) as there are many connections comming from search engines siders
>   (90% of all the established connections), I'd like to limit the
>   ressources that spiders are using. One way would be through IPFW,
>   but are there better ways? Is there a way to limit/prioritize in
>   Apache (not that I know any).
>  
>
google robots.txt which ought to limit what the spiders look at (but 
consequently reduces what they index, as well).

Overall, though, your problem sounds more like a piece of software 
bloating as it runs; the longer it runs the more memory it consumes.

Does the machine end up swapping?  Try tracking memory usage.

--Alex







Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?44A50C2E.7080500>