Date: Sun, 14 Jun 2009 18:19:53 -0400 From: Ken Smith <kensmith@cse.Buffalo.EDU> To: Adam McDougall <mcdouga9@egr.msu.edu> Cc: freebsd-hubs <freebsd-hubs@freebsd.org> Subject: Re: TLD cvsup mirrors Message-ID: <1245017993.12125.62.camel@neo.cse.buffalo.edu> In-Reply-To: <4A355903.3040408@egr.msu.edu> References: <1244913371.55746.12.camel@neo.cse.buffalo.edu> <4A355903.3040408@egr.msu.edu>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-o5bgFLwr3fQ1aMHe40IS
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable
On Sun, 2009-06-14 at 16:09 -0400, Adam McDougall wrote:
> I'd be happy to take on more cvsupd clients if you want, lately I've=20
> been getting around 550 working clients per day and it feels like=20
> nothing (cvsup15.freebsd.org). I have 20G of ram in the system and=20
> lately a lot of the cvsup data seems to get cached. Plenty of CPU to go=20
> around too.
Thanks. If I don't get enough offers I might take you up on that but at
least for now the goal is to get back to having each of the
cvsup*.freebsd.org entries being unique machines. The higher numbered
machines do seem to wind up with less traffic, one of mine is cvsup18
and it only sees around 200/day.
> What would you recommend for kern.maxvnodes? Thanks
That depends on how much physical memory the machine has and what else
it's doing. For my machines, which are just mirror systems, I have:
Dual Opteron 2.3GHz, 4GB RAM:
kern.maxvnodes =3D 250000
maximum cvsupd clients =3D 40
Quad Xeon 2.4GHZ, 8GB RAM:
kern.maxvnodes =3D 350000
maximum cvsupd clients =3D 40
Dual Xeon 1.7GHz, 2GB RAM:
kern.maxvnodes =3D 150000
maximum cvsupd clients =3D 20
The second one is ftp-archive.freebsd.org as well as being a cvsupd
server.
With 20GB RAM if the machine isn't doing much else you could probably
crank maxvnodes up to over the number of files in the repository itself
(looks to be a little over 570000 files in it at the moment).
The other performance tweak that helps a *lot* is to make sure you mount
the partition the repository is in using noatime.
The first machine listed above handles around 3000 connects per day
comfortably with that configuration. It's the one I let accumulate a
few too many of the TLD names though (three at the moment), those are
some of what I'm trying to find a new home for. :-)
I only have the second machine doing significant-ish cvsupd stuff when I
need it to take over for site(s) that died while I look to find a new
site to take it over. If a cvsupd server has been down for a while it
can wind up getting *slammed* when it comes back to life. I took over
for one that had been down for quite a while on Friday and it wound up
handling over 7,000 requests the first day. So... I usually try to take
over on one of my machines first to get through that and then get an
idea of what the normal daily traffic is so I can tell the new site what
they're in for...
--=20
Ken Smith
- From there to here, from here to | kensmith@cse.buffalo.edu
there, funny things are everywhere. |
- Theodore Geisel |
--=-o5bgFLwr3fQ1aMHe40IS
Content-Type: application/pgp-signature; name=signature.asc
Content-Description: This is a digitally signed message part
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.9 (FreeBSD)
iEYEABECAAYFAko1d4kACgkQ/G14VSmup/ZqBwCgjC6/a0xNV/3rlDZbC4ICrFtN
EDIAn21EpvSKR68Dnah62zQV0dcCMXpn
=23oo
-----END PGP SIGNATURE-----
--=-o5bgFLwr3fQ1aMHe40IS--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1245017993.12125.62.camel>