Date: Tue, 19 Oct 2004 12:04:12 -0500 From: Will Andrews <will@csociety.org> To: Ken Smith <kensmith@cse.Buffalo.EDU> Cc: freebsd-hubs@freebsd.org Subject: Re: Just curious - cvsup mirror connect rate? Message-ID: <20041019170412.GV42886@hex.databits.net> In-Reply-To: <20041018203143.GB23076@electra.cse.Buffalo.EDU> References: <20041018203143.GB23076@electra.cse.Buffalo.EDU>
next in thread | previous in thread | raw e-mail | index | archive | help
--rG09A39trvEtf3rB Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 18, 2004 at 04:31:43PM -0400, Ken Smith wrote: > I'm just curious what people typically see for connect rates to the > main cvsup mirrors. >=20 > I've got one server here that's desperately in need of more memory > but it typically services around 2500 connections a day. Another > cvsup server I've got access to at another site services roughly > the same number per day. >=20 > The reason I'm asking is I'm cleaning up some servers that vaporized > on us. I've started to take over a dead server's name on a large > server here for at least a day before I turn it over to a new volunteer > site because of the inevitable slamming that happens when a new server > takes over for one that had been down for a while. I've done this > a couple times now and despite the initial load once things settle > down a bit I've been seeing the same typical number - on average > around 2500 connects a day. >=20 > Until now... I just took over cvsup5 for a bit because it had been > down. In less than 6 hours it's serviced about 11,000 connects. And > I'm not seeing tons of "Tree comp failure..." messages, the huge majority > are reporting success. It's been pegged at the 30 connect limit ever > since I made the DNS change almost 6 hours ago... >=20 > So, just kind of wondering what people normally see as average traffic > for a day. If cvsupd has been running all the time your machine has > been up simply taking the current connect number it's allocating and > dividing by the number of days it's been up is close enough. :-) > I'm kind of wondering if the number of hits you get is a function > of what cvsupN number you get - when people first set themselves > up they start at cvsup1 and go up until they find one that doesn't > say its full and then set up their cron job to use that one... :-) I think the imbalance is because people (falsely) rely on a program called "fastest_cvsup" to choose the mirror to use. This program only measures network performance of the cvsup mirrors in question & thus leads them to use a mirror that is not necessarily their best choice. The fact is that the network performance means little when it comes to cvsup, especially for updates. CPU, RAM, disk I/O of the server mean a lot more. This particularly affects cvsup12 since its outbound link is frequently saturated. The statistics are, for this month: will@sanmateo% for i in `jot -w '%02d' 18 1`;do echo -n "2004/10/${i}: ";gr= ep ^2004.10.${i} cvsupd.log | grep ": +"|wc -l;done 2004/10/01: 1255 2004/10/02: 1218 2004/10/03: 1152 2004/10/04: 1305 2004/10/05: 1349 2004/10/06: 1250 2004/10/07: 1314 2004/10/08: 1253 2004/10/09: 1252 2004/10/10: 1188 2004/10/11: 1212 2004/10/12: 866 2004/10/13: 1265 2004/10/14: 1246 2004/10/15: 1288 2004/10/16: 1267 2004/10/17: 1225 2004/10/18: 1324 At last count, this server had served 159,208 connections since it was last restarted July 13th & rarely sees load avgs above 2.0 & almost never above 10.0. On a particularly good day, it serves 1500-1600 clients. Regards, --=20 wca --rG09A39trvEtf3rB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.6 (FreeBSD) iD8DBQFBdUkLF47idPgWcsURAvLAAJ9hkMcV4bUs/65YupQ22imtFdrUUwCcD1ee BgQYJelG2UTPO6ls7lRqvDQ= =wYi7 -----END PGP SIGNATURE----- --rG09A39trvEtf3rB--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20041019170412.GV42886>