Date: Tue, 09 May 2006 23:02:33 +0200 From: Pav Lucistnik <pav@FreeBSD.org> To: Murray Stokely <murray@FreeBSD.org> Cc: www@FreeBSD.org Subject: Re: website statistics Message-ID: <1147208553.49070.4.camel@ikaros.oook.cz> In-Reply-To: <20060509181115.GZ83847@freebsdmall.com> References: <1147173626.68599.49.camel@pav.hide.vol.cz> <20060509181115.GZ83847@freebsdmall.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--=-+5uTs9yE/7KCbUSYIU1y
Content-Type: text/plain; charset=ISO-8859-2
Content-Transfer-Encoding: quoted-printable
Murray Stokely p=ED=B9e v =FAt 09. 05. 2006 v 11:11 -0700:
> > SEARCHBOTS
> >=20
> > On top of the numbers above, search engine crawlers generated another
> > 43,778 hits/day. Googlebot alone is responsible for 7875 hits/day.
>=20
> Google claims to have 1,680,000 documents from www.freebsd.org indexed
> (+site:www.freebsd.org query), and 3 times as much if you count
> people.freebsd.org and the various ftpN and other domains. If that is
> anywhere near correct, then 7875 hits / day means the average page is
> only refreshed every 213 days. I hope it crawls faster than 7875 hits
> / day on other days. Does Apache log a page hit if it was not
> returned because of an If-Modified-Since header?
Yes, that's counted as a page view. Google is known to record the
frequency with which the page is updated, and crawl often updated pages
more often. Also, I would imagine, it would crawl homepage daily, just
for the sake of having a fresh one in cache.
Someone is reading us in Google, now it gives 2,040,000 documents on
that site. Honestly, that figure feels overshot by a lot. Can't imagine
2 million distinct pages here.
--=20
Pav Lucistnik <pav@oook.cz>
<pav@FreeBSD.org>
Any sufficiently advanced technology is indistinguishable from magic.
-- Arthur C. Clarke
--=-+5uTs9yE/7KCbUSYIU1y
Content-Type: application/pgp-signature; name=signature.asc
Content-Description: Toto je =?iso-8859-2?Q?digit=E1ln=EC?=
=?ISO-8859-1?Q?_podepsan=E1?= =?iso-8859-2?Q?_=E8=E1st?=
=?ISO-8859-1?Q?_zpr=E1vy?=
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.3 (FreeBSD)
iD8DBQBEYQNpntdYP8FOsoIRAv0TAJ4jj7gEXvPuBbPqt9tRLXkygQwpIwCffCjj
N7Ssu3wsrFfiqI4Ebxxgr4w=
=WyK+
-----END PGP SIGNATURE-----
--=-+5uTs9yE/7KCbUSYIU1y--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1147208553.49070.4.camel>