Date: Thu, 17 Apr 2003 19:21:13 -0400 From: Bill Moran <wmoran@potentialtech.com> To: Ashley Gillard <ashleyg@google.com> Cc: freebsd-questions@FreeBSD.ORG Subject: Re: Free BSD in Googles's Index Message-ID: <3E9F36E9.3080506@potentialtech.com> In-Reply-To: <000701c30532$0ea7fda0$6510200a@corp.google.com> References: <000701c30532$0ea7fda0$6510200a@corp.google.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Ashley Gillard wrote: > Dear Free BSD Representative: > > Our crawl team has discovered that Google is currently blocked from > crawling your site by the robot.txt that is on your site. We would like > to index your site at http://bento.freebsd.org to provide you better > coverage and are interested in working with you to do this. > > Google's mission is to deliver the best search experience on the > Internet by making the world's information universally accessible and > useful. To find out more about Google.com visit: > http://www.google.com/webmasters/. > > I look forward to hearing from you. First off, bento is a ports build cluster and it's probably impractical to have google index it, as the information probably changes before it can even reach your index. If you still think it would be practical to alter the robots.txt file, it's probably best to contact Satoshi Asami (asami@freebsd.org) as he appears to maintain that site. -- Bill Moran Potential Technologies http://www.potentialtech.com
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3E9F36E9.3080506>