Date: Wed, 04 Jan 2006 15:22:14 -0500 From: Gerard <gerard@seibercom.net> To: freebsd-questions@freebsd.org Subject: Re: [dadadev] atom and the privacy, multiple fields and foreign languages. Message-ID: <20060104152015.069D.GERARD@seibercom.net> In-Reply-To: <20060104130009.99277184@skazat.com> References: <20060103192001.86962800@skazat.com> <20060104130009.99277184@skazat.com>
next in thread | previous in thread | raw e-mail | index | archive | help
"Alfred Vink" <alfred@alfsoft.com> > Michael: > > 4. If I use the archiving of my discussion list the e-mail addresses are > displayed doing a Google search with the keywords of the name of the person. > > Add a robots.txt file to the root of your site and in this textfile type: > > User-agent: * > Disallow: /cgi-bin/ > > Now your problem is gone, there are a multiple of things you can set in the > robots.txt file to have control over how searchengines scan your site. > > Alfred You might want ot check out this URL for further information. http://www.seoconsultants.com/robots-text-file/ If you create a custom DADA directory under your home directory, those files would never have been indexed anyway. You should really consider that option. -- Gerard Seibert gerard@seibercom.net
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20060104152015.069D.GERARD>