Date: 04 Sep 2002 16:07:43 -0400 From: Lowell Gilbert <freebsd-questions-local@be-well.no-ip.com> To: freebsd-questions@freebsd.org Subject: Re: Macros in ipfw rules Message-ID: <447ki1frhs.fsf@be-well.ilk.org> In-Reply-To: <20020904144515.GC91519@catflap.home.slightlystrange.org> References: <20020903142632.GA71601@catflap.home.slightlystrange.org> <443cspq4ll.fsf@be-well.ilk.org> <20020904133053.GA91519@catflap.home.slightlystrange.org> <20020904133511.GD20573@pcwin002.win.tue.nl> <20020904144515.GC91519@catflap.home.slightlystrange.org>
next in thread | previous in thread | raw e-mail | index | archive | help
> > If that's all you want: > > > > http://www.robotstxt.org/wc/robots.html > > > > No need for firewall rules for that kind of thing. > > Aha! Exactly what I needed! Thanks a lot for that, Stijn. Note, however, that robots only pay attention to it if they want to. Legitimate search engines will pay attention, but spammers' "spiders" often won't. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?447ki1frhs.fsf>