Posted by cmashieldscapting on 02/07/06 21:34

Phil Earnhardt wrote:

> I can't imagine how you would categorically block them. OTOH, the
> Robots Exclusion Protocol can be used to tell anyone who honors such
> things that you don't want your website copied.
>
> --phil

Try doing a search using key topic words on Usenet, or at least Google
Groups, the Google version of Usenet. I'm pretty sure I saw a couple
of discussions regarding this.

Cori

[Back to original message]