Posted by mbstevens on 11/11/53 11:22

Jedi Fans wrote:
> hyweljenkins@hotmail.com wrote:
>
>>> I'm very familiar with the OP's
>>> problem, and I've solved it that way.
>>
>>
>> Explain it then. I bet it doesn't work as well as you think; certainly
>> not anywhere near 90% effective. Robots don't ahve to honour the
>> robots meta tag that you suggest, so why would they? After all,
>> spammers are generally somewhat unscrupulous.
>>
> edit the robots.txt file...

Robots don't have to obey that, either. It serves as a command only for
law abiding robots.

[Back to original message]