|
|
Posted by mbstevens on 10/22/53 11:22
Jedi Fans wrote:
> hyweljenkins@hotmail.com wrote:
>
>>> I'm very familiar with the OP's
>>> problem, and I've solved it that way.
>>
>>
>> Explain it then. I bet it doesn't work as well as you think; certainly
>> not anywhere near 90% effective. Robots don't ahve to honour the
>> robots meta tag that you suggest, so why would they? After all,
>> spammers are generally somewhat unscrupulous.
>>
> edit the robots.txt file...
Robots don't have to obey that, either. It serves as a command only for
law abiding robots.
Navigation:
[Reply to this message]
|