Posted by jokla on 08/27/06 10:29
Paul wrote:
> I am tearing my hear out. It apears my website is under atack from
> these search engins. I have heard that I can place code in my header
> som where to stop this. Any help/
>
> the browser information that I have collected show up the following
>
> Mozilla/5.0 (compatible; Yahoo! Slurp;
> http://help.yahoo.com/help/us/ysearch/slurp)
>
> Mozilla/5.0 (compatible; Googlebot/2.1;
> +http://www.google.com/bot.html)
>
> Please help.
>
> Desmond.
Layst week Yahoo and MSN came to one of my sites a dozen times a day
and Google did this yesterday . . . looks like they're catching up with
the crawling
Navigation:
[Reply to this message]
|