You are here: Re: googlebot indexes links it finds in newsgroups - just for your info « HTML « IT news, forums, messages
Re: googlebot indexes links it finds in newsgroups - just for your info

Posted by mrcakey on 09/24/07 11:00

"CW Northrop" <cwnorthrop@gmail.com> wrote in message
news:Xns99B520ACF5B60cwnorthrop@216.196.109.145...
> On 24 Sep 2007 in alt.html, Joe Butler said:
>
>> You probably know this already, but 8 hours after publishing a testing
>> area link in this newsgroup, googlebot goes straight for it - it
>> checked robots.txt first, which I hadn't set up to exclude this
>> folder.
>>
>>
>>
>>
>
> Yes it seems to spring like a panther on new domain names too, the
> strange and unpredictable beast.
>

LOL

+mrcakey

 

Navigation:

[Reply to this message]


Удаленная работа для программистов  •  Как заработать на Google AdSense  •  England, UK  •  статьи на английском  •  PHP MySQL CMS Apache Oscommerce  •  Online Business Knowledge Base  •  DVD MP3 AVI MP4 players codecs conversion help
Home  •  Search  •  Site Map  •  Set as Homepage  •  Add to Favourites

Copyright © 2005-2006 Powered by Custom PHP Programming

Сайт изготовлен в Студии Валентина Петручека
изготовление и поддержка веб-сайтов, разработка программного обеспечения, поисковая оптимизация