|
|
Posted by Big Bill on 08/08/06 17:05
On 8 Aug 2006 07:16:01 -0700, softwarelabus@yahoo.com wrote:
>Hi,
>
>I wanted to warn all website owners that some evil web hosts like
>vistapages will periodically place a robots.txt file on your site that
>disallows all search engines. It happened to me.
>
>Over the last several months I've noticed my web traffic dropped to
>nearly zero. A few days ago I noticed a new file, robots.txt. As most
>of you know, if your site has a robots.txt in your websites home
>directory then all search engines will look at it for possible
>instructions. The robots.txt file tells search engines what to do or
>what not to do. In my case, it had simple instructions to disallow all
>user-agents; i.e., telling all sites they cannot come here.
>
>How to check:
>If you web site is called www.mywebsite.com then you want to check the
>following web page:
>www.mywebsite.com/robots.txt
>
>You should also look for this file when you ftp to your site in case
>your web host places a sneaky server script to make robots.txt
>invisible only to you.
>
>Paul
I guess your web hosts don't like you, do they? Did you ask them about
this?
BB
--
http://www.here-be-posters.co.uk/marilyn-monroe-pictures.htm
http://www.kruse.co.uk/seo-maintenance.htm
http://www.crystal-liaison.com/artis-orbis/amici-della-luna-glass.html
Navigation:
[Reply to this message]
|