Posted by Safalra on 08/08/06 14:25

On 8 Aug 2006 07:16:01 -0700, softwarelabus@yahoo.com wrote:
> [snip hosts adding robots.txt file]
> You should also look for this file when you ftp to your site in case
> your web host places a sneaky server script to make robots.txt
> invisible only to you.

They could of course hide the file on the server (as mosts hosts do with
server configuration files) - and much more reliably than doing so for HTTP
requests.

--
Safalra (Stephen Morley)
http://www.safalra.com/hypertext/

[Back to original message]