|
Posted by John Hosking on 10/07/06 03:44
Jonathan N. Little wrote:
> Put eBay auction files in a folder and use a robot.txt file to indicate
> that that folder is not to be indexed. Google "robot.txt" for syntax...
That would be robots.txt, with an "s". When you've googled, be sure to
read the part about robots.txt not working with misbehaving spiders.
--
John
[Back to original message]
|