Posted by ctclibby on 07/01/06 10:00

StevePBurgess@gmail.com wrote:
> Hi thanks - but I don't want to prevent the search engines from
> crawling my site - I just want a (relatively) accurate figure on how
> many clicks through to the book site I've had.

Robots.txt has a bunch of configurable options. You can tell the bots
NOT to index the 'login' portion of your site, and allow the rest of
it.

todh

[Back to original message]