|
Posted by ctclibby on 07/01/06 10:00
StevePBurgess@gmail.com wrote:
> Hi thanks - but I don't want to prevent the search engines from
> crawling my site - I just want a (relatively) accurate figure on how
> many clicks through to the book site I've had.
Robots.txt has a bunch of configurable options. You can tell the bots
NOT to index the 'login' portion of your site, and allow the rest of
it.
todh
Navigation:
[Reply to this message]
|