Posted by Cinamon Thunder on 02/20/07 08:56

Google and other engines spider my website every single day and as
result generates QUITE A BIT of traffic.

I've tried:

<META NAME="revisit-after" CONTENT="7 days">

--but the engines still visit daily.

I dont want to use:

<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">

--as it will prevent spidering all together unless I remove the tag
every week or so for a few days?

I'm not sure about robot.txt as I want the entire site indexed (just not
every single day) and no pages excluded.

Any advice would be appreciated!

Thx
C

[Back to original message]