|
Posted by Cinamon Thunder on 02/20/07 08:56
Google and other engines spider my website every single day and as
result generates QUITE A BIT of traffic.
I've tried:
<META NAME="revisit-after" CONTENT="7 days">
--but the engines still visit daily.
I dont want to use:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">
--as it will prevent spidering all together unless I remove the tag
every week or so for a few days?
I'm not sure about robot.txt as I want the entire site indexed (just not
every single day) and no pages excluded.
Any advice would be appreciated!
Thx
C
Navigation:
[Reply to this message]
|