|
Posted by Newsgroups on 10/08/07 18:10
> That's where it gets tricky. =) But consider this -- if you obey
> robots.txt 100% from the start, you'll always be doing the right thing
> no matter how many people use your aggregator.
I agree ; but, If I obeyrobots.txt, my aggregator won't aggregate lots
of RSS. Who want to use an aggregator which do not aggregate :-)
For information : There is currently about 70 users that use my
aggregator... It's difficult for me to recruite :-) But i really wants
to be 100% conform with rules and standards...
Thanks for your help and opinion.
Navigation:
[Reply to this message]
|