|
|
Posted by Paul on 12/08/97 11:56
I have a hitcounter that logs how many visitors I get. Over the last
month this counter has gone through the roof. It know apears that it is
Robots. My website does not have any meta tags like keywords
description. So they should not be going there. I think someone has
nominated me to them, but I would not know. The database records
clearly indicate a date. I can re-adjust the counter because I have
database records. but I don't want robots increasing my counter.
Desmond.
Nikita the Spider wrote:
> In article <1156325769.264557.183990@m73g2000cwd.googlegroups.com>,
> "Paul" <desotuatail@aol.com> wrote:
>
> > I am tearing my hear out. It apears my website is under atack from
> > these search engins. I have heard that I can place code in my header
> > som where to stop this. Any help/
> >
> > the browser information that I have collected show up the following
> >
> > Mozilla/5.0 (compatible; Yahoo! Slurp;
> > http://help.yahoo.com/help/us/ysearch/slurp)
> >
> > Mozilla/5.0 (compatible; Googlebot/2.1;
> > +http://www.google.com/bot.html)
>
>
> Desmond,
> Ken has already given you good practical advice to which I have nothing
> to add. But I'm wondering what you mean by saying your Web site is
> "under attack". Yahoo! Slurp and Googlebot try to be reasonably polite
> when spidering a site.
>
> --
> Philip
> http://NikitaTheSpider.com/
> Whole-site HTML validation, link checking and more
Navigation:
[Reply to this message]
|