Posted by Kevin Wells on 12/18/63 11:51

In message <1151495324.852580.282450@75g2000cwc.googlegroups.com>
StevePBurgess@gmail.com wrote:

>Hi. I have a book affiliate website. Whenever a visitor clicks on one
>of the books, a script adds one to a field in a mysql database and then
>takes the visitor to the shopping basket on the book website.
>
>I have noticed that the book links are getting lots of hit. At first, I
>was pleased about the potential income this might mean - but then it
>occurred to me that many of these hits are web crawlers (this was
>confirmed by webaliser).
>
>Any suggestions of ways of checking if the link is being "clicked" by a
>webcrawler so that I can not increment the field in the sql database?
>
>I've checked HTTP_REFERER but it seems to be empty for what I assume
>are crawled clicks.
>
>Cheers
>
>Steve
>

Under user agent they appear to identify themselves as either:

bot
crawler
spider
slurp
crawling

--
Kev Wells http://kevsoft.topcities.com
http://kevsoft.co.uk/
ICQ 238580561
Useless Fact 04 The number of islands around mainland Britain is 6289.

[Back to original message]