Posted by Steve Pugh on 02/20/07 21:32

On Feb 20, 9:20 pm, kobus...@gmail.com wrote:
> Here are spider bandwidth stats for the 19th
>
> Googlebot (Google) 262.93 MB 19 Feb 2007 - 23:54
> Inktomi Slurp 74.83 MB 19 Feb 2007 - 23:58
> MSNBot 270.99 MB 19 Feb 2007 -
> 23:34
> Unknown robot (identified by 'robot') 597.13 KB 19 Feb 2007 - 05:23
>
> Thats 1.2+ Gig for the day?

There's a mistake there. Either you typed 597.13 Kb when you meant
597.13 Mb or you read it the other way round,

> Yet when I look at my overall summary for the 19th:
>
> Day Number of visits Pages Hits Bandwidth
> 19 Feb 2007 287 24266 45669 181.29 MB
>
> I smell a rat...

Depends on which flavour of smoke and mirrors your stats use.

Now as you full quoted and top posted you probably didn't read Jukka's
reply carefully, so I'll just draw you attention to this part:

> On Feb 20, 4:25 pm, "Jukka K. Korpela" <jkorp...@cs.tut.fi> wrote:
> > (I'm assuming that your server sends adequate Last-Modified headers so that
> > spiders can just send a HEAD request and see that nothing has changed,
> > instead of retrieving the actual content.)

Steve

[Back to original message]