|
|
Posted by MD on 08/22/06 21:48
How about putting sleep() when visiting each page ?
Is this going to reduce the risk of stopping the server?
MD
"Jerry Stuckle" <jstucklex@attglobal.net> wrote in message
news:oOqdnZPgTIp_fnfZnZ2dnUVZ_u-dnZ2d@comcast.com...
> mich dobelman wrote:
> > I am developing a web crawler which collects info from more than 50,0000
> > pages.
> > but i am afraid this is going to clog the rental web server if I run it
> > every single day.
> >
> > Is it possible to stop the web hosting server because of my program?
> >
> > MD
> >
> >
> >
> >
>
> Of course you can. Anyone on the server can, with a poorly written
> script. For instance,
>
> <?php
> for ($i = 0; $i < 10; $i--) {
> // Do something here not requiring I/O
> }
>
> Will tie up the server for a while (I know from experience :-) ).
>
> Because of this, most shared hosts keep the max execution time of PHP
> scripts rather short, like 30 seconds. That way a single script can't
> screw things up for too long.
>
>
> --
> ==================
> Remove the "x" from my email address
> Jerry Stuckle
> JDS Computer Training Corp.
> jstucklex@attglobal.net
> ==================
Navigation:
[Reply to this message]
|