Posted by Rik on 08/17/06 22:18

Shuan wrote:
>> It's okay if you're doing a job that really needs a long time to
>> execute, such us retriving a 50 MB file from the Internet, spidering
>> a web site or synchronising two databases.
>>
>> Is that the case?
>
> i don't have to get a big file but i need to crawl the whole
> websites( about 1000 pages )
> and that takes time;

Well yeah, about a 1000 pages will almost certainly need more execution time,
forget what I said about the regex. As the preg_match_all is likely the most
time consuming part of your script (be it relativelyy fast), chances are quite
high that in it's nth execution the limit is passed.

DO you know how many pages you do parse in those 60 second BTW?

Grtz,
--
Rik Wasmus

[Back to original message]