Posted by Andy Hassall on 09/29/07 14:49

On Sat, 29 Sep 2007 03:12:19 -0700, qwertycat@googlemail.com wrote:

>I'm new to multi-process programming, should one avoid forking
>children from children of a parent?
>
>I'd like to spawn 10 children from the parent and each of those
>children spawns another 5 children which process chunks of data (200
>rows) with heavy usage of CPU and regexp

So you're spawning 500 processes? Do you have a very large number of CPUs to
run them on? Otherwise only a few will actually be running at any time, and
you'll be losing useful throughput to overhead, surely.

--
Andy Hassall :: andy@andyh.co.uk :: http://www.andyh.co.uk
http://www.andyhsoftware.co.uk/space :: disk and FTP usage analysis tool

[Back to original message]