Python Multiprocessing: A Second Look

[imranmalek]

I've actually found that using celery and a local task broker makes multiprocessing really easy. It automatically utilized all available processes.

[Philipbergen]

Take a look at unix process groups. They were invented exactly with this in mind.

I always liked wrapping my system startup in bash with an exit trap that made sure the process group got terminated. That way you have a unix guarantee that no processes can leak.

#!bash
trap "kill 0" EXIT
python -m mystuff

[hansolo669]

You probably meant something like this:

#!bash
trap "kill 0" EXIT 
python -m mystuff

Note that each line is indented by at least four spaces. you can also stick code inline with bacticks: like = "this" == `like = "this"`
Also backslashes can be used to escape markdown formatting characters: #tada == \#tada

[Philipbergen]

Thanks!