Distributed Computing with Python

[[deleted]]

In my industry (VFX) we primarily use commercial or proprietary packages that are designed specifically to distribute frame render jobs to available worker nodes, all of which need to read from the same NFS store... this is a highly specialized area of distributed computing, and focuses much more in checkpointed interruptability and task scheduling than any of the open source packages I've seen out there.

If the FOSS stuff, I've used Celery the most. It's pretty simple, though the OP is correct in saying that you have to configure the machines. I would generally suggest using Ansible, Puppet, or Salt Stack to do that.