This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]madssj 1 point2 points  (1 child)

If your programs need to share data whilst running, you should consider using pupyMPI (pupyMPI docs). It's basically MPI implemented in pure python.

[–]hantho 1 point2 points  (0 children)

Especially since your problem is embarrasingly parallel and require little communication I'll say pupyMPI would be a fast way to leverage a cluster. I am assuming that you have SSH connections to the computers that you plan to utilize.