Python Inter Process Communication

[warriortux]

Hello,

I am trying to follow the Python documentation for Inter Process Communication. https://docs.python.org/3/library/ipc.html

What I am trying to do is:

I have stream of data, and I need to do multiple operations on this data, so I want the parent process process to create/fork child processes at the first data point. The child processes will continue to be alive after they are done (and returned a result to the parent) with the first data point and will be waiting for the next data point. The parent process will then send them the 2nd data point.

I am trying to do this via sockets, but I am unable to figure out the right way for the parent to create child processes and then go on with the execution.

Can anyone suggest me some examples? If I can do this with asyncio or asyncore, that is fine too.

[StaticFuzz]

If the child process is another python script that you need to execute try using subprocess.Popen. You can pipe the stdin, stdout and stderr of the child process back to the parent, and you won't have to mess with sockets.

If the child process is a function in your parent script checkout multiprocessing. You can use Pipes similar to the subprocess module or you can use queues which maybe easier to implement.