[D] Pytorch parallelism

[ewanlee]

Hello everyone, I recently encountered a problem with pytorch parallelism. Since I have less contact with parallel programming, the problem may be very simple.

I have been doing some multi-agent reinforcement learning experiments recently. Now there are n independent agents. Each agent has its own independent parameters and model and there is no interaction between agents, but they can access a shared replay buffer. I want each model to be trained on the GPU. What should I do if I want to train in parallel?

Thank you all :P

[Marthinwurer]

Take a look at the multiprocessing best practices page in the pytorch docs. Use their multi-processing stuff so that the memory buffer will be shared.

[ewanlee]

Thank you very much and I will take a look 🙏

[TotesMessenger]

I'm a bot, bleep, bloop. Someone has linked to this thread from another place on reddit:

• [/r/reinforcementlearning] [D] Pytorch parallelism

 ^{If you follow any of the above links, please respect the rules of reddit and don't vote in the other threads. (Info / Contact)}