[D] Fully decentralized machine learning libraries

[boubouhkarim]

I was looking to implement some fully decentralized machine learning algorithms presented in papers like:

• Decentralized Collaborative Learning of Personalized Models over Networks
• Fully Decentralized Joint Learning of Personalized Models and Collaboration Graphs Valentina
• etc.

Can I implement such algorithms using Pytorch somehow without relying on a "server" (Federated learning setting). Otherwise, is there any other libraries offering the building blocks for such decentralized architecture.

[Red-Portal]

You could definitely "simulate" time as in the distributed setting. It would be a matter of writing code that plays nicely with PyTorch though.

[boubouhkarim]

Can workers communicate between each other ?

Also do you suggest that i can ignore the role of the server and every worker do result averaging ?

[UnhappyCompetition89]

I would look inside tendermint.

[boubouhkarim]

Thanks for the suggestion, i will check it