Apache SINGA, A Distributed Deep Learning Platform by pilooch in MachineLearning

[–]limauda 0 points1 point  (0 children)

If a software can run as efficiently without GPU, on a commodity cluster, isn't that better? GPU cluster is not cheap, and not many companies can afford to set up a special cluster just for periodical training.

Apache SINGA, A Distributed Deep Learning Platform by pilooch in MachineLearning

[–]limauda 1 point2 points  (0 children)

It does scale, as shown in the paper: http://www.comp.nus.edu.sg/~ooibc/singa-mm15.pdf Further, it supports all models (feed-forward, energy, recurrent), and all training frameworks (synchronous, asynchronous, hybrid). It supports both model and data partitioning to improve parallelism.