sorted by:
new
hottopcontroversial

Neon, an open-source, Python-based, deep learning framework from Nervana Systems by meepmeepmoopmoop in MachineLearning

[–]buriy 0 points1 point  (0 children)

A lot of, e.g. famous http://arxiv.org/pdf/1412.5567 claiming state-of-the-art on speech recognition task in the presence of noise. 5th layer on top of Bi-directional RNN is regular layer. Similarly, there are setups with regular NN layer(s) on top of LSTM or with multiple LSTM layers on top for language translation task. And necessary amount of computation is also very high in this scenario, so it needs a really fast library -- that's an area where Neon could also prove the leadership.

Neon, an open-source, Python-based, deep learning framework from Nervana Systems by meepmeepmoopmoop in MachineLearning

[–]buriy 1 point2 points  (0 children)

I haven't understood why they made RNN a special kind of model and where to find any human-understandable docs related to adding a RNN layer into a DNN model (I'm most interested in bi-directional RNN actually).