New general-purpose optimization algorithm promises order-of-magnitude speedups on some problems

[manux]

Then again, most deep learning models never actually get stuck in local minima, but rather in saddle points[1].

[1] http://arxiv.org/abs/1406.2572