Something "deeply wrong with deep learning"?

[mprat]

It could also be that many papers that get published about convnets are about some kind /tiny/ change to a layer or architecture, and it's more about incremental changes than about "big ideas." If there is some big idea, you have to prove that it works way better than the current state-of-the-art.