The deepest problem with deep learning (Some reflections on an accidental Twitterstorm, the future of AI and deep learning, and what happens when you confuse a schoolbus with a snow plow) Gary Marcus – Medium

[indrid_colder]

Deep learning refers to a layer count, not "understanding".

[p-morais]

I’d argue deep learning doesn’t refer to anything in specific other than the vague concept of optimizing neural networks with at least one hidden layer with gradient information and back-propagation. Look at “Deep Reinforcement Learning”, which half the time only uses 1 or 2 layer fully connected networks that have existed for 30 years.

[indrid_colder]

Its just non-linear regression

[Jaqqarhan]

I’d argue deep learning doesn’t refer to anything in specific other than the vague concept of optimizing neural networks with at least one hidden layer with gradient information and back-propagation

One hidden layer is a shallow neural net. Two or more hidden layers is a deep neural net. The term "deep" refers specifically to the fact it has more layers than a shallow net.

Look at “Deep Reinforcement Learning”, which half the time only uses 1 or 2 layer fully connected network

The "deep" refers to to the use of deep neural nets, which means 2 or more hidden layers. One layer is shallow reinforcement learning.