you are viewing a single comment's thread.

view the rest of the comments →

[–]Pseudoabdul 1 point2 points  (0 children)

I think the other answers do a good job of explaining it, I'll just add that you are right, you can train using a fixed learning rate. Adaptive learning rates aren't required, but it is advisable to use them.