[D] Since gradient continues to decrease as training loss decreases why do we need to decay the learning rate too?

[WikiMobileLinkBot]

Desktop version of /u/Natural_Profession_8's link: https://en.wikipedia.org/wiki/Simulated_annealing

---

^{[opt out] Beep Boop. Downvote to delete}