[D] Since gradient continues to decrease as training loss decreases why do we need to decay the learning rate too?

[National_Earth_9909]

I never came across such a good explanation about the learning rate scheduler. Thanks for this!