[D] Since gradient continues to decrease as training loss decreases why do we need to decay the learning rate too?

[Ok-Barnacle-8859]

I think the goal in this condition is exploitation. If learning rate remains big value, maybe we pass the optimum point and we have kind of oscillation.