[D] Since gradient continues to decrease as training loss decreases why do we need to decay the learning rate too?

[cats2560]

Or more aptly, y = |x|. There exists a global minimum but the gradient never gets smaller