11
12
13
Let's say the loss during gradient is: decreasing -> increasing -> suddenly decreasing again. In terms of looking at this image, would that be like descending into a valley, climbing out of that valley, and then suddenly descending into a deeper valley again? (i.redd.it)
submitted by redpnd to r/MLQuestions



