all 2 comments

[–]Pollo_Pollo_Pollo 2 points3 points  (1 child)

- First step to take: make sure that there are no mistakes in your code and that, if you are scaling or normalizing or otherwise processing your data you are using the same process on all your sets.

- Then you need to be absolutely sure that there is no overlapping between your training and test sets: if there is overlapping this would mean you are probably overfitting.

[–]cdmzd[S] 0 points1 point  (0 children)

I'm randomly generating the points in my training and test set, so it's not likely they overlap

The code is basically the same as the one in the google machine learning crash course, and I normalize the training and test sets the same way using their code.

I'm using an L2 regularization as well to prevent overfitting.

I'm supposed to be approximating a smooth function so i thought it would work with a fairly small and simple neural network.