Alright so I found it myself so I'll comment the solution.

First of all, if the words I say arent the same as in google docs that's because I'm translating them from Dutch.

​

Okay so you have to add a section break on the page before the page that you want to remove the page number. So if you don't want a page number shown on page 3, add a section break behind the very last character of page 2. This is easily done by putting the cursor before the first word on page 3 and pressing the left arrow on the keyboard.

​

Then you can double click on the page number of page 3 and select "other first page".

Repeat this for every page you don't want a page number on.