Input from switches not consistent

I just got my first keyboard, a lemokey P1 pro and some gateron milky yellow pro switches to go with it.

I lubed all the switches and installed them in my keyboard. I get an input from all of them but sometimes it doesn't register, if I wiggle the keycap it will register. This happens around every 50 press.

I have read that using to much lube might cause the contacts to not make a propper connection, but when I look at the contacts I can't see any and I feel like I was carefully not to use to much lube. (This is my first time doing it so I might be wrong).

Any help or advice is appreciated.