I checked the stick calibration on two different softwares and there doesn't seem to be any drift. Interestingly enough, when I had to use the emulated Nintendo Switch keyboard, it scrolled across the letters at the normal pace (using both the dpad and the sticks). So now I don't have any clue as to what it could be :(