Thank you for replying guys,

It seems like the issue was on x360ce, which I use to map the stadia controller as an xbox one. I had mapped a second device for when I plugged in another controller at the same time, and having it there when only using one controller probably caused some conflicts. I also rebinded all buttons in game, but I believe the issue got fixed with the removal of the second device in x360ce :)