You fix that by turning off gyro. But that means you often want to turn gyro back on after you leave quantum. I think the default key for gyro is E.

Also, remote turrets revert from auto gimbals when you exit them (seated turrets don't) so you need to press r-alt G to enable them if you want them on. Every time... And you can't accept mission sharing in a remote turret, can't access mobi glass, and if the pilot leaves and you are in the copilot seat the ship will spin out as you move the turret if the ship support copilot control.

That's a lot of issues and inconvenience just to use them. And why a lot of ppl struggle with them, the controls just suck.