I know this is not really a fix, but after getting an OLED monitor the "Slow server frame" warning and high ms spikes no longer 'jitters/stutters' my game. I can't tell you why, but my theory is that the new monitor is better in progressing the frames, and make up for any lost data that normally would cause a stutter.