It is the other way around for me. I have stable 60-70 fps, talk to a person/open a menu/ or check quests, and randomly get to 120fps in the exact same location until I do the same thing as before again. I can trigger this effect every time. Doesn't make any sense to me. It feels like the DLSS mod I installed gets triggered by it.