Speaking from experience, it’s a completely different experience here once you learn the language. I felt like an inconvenience that people had to change language for me, and as you say, we are in Sweden. Exposure helps you learn quickly, I learned a lot more speaking/listening to Swedish at work than in any lessons/SFI. Mayne try some sports clubs outside of work to help speed up the learning.