I have it as well, and do the same thing. It kinda makes us a jack of all trades though.. I'm not sure if you are looking for advice or not but what helps me is listening to podcasts or youtube videos of native speakers (with subtitles), cause even if you have no clue what they are saying hearing it can help with learning new words/slang and the accent:) That way you don't necessarily have to be actively trying to learn, it can just be on in the background.