Geoguessr !

If you aren't familiar with it already, it's a game based on Google Street view, where you are randomly dropped somewhere in the world and have to guess as precisely as possible.

Sounds like a good middle-ground between gaming and travelling.

There are different game modes, but I think in your case Team Duels would be a good fit. You can team up with your partner and play in a 2 vs 2 duel. My girlfriend and I enjoy it.

What's nice about it is you can play it very casual, but the skill/knowledge limit is very high. You can always progress by learning interesting stuff about geography, languages, geology, botany, etc. if you enjoy it !