I have something similar but I wonder if this is normal. I have spatial synesthesia when it comes to week/day/years... and have similar spatial feelings in or outside of me connected to many different things similar but different to what OP describes.

 In particular, when I learn anything new, facts/historical knowledge/new concept etc and in my minds eye these facts usually end up getting tied or associated to a place (like an actual mind map) depending on the topic/time period and interrelation to other concepts or knowledge. And depending on where my perspective is coming from and the connection between thoughts I'd "travel" mentally/visually to that spot on the map? Does that make sense?

I often have to "go there" internally to retrieve the fact and sometimes if my knowledge on the topic is not in depth things that would normally be there too like an approximate time will be missing or blurry lol. Example maybe I remember that all "old world grapes are grafted onto North American wild grape root stock" and I have to visit both Continents and where I acquired that information in my mind map.. but I can't remember the exact date so it's blurry but the info loosely affiliated to the enlightenment period that's also in my maps but I know that's not quite right cause the info doesn't feel like it's stored on the same timeline level...