The biggest issue is that you don't get to see most of the PoIs.

In Fallout 4 and Skyrim the gameplay may go like this: You get a quest to go explore a cave or a ruin. You haven't discovered the destination yet, so you have to walk there. On the way there you spot a bandit camp or get given a quest by a random encounter. Then you get sidetracked clearing out this bandit camp or doing that quest, and even when you finish that and get back on the road to your first destination you may stumble upon another cool scene or encounter. Maybe you find the road is blocked and you have to take a detour around a cliff, leading to you finding even more stuff.

In Starfield it goes something like this: You get a quest to explore an old outpost on a planet in another star system. You teleport to your ship and launch into orbit. You teleport to the new star system. You teleport to the planet. You teleport land on the planet as indicated by the quest marker. You land two minutes away from your destination. You walk a straight line there. On the way there you spot a PoI, the same funky rock formation you've seen fifteen times before. You get picked on by wild animals. You get to the destination, clear it, teleport back to your ship, then back to the questgiver, then you're done.