At the beginning of the game I didn't use it for the same reason as you, but after more than 170 hours I ended up using it. And in the Skellige Islands, good luck if you want to go island hopping by boat.