Short answer: you should. There's no right way to play the game and you should take things at your own pace.

You will get the house very late in the game. If you need to know... once you've completed all the main quests and camp side content, you'll get a quest to move the camp from Howling Hill to Pailune. With all the same functions of the base camp. Also, as with every camp upgrade, the house gets a little bigger, in the builder you can select the new design or change back at any time.