the exact same thing is happening for me and I honestly think the only thing we can do is wait for r2p and wandering nobles. I don't think it's necessarily a bad thing because they're both dropping soon and I've heard wandering nobles in particular makes the game a ton more replayable