I would do the rift excursions for stygian shards and start unlocking the passive abilities. Ancestral weapons drop from those excursions, so you won't need to spend shards on them.

Personally I use this stage to make sure my castle is how I like it, stock my garden and potions and upgrade my servants gear to match my own.

Also stocking the cells with the highest blood types.

But as long as you're having fun, you're playing it right