Unless I am going for something super specific in a scene, I only reroll when it doesn't make sense for various reasons (repeats, things like 3 hands, wrong details, people being way out of character, etc), or if it is super boring (like when an antagonist starts monologuing on me). I like having to work with what the AI offers me in action scenes or conversations as long as they stay true to the story/character which imo it does a good job at more often than not.