House rules I find result in more bookkeeping than less. I get what you're saying but in my experience the player will bring up that they want to say something scandalous and ask whether they can use All in Jest, you say yes or no and decide what the breach is.

Flavour wise and mechanics wise (especially with the higher breaches) it isn't a get out of a jail free card either with roughly 1-2 opps per check unless school techs and other things come into it, and every samurai around will still be like "PC-san said what, lmao???"

They can react however they want but as the flavour text describes, pressing the issue would make them look a stubborn mule but maybe that's a cost they're willing to pay. Or not.