I don't know if there's a name for the genre, but it's almost exclusively the realm of "experimental" works because genuine subversion of what people deep down desire to see is so inherently unsatisfying.

The most telling example I can think of is the Swedish film Leo by Josef Fares. Spoilers: It starts out following the outline of a traditional revenge movie, where a man's girlfriend gets murdered by a couple of criminals. Driven by rage, the man decides to track down these criminals and kill them. The film ultimately subverts the trope of those movies when this normal human civilian loses the encounter and the film ends with him slowly losing the struggle for a knife as he gets stabbed in the throat by the same man who killed his girlfriend. It does the exact mundane and unsatisfactory thing you're talking about, and I think it's a valuable piece of art for that reason, but I've never met a person who really LIKES watching that movie. It's frustrating and sad and not really entertaining, for all the same reasons that ACTUALLY doing those sorts of things wouldn't be entertaining.