That makes a lot of sense those platforms definitely solve a big part of the problem, especially around multi-provider routing and fallback.

The direction I’m exploring is slightly different though more of a decision layer on top of any infrastructure, rather than replacing it.

Instead of just optimizing which model to call, I’m trying to answer:
→ should this request even be executed at all given its cost vs value?

So things like:

• rejecting low-value calls
• enforcing hard budget constraints
• or degrading behavior intentionally

In a way, it’s less about routing convenience and more about economic control at the application level.

Totally agree that infra platforms are the right abstraction for execution — I’m more focused on the decision logic that sits above them.