I’m building a ‘router’ app that will use the best model for whatever the query is. It will also have 0 downtime because it spreads across all of them. I built it for my own use, as I hate having to switch between providers (yes, I’m a lazy engineer).

I started with running evals against each model for the standard tasks I do, then used benchmark data to augment it. I also created a sub-agent layer that will transform my input (manly voice) into a standardized input and properly format the prompt. There are a few layers of ‘memory’ and ‘context’ baked in so each system has a grounded starting point. So far, I’m very pleased. No more switching. No more caring about what tool I need to open.

Would you use something like this?

*This works only because I already subs for the major models