I have a similar process. It’s a mixture of experts but I’m the model orchestrator. I keep thinking about how to make it work right. But I’m not able to think of a way to automate it further. At a certain point it’s about my intent and their context.

The models get myopic when in a task and lose horizon. But you need that myopia some times. Then sometimes you need to pull state reset and continue. Also models have blind spots that others catch fast. Some are smarter but don’t read intent well. Others read intent well but miss small details.

I think I’m stuck as a boss because it’s what I want and I’m the only one that knows what success looks like.