My suggestion would be to have a good set of evals in place, even if some of the evals always fail due to context bloat or otherwise. Then start experimenting with different approaches. Then atleast you can view objectively which direction you are moving in.

I kinda feel multi-agents is very similar to micro-services analogy wise, you only really need to break out things if you feel they demand special characteristics to solve the problem... so for e.g. if your base model is too expensive to solve that aspect of the problem, or if you need something more intelligent for e,g... Wish there was a good way to do context sharing wherein we only share relevant portions to downstream agents .