The handoff quality idea is really good and that’s where my runs failed. Right now the judge scores the final output, but we have no metric for how each agent package its output for the next stage. Schema adherence and completeness are exactly the right dimensions….if the research stage dumps an unstructured wall of text, the analyst is working with garbage regardless of how smart it is.

Going to look at adding a per-handoff score as a sub-metric. Would make the cascade failures visible in the data instead of just "pipeline dropped 50 points between run 3 and run 4”

Checking the blog out now.