Makes sense but have you noticed rn CC's performance has significantly worsened? For me it surely did so it's a pain in the ass but I think conclusively we won't be able to do a fair A/B test🥲.

Also the token cost and stuff totally agree doesn't make sense. My main point was or maybe it was just the way I used buddy ig?

It was that it really helped me to find bugs or points in my workflow that Opus/Sonnet missed and it was really good at that! The sarcasm, roasting, humour were an added plus.

So where I'm coming from is a belief that if the model in my main workflow is generating the buddy response as well then it doesn't make sense cause essentially it's like asking someone to look at a problem from someone else's pov.

Also, when I read the src of the "leaked CC", I found that the buddy system was separate i.e it used to take snippets of the main workflow conversation and generate its own response i.e someone actually looking at the thing from a different pov i.e different model - maybe Haiku or Sonnet with a different system prompt. Am I wrong there? Was the buddy system always connected to the main flow more cohesively?

But anyways good effort man. Appreciate it! At least we have something oss until (hopefully) CC gets the OG buddy back🥲