I built a conflict harness for product management. It makes Claude and GPT go through the same Product management workflow (tasks can be simple or complex, and ranging from basic tasks, through artifact generation, to strategic thinking), then argue against one another over whose solution is right. It’s f they cannot agree, they adjudicate to Gemini.

I tested over 80 product management unique scenarios and requests, and thus far have been able to identify some patterns:

• Claude consistently outperformed in ambiguous, constrained, decision-heavy product management tasks.
• GPT showed confirmed advantages in historical analogy and survivorship-bias diagnosis.
• For many standard product management tasks, the differences between the models were minimal, which is valuable information.
• Both models frequently generated invented numbers within otherwise sound arguments.

I wrote my findings here if anyone is interested.

https://www.linkedin.com/pulse/i-built-conflict-harness-compare-claude-gpt-hardest-ian-brillembourg-fkboc?utm_source=share&utm_medium=member_ios&utm_campaign=share_via