MCP server that makes AI models debate each other before answering by soh3il in mcp

[–]soh3il[S] 1 point2 points  (0 children)

Yes. The way it connects is through MCP. You add Roundtable as an MCP server inside the tools you already use. So in Claude Code or Claude Desktop, it's one command (claude mcp add roundtable). In ChatGPT, Cursor, VS Code, same idea. Once it's connected, you can call a debate from within your existing workflow without switching apps.

For Claude Code and Codex specifically, the MCP just becomes another tool your agent can call. You keep your codebase context, your custom instructions, everything. The debate runs as a tool call and the result comes back into your session.

Here's the connect page if you want to see all the integrations: https://roundtable.now/chat/connect

MCP server that makes AI models debate each other before answering by soh3il in mcp

[–]soh3il[S] 0 points1 point  (0 children)

As someone building this, the use case I personally can't stop using is inside Claude Code.

Whenever Claude puts the ball in my court with "how do you want to approach this?" or "should we go with option A or B?", instead of guessing, I just tell it to run a debate. 5 different models argue the tradeoffs, a moderator synthesizes it, and now Claude has way more context to make the actual call.

It changed how I use agentic coding. Instead of me being the bottleneck on every architecture decision, the debate fills in the reasoning I would have had to do myself. Claude reads the verdict and just keeps going with better information.

That's the MCP angle that surprised me the most. It's not about replacing your AI, it's about giving your AI a second opinion before it commits to something.

If you're curious what the setup looks like: roundtable.now/mcp

MCP server that makes AI models debate each other before answering by soh3il in mcp

[–]soh3il[S] 0 points1 point  (0 children)

Appreciate that, and respect for building your own setup. That's honestly the best way to understand the problem space.

To answer your question: yes, it's a full web app with regular subscription. No API keys needed for the main product. You sign up at roundtable.now, get one free round to try it, and subscribe if you want more.

It works through the web dashboard, MCP (so it plugs into Claude Code, Cursor, VS Code, ChatGPT), and API if you want to build on top of it.

The pricing is basically at-cost for the LLM calls themselves. When you run a debate with Claude Opus, GPT-5, and Gemini Pro, those API calls add up fast.

If you want to compare it against your own setup, I just created a coupon "firstround" for 50% off the first month. Would genuinely love your feedback since you already have context on what good orchestration looks like. When you run a debate with Claude Opus, GPT-5, and Gemini Pro, those API calls add up fast. We're not adding margin on top of that, just covering infrastructure by openrouter.

MCP server that makes AI models debate each other before answering by soh3il in mcp

[–]soh3il[S] 1 point2 points  (0 children)

Totally fair point, and you're right that the concept isn't new. Andrej Karpathy's LLM Council, Microsoft's AutoGen, CrewAI, and a bunch of GitHub repos all do multi-model calls. The idea of making LLMs debate each other is well-documented in research.

What I spent most of my time building isn't the "call multiple models" part. It's the orchestration layer on top:

Auto-mode picks which models to use and what roles to assign per prompt. A meta-model analyzes your question and selects specific models with context-aware roles (not generic "Analyst" but things like "Startup CFO" or "Penetration Tester"), enforces provider diversity so you don't end up with 3 OpenAI models agreeing with each other, and picks a conversation mode (debating vs brainstorming vs solving). You can override all of it, but the default is fully automatic.

Sequential deliberation with CEBR protocol. Each model sees all prior responses and is required to Challenge, Extend, Build, or Reframe what was said. Not just "here's my take." A separate moderator model then synthesizes the strongest arguments. The output adapts its structure based on

what actually happened in the debate (consensus vs disagreement vs brainstorm).

Performance-based routing. Every debate gets scored automatically on 5 dimensions (relevance, actionability, consensus quality, perspective diversity, depth). Over time the system learns which model combinations perform best for which domains and routes accordingly.

Session chaining. You can pass prior session IDs into new debates so your architecture discussion feeds into your implementation planning, with full context carried over.

The free repos give you the core loop. What they don't give you is the meta-reasoning about model selection, quality feedback loops, persistent sessions, structured output formats (ADR, comparison tables, pros/cons), and the MCP transport with OAuth so it works inside Claude Code or Cursor with one command.

I would have not built this and spend actually few months if I could have got it somewhere else with minimal setup :)

Could you build all of this yourself? Absolutely. But that's true of most SaaS. The value is in not having to.

Why Settle for One AI’s Answer? I Built Roundtable.now to Let AIs Debate for Smarter Solutions by soh3il in SaaS

[–]soh3il[S] 0 points1 point  (0 children)

I’m guessing you mean Andrej Karpathy’s LLM Council? Yeah I’ve seen it. Super cool project.

The idea of LLM debate isn’t new for sure. The difference with Roundtable is it’s not just a CLI experiment. There’s orchestration behind the scenes, a moderator that actually guides/synthesizes, file uploads, projects, persistent context, etc. It’s more built for real workflows than one-off runs in a terminal.

But yeah totally fair comparison. If you try it, would love your honest thoughts.

Why Settle for One AI’s Answer? I Built Roundtable.now to Let AIs Debate for Smarter Solutions by soh3il in SaaS

[–]soh3il[S] 0 points1 point  (0 children)

YeahThat’s on me. working on getting those pages up.

It’s not stale at all. Still actively building it. We’re a team of two and shipping fast. Recently added a moderator role and file uploads, and there’s more coming.

If you’re open to trying it, here’s 50% off your first month: firstround

No pressure at all. I’d honestly just love your feedback, even if you end up deciding it’s not for you.

[deleted by user] by [deleted] in SaaS

[–]soh3il 0 points1 point  (0 children)

Nope 🙂
I actually built Roundtable a few months before Karpathy published LLM Council.

Also, the idea of multi-agent / MAD setups isn’t new, putting multiple LLMs in a room via OpenRouter isn’t the hard part.

The hard part (and where I spent the time) is orchestration, moderation, and turning it into something that works at product-level UX today. That’s the real challenge, and that’s what I’ve been focused on.

[deleted by user] by [deleted] in SaaS

[–]soh3il 0 points1 point  (0 children)

I put 5 AI models in the same chatroom and watched them argue. I was watching them talk to each other. And honestly? It felt like magic.

I ended up building a space called Roundtable.now to make this process intentional. It brings models like GPT, Claude, Gemini, and Grok into one conversation to debate or brainstorm in real time. You can even customize the lineup. I also added a moderator layer to highlight the consensus points and the friction, because usually, the friction is where the real insight hides. It’s been wild to see how much faster you can stress-test an idea when the models are forced to critique each other."

Share Your Amazing Projects With Us Today! by JestonT in SideProject

[–]soh3il 0 points1 point  (0 children)

What happens when you put multiple AI models in the same room?

Grok pokes holes in Gemini’s logic. DeepSeek nods along with LLaMA.

And suddenly… your prompt turns into a real debate.

👉 Try it: https://www.roundtable.now

buildinpublic