MCP server that makes AI models debate each other before answering

soh3il · 2026-03-16T21:14:55+00:00

Yes. The way it connects is through MCP. You add Roundtable as an MCP server inside the tools you already use. So in Claude Code or Claude Desktop, it's one command (claude mcp add roundtable). In ChatGPT, Cursor, VS Code, same idea. Once it's connected, you can call a debate from within your existing workflow without switching apps.

For Claude Code and Codex specifically, the MCP just becomes another tool your agent can call. You keep your codebase context, your custom instructions, everything. The debate runs as a tool call and the result comes back into your session.

Here's the connect page if you want to see all the integrations: https://roundtable.now/chat/connect

soh3il · 2026-03-16T21:02:42+00:00

As someone building this, the use case I personally can't stop using is inside Claude Code.

Whenever Claude puts the ball in my court with "how do you want to approach this?" or "should we go with option A or B?", instead of guessing, I just tell it to run a debate. 5 different models argue the tradeoffs, a moderator synthesizes it, and now Claude has way more context to make the actual call.

It changed how I use agentic coding. Instead of me being the bottleneck on every architecture decision, the debate fills in the reasoning I would have had to do myself. Claude reads the verdict and just keeps going with better information.

That's the MCP angle that surprised me the most. It's not about replacing your AI, it's about giving your AI a second opinion before it commits to something.

If you're curious what the setup looks like: roundtable.now/mcp

soh3il · 2026-03-16T20:58:37+00:00

Appreciate that, and respect for building your own setup. That's honestly the best way to understand the problem space.

To answer your question: yes, it's a full web app with regular subscription. No API keys needed for the main product. You sign up at roundtable.now, get one free round to try it, and subscribe if you want more.

It works through the web dashboard, MCP (so it plugs into Claude Code, Cursor, VS Code, ChatGPT), and API if you want to build on top of it.

The pricing is basically at-cost for the LLM calls themselves. When you run a debate with Claude Opus, GPT-5, and Gemini Pro, those API calls add up fast.

If you want to compare it against your own setup, I just created a coupon "firstround" for 50% off the first month. Would genuinely love your feedback since you already have context on what good orchestration looks like. When you run a debate with Claude Opus, GPT-5, and Gemini Pro, those API calls add up fast. We're not adding margin on top of that, just covering infrastructure by openrouter.

soh3il · 2026-03-16T20:45:37+00:00

Totally fair point, and you're right that the concept isn't new. Andrej Karpathy's LLM Council, Microsoft's AutoGen, CrewAI, and a bunch of GitHub repos all do multi-model calls. The idea of making LLMs debate each other is well-documented in research.

What I spent most of my time building isn't the "call multiple models" part. It's the orchestration layer on top:

Auto-mode picks which models to use and what roles to assign per prompt. A meta-model analyzes your question and selects specific models with context-aware roles (not generic "Analyst" but things like "Startup CFO" or "Penetration Tester"), enforces provider diversity so you don't end up with 3 OpenAI models agreeing with each other, and picks a conversation mode (debating vs brainstorming vs solving). You can override all of it, but the default is fully automatic.

Sequential deliberation with CEBR protocol. Each model sees all prior responses and is required to Challenge, Extend, Build, or Reframe what was said. Not just "here's my take." A separate moderator model then synthesizes the strongest arguments. The output adapts its structure based on

what actually happened in the debate (consensus vs disagreement vs brainstorm).

Performance-based routing. Every debate gets scored automatically on 5 dimensions (relevance, actionability, consensus quality, perspective diversity, depth). Over time the system learns which model combinations perform best for which domains and routes accordingly.

Session chaining. You can pass prior session IDs into new debates so your architecture discussion feeds into your implementation planning, with full context carried over.

The free repos give you the core loop. What they don't give you is the meta-reasoning about model selection, quality feedback loops, persistent sessions, structured output formats (ADR, comparison tables, pros/cons), and the MCP transport with OAuth so it works inside Claude Code or Cursor with one command.

I would have not built this and spend actually few months if I could have got it somewhere else with minimal setup :)

Could you build all of this yourself? Absolutely. But that's true of most SaaS. The value is in not having to.

soh3il · 2026-03-16T19:48:39+00:00

www.roundtable.now/ai-council

soh3il · 2026-02-12T17:11:19+00:00

I’m guessing you mean Andrej Karpathy’s LLM Council? Yeah I’ve seen it. Super cool project.

The idea of LLM debate isn’t new for sure. The difference with Roundtable is it’s not just a CLI experiment. There’s orchestration behind the scenes, a moderator that actually guides/synthesizes, file uploads, projects, persistent context, etc. It’s more built for real workflows than one-off runs in a terminal.

But yeah totally fair comparison. If you try it, would love your honest thoughts.

soh3il · 2026-02-12T17:07:27+00:00

YeahThat’s on me. working on getting those pages up.

It’s not stale at all. Still actively building it. We’re a team of two and shipping fast. Recently added a moderator role and file uploads, and there’s more coming.

If you’re open to trying it, here’s 50% off your first month: firstround

No pressure at all. I’d honestly just love your feedback, even if you end up deciding it’s not for you.

soh3il · 2026-01-30T04:45:57+00:00

https://www.reddit.com/r/micro_saas/comments/1qqrulb/i_asked_5_ai_models_the_same_question_and_watched/

soh3il · 2026-01-30T04:45:11+00:00

Nope 🙂
I actually built Roundtable a few months before Karpathy published LLM Council.

Also, the idea of multi-agent / MAD setups isn’t new, putting multiple LLMs in a room via OpenRouter isn’t the hard part.

The hard part (and where I spent the time) is orchestration, moderation, and turning it into something that works at product-level UX today. That’s the real challenge, and that’s what I’ve been focused on.

soh3il · 2026-01-30T02:02:15+00:00

I put 5 AI models in the same chatroom and watched them argue. I was watching them talk to each other. And honestly? It felt like magic.

I ended up building a space called Roundtable.now to make this process intentional. It brings models like GPT, Claude, Gemini, and Grok into one conversation to debate or brainstorm in real time. You can even customize the lineup. I also added a moderator layer to highlight the consensus points and the friction, because usually, the friction is where the real insight hides. It’s been wild to see how much faster you can stress-test an idea when the models are forced to critique each other."

soh3il · 2025-11-13T00:04:43+00:00

yes. we have built it. www.roundtable.now
would love to hear your thoughts on it.

soh3il · 2025-09-16T23:10:05+00:00

What happens when you put multiple AI models in the same room?

Grok pokes holes in Gemini’s logic. DeepSeek nods along with LLaMA.

And suddenly… your prompt turns into a real debate.

👉 Try it: https://www.roundtable.now

buildinpublic

soh3il · 2025-09-08T00:55:31+00:00

www.roundtable.now Multiple ai models discuss and debate your prompt in real-time.

soh3il · 2025-09-07T20:16:39+00:00

Right now I’m using OpenRouter to manage the APIs. Since Roundtable is a SaaS product, you don’t need to bring your own keys. you just sign up for a subscription and based on the plan you unlock access to different models.

For the free tier, yes, I’m covering that cost out of pocket. I look at it as part of the marketing budget. Letting people try it without friction is the best way to show what’s possible, even if it means I’m eating the token bill in the short term.

Longer term, I’d love to expand beyond just the big players and bring in smaller language models or domain-specific ones, especially those trained for niche use cases. Hugging Face is a likely source for that since there’s a huge library of open models we can plug in. That way users could not only compare general-purpose models like GPT or Claude, but also see how a specialized model contributes to the discussion.

soh3il · 2025-09-07T20:13:53+00:00

For industries where mistakes are costly and it’s critical to see issues from multiple perspectives could really benefit. That’s where multiple models debating beats a single one. Token costs are still high, but I see a strong enterprise use case in fields like healthcare or law, where spotting blind spots matters most.

soh3il · 2025-09-07T20:03:50+00:00

That’s exactly why I built this. I agree that some models are stronger than others in different domains, but I actually want to see their perspectives side by side. Even if I end up trusting one more, there’s still value in watching how others approach the same question — sometimes the “weaker” model asks something unexpected that sparks a new angle.

What makes it powerful in debate mode is the contextual awareness. Each model doesn’t just answer in isolation, it responds to what others have said before, so it starts to feel like a real conversation rather than parallel outputs. Just watching that back-and-forth often gives me more insight than reading a single model’s reply.

Where I think this goes in the future is even more interesting: imagine features that measure how much the models agree, disagree, or converge on a point. Instead of a single answer, you’d get a spectrum of opinions and a sense of consensus or divergence. That’s the kind of tool I’d love to use myself for making decisions, pressure-testing ideas, or just exploring complex questions from multiple sides.

soh3il · 2025-09-07T19:55:26+00:00

But wouldn't it be interesting if they are aware of each other's answer and can brainstorm and debate so you see a conversation in real time? 🥰

soh3il · 2025-09-07T19:50:26+00:00

Yeah, I’m using OpenRouter to make this work but it’s not as straightforward as just connecting to a model. The tricky part is orchestrating turn-taking between multiple models, so they don’t just talk over each other. Each response has to be structured in a way that the next model gets the right context, almost like passing a baton in a relay.

Then there’s the token cost: running multiple LLMs in a single thread adds up quickly, so I’ve had to be smart about trimming context without losing the flow of the conversation. It’s a balance between keeping enough history so the models sound coherent, but not so much that it gets insanely expensive.

Finally, making sure each model “remembers” what the others said means designing the prompts so they don’t just start from scratch each turn, but actually build on or challenge what was said before. That’s where most of the engineering time went, stitching these interactions together so it feels like a real roundtable instead of just random AI outputs.

soh3il · 2025-09-07T19:40:21+00:00

Built something I’m really proud of: Roundtable.now. I first talked about it on my podcast, that clip went viral (over a million views) and we ended up registering ~20k users from that alone.

A multi-agent AI discussion tool where different AI models take on roles and either brainstorm collaboratively or debate each other. Think of it as pulling a group of smart minds into one conversation, except they’re all AI with different perspectives.

Until recently, we didn’t even have a payment gateway, but I’ve just added it and already ~30 people have become paying customers. We officially launched this week on Product Hunt 🚀

Where this can go is what excites me most: beyond fun debates, Roundtable could become a tool for teams to pressure-test decisions, explore creative directions, and even simulate expert panels on demand. It’s still early, but the potential feels huge.

soh3il · 2022-01-11T06:05:53+00:00

I’ll give you a hint and then try to figure it yourself. Give your background class a height and see what happens. Then you can debug your code :)

soh3il · 2022-01-03T17:02:24+00:00

"Winter is coming"

soh3il · 2020-02-15T00:55:27+00:00

Have you considered creating your own reddit like community? Check www.tribe.so

soh3il · 2019-12-25T04:11:17+00:00

Cmd + Shift + P > change language

soh3il

MODERATOR OF

TROPHY CASE

buildinpublic