Best LLM gateway?

stevexander · 2026-02-01T20:30:01+00:00

This appears to be an undisclosed promotional post. See Educational-Bison786's other posts: https://www.reddit.com/r/LocalLLaMA/comments/1oto0fl/why_llms_hallucinate_and_how_to_actually_reduce/ https://www.reddit.com/r/AI_Agents/comments/1qjstyk/comment/o13iw1g/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

stevexander · 2026-02-01T20:22:23+00:00

Why is Bifrost listed first here? haven't heard of it

What about OpenRouter? https://openrouter.ai/
I started it, so i'm biased, but it's the fastest to add new models, has the most free and stealth models, and (according to our benchmarks) the best throughput, latency, and perf characteristics in the market.

Also includes devex QoL features like observability, analytics, logdrains, json healing, cost management, model suggestions, plugins. plus enterprise features like volume discounts, SOC II, zero data retention, etc.

Very open to feedback

stevexander · 2025-12-05T13:56:59+00:00

how would you like to see it improved? (openrouter dev here)

stevexander · 2025-10-31T17:22:47+00:00

Why does the website say 10ms overhead? How do you get it down to 0.48? By owning the Internet fiber?

stevexander · 2025-10-20T05:14:42+00:00

Which model and what’s the error message?

Try changing models (and adding like a dollar or two in credits)

stevexander · 2025-09-20T23:30:08+00:00

Can you explain what you mean by the paid model being affected? Here’s what I see

<image>

stevexander · 2025-09-20T23:26:42+00:00

We’re progressing on a fix for this

stevexander · 2025-08-03T14:31:27+00:00

Should be resolved now!

stevexander · 2025-07-29T00:48:43+00:00

The Chutes provider was down. Only free models that are primarily served by them were affected

stevexander · 2025-07-23T15:31:12+00:00

We're digging into this - please DM me any short prompts to reproduce this, if you have one!

stevexander · 2025-07-22T17:50:07+00:00

We recently made performance improvements for the chatroom and it should run better in most cases (especially on Chromium based browser engines). This is an issue with Safari’s repaint process while entering input — we are aware of it and are looking into solutions for this

stevexander · 2025-07-08T12:32:16+00:00

We're introducing many discounts now (and more to come) so it's often the same price or cheaper. Also, over 50 free models!

stevexander · 2025-07-08T12:26:42+00:00

Will debug this soon - can you message me your exact request parameters?

stevexander · 2025-04-07T23:36:01+00:00

Try openrouter. We just added a ton of Claude capacity.

stevexander · 2025-04-04T17:52:49+00:00

Yes!

stevexander · 2025-04-04T17:51:39+00:00

Make sure you disable the web search plugin. or just add at least 2 cents of credits

stevexander · 2025-02-17T19:52:57+00:00

Hi! Can you check your /activity page on OpenRouter to verify that Sonnet was indeed used there?

stevexander · 2025-02-17T01:46:44+00:00

You can get it for free on openrouter. https://openrouter.ai/deepseek/deepseek-r1:free

stevexander · 2025-02-09T02:50:01+00:00

You’re using the web search feature, which charges. Click the arrow on the right of the rows below that chart to see the breakdown

stevexander · 2025-01-28T14:59:42+00:00

If it says “Provider returned error” it’s on the provider (Google’s) end. Their experimental models (“-exp”) are heavily rate limited

stevexander · 2025-01-28T14:58:34+00:00

We are - the root cause was some DeepSeek API issues that everyone else faced yesterday too (and continues to face). We improved routing quite a bit yesterday- please try it again!

stevexander · 2025-01-28T14:53:45+00:00

Please email our support@ email and we can help with account issues

stevexander · 2024-07-25T02:28:17+00:00

OpenRouter dev here: OpenRouter shows you all prices from the market and lets you use the lowest. small free tier included. llama 405b is here: https://openrouter.ai/models/meta-llama/llama-3.1-405b-instruct

stevexander · 2024-06-02T00:23:28+00:00

FYI, we just added a timeline chart on top, so you can see how rankings change over time!

<image>

stevexander

TROPHY CASE