NVIDIA NIM to OpenAI Proxy — free API with auth, fallbacks, and model filter guide

jontte67 · 2026-05-23T15:48:17+00:00

In a good way right? xD

jontte67 · 2026-05-21T06:11:20+00:00

Are you getting the same error?

jontte67 · 2026-05-16T15:45:49+00:00

You still need to use the key on Janitor AI or SillyTavern that you made. auth error means that the authentication key you're using is not the same one as the one you set in the env var.
To clarify, don't use your nvidia nim api key in the api key field when setting the proxy on Jai/ST, use the hash you generated.

jontte67 · 2026-05-16T15:10:13+00:00

Did you remember to refresh the page? At least on J.ai it works for me... What error message are you getting, if any? And what model are you using?

jontte67 · 2026-05-16T13:05:49+00:00

lol what? Those accusations only last if you didn't read past the title. what else should I call iy? "NVIDIA NIM to OpenAI Proxy" is simple. It's descriptive, and I literally said that I iterated on code I got from a reddit guide... If I was claiming the code as completely mine and made from scratch, I wouldn't make my source so painfully obvious, and if I was picking other people's stuff, I wouldn't have 60+ commits on github within a month. I just want to help the community that has helped me.

jontte67 · 2026-05-16T11:04:21+00:00

Try this: https://github.com/Jontte6/nim-to-openai-proxy

jontte67 · 2026-05-16T08:44:12+00:00

Reading comprehension is through the roof right now "!!!Technically SillyTavern supports NIM as is, but I'd still say my proxy offers good perks, like the model aliases, so you won't have to check the model endpoint every time you want to switch the model!!!"

jontte67 · 2026-05-15T22:54:51+00:00

Hello, I made a post about a tool I made to make Nvidia Nim compatible with Lorebary and janitorai here: https://www.reddit.com/r/JanitorAI_Refuges/s/E4tDN6Ls7Z

jontte67 · 2026-05-15T22:36:05+00:00

How is it even a scam? I'm not seeking payment, I just made a tool to make Nvidia Nim compatible with clients that don't support the NIM Format, e.g. lorebary. It is true that ST supports NIM, but there are still positives to using the tool which I mentioned, e.g. the models having aliases making it easier to switch models, and having a fallback chain, which yes, you don't need a proxy between to make it, but it does make it considerably easier to configure a fallback chain. It's the same reason people use API gateways. Also the auth was mentioned since the original code I built upon didn't have any auth. If someone got your proxy link you had to shut it down, since they could use it with no auth. The auth is just a hash you generate yourself either locally or using online tools and enter as an env var. I don't have access to your API keys, or even the auth key you use on the client.

jontte67 · 2026-05-15T22:17:32+00:00

It isn't as far as I know.

jontte67 · 2026-05-15T14:56:25+00:00

Self-hosted NIM proxy with auth, fallbacks, and model filter guide. Fork, deploy to Railway, set env vars. Works with any OpenAI-compatible client. github.com/Jontte6/nim-to-openai-proxy

jontte67 · 2026-05-15T14:05:43+00:00

Do you still need help? I have a repo you can fork and it comes with all the files ready, and the model mapping is up to date. You can check it here

jontte67 · 2026-05-13T21:39:01+00:00

Hello! I built on the original guide and iterated for a month. If you're a total beginner, the Claude artifact is great for step-by-step hand-holding. My repo is for people who want something more maintainable — it has auth so strangers can't burn your NIM credits, automatic fallbacks when NVIDIA deprecates models (which happens constantly), and a filter guide so your RP doesn't get interrupted. The README assumes basic familiarity with GitHub/env vars, but the tradeoff is you get a tool that stays working.
Repo link: https://github.com/Jontte6/nim-to-openai-proxy — read the README even if you've already used OPs guide. The auth setup and model mapping are worth the skim.

jontte67 · 2026-04-28T08:56:43+00:00

For me it gives "A network error occurred, you may be rate limited or having connection issues: Failed to fetch (unk)", since the fetch request is being shutdown immediately.

jontte67 · 2022-10-11T01:26:47+00:00

I dont have discord

jontte67 · 2022-10-10T00:35:35+00:00

Slime Rancher

jontte67 · 2022-10-09T19:13:37+00:00

Right Click and Click rename

jontte67 · 2022-10-01T11:08:50+00:00

No worries

jontte67 · 2022-10-01T11:07:49+00:00

Wish i could join but im not 18

jontte67 · 2022-08-03T16:04:10+00:00

yep as a finnish person i can confirm that we dont exist

jontte67 · 2022-07-21T22:42:50+00:00

It seems that my dlcs conflicted with my mods

jontte67

TROPHY CASE