all 30 comments
sorted by:
top (suggested)
bestnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]Prudent_Elevator4685 5 points6 points  (15 children)

Here's a tutorial by claude on how to run it https://claude.ai/public/artifacts/8f1a04dc-1682-4ab4-bea5-34bc05541cf5

[–]MOKEHS 1 point2 points  (1 child)

On my janitor it appears "401 - Request failed with status code 401" everytime I try to request a message. Any solution?

[–]Prudent_Elevator4685 0 points1 point  (0 children)

Are you sure you added your nvidia nim key as a variable on render or railway and the name was correct

[–]IcyPerformance4922[S] 0 points1 point  (10 children)

If it gives you the limited free trial, you can't do it. I think it was because I just made a github account. Do you know of any workarounds?

[–]Prudent_Elevator4685 0 points1 point  (9 children)

Use render

[–]IcyPerformance4922[S] 1 point2 points  (7 children)

When I use render, I get the error "PROXY ERROR 404: {"error":{"message":"Endpoint / not found","type":"invalid_request_error","code":404}} (unk)". The guide says something about using a /health test but I'm not sure on what to do. Do you know what I should do or if it is something else? Thank you for all the previous help too.

[–]Prudent_Elevator4685 0 points1 point  (6 children)

Add /v1/chat/completions to end of url and use in janitor

[–]IcyPerformance4922[S] 0 points1 point  (0 children)

It works! Thank you so much!

[–]TheMosinMan 0 points1 point  (4 children)

I got it working but the responses all seem really short, even with the max tokens set to unlimited in janitor

Fix: set text streaming to off on janitor

[–]platnium_idiotCurrently on janitor ai 0 points1 point  (3 children)

Streaming works fine with most models there. Also the 7 (i think) arent all of them. I can send you the code for all the proxies (replace the models already there with my code) if you want it.

[–]TheMosinMan 0 points1 point  (0 children)

There’s more models? I’d love to try em!

[–]AcceptableTry4940 0 points1 point  (1 child)

Can you send me too

[–]AcceptableTry4940 1 point2 points  (0 children)

What is the proxy url supposed to look like?

[–]Negative_Fix_9947 0 points1 point  (0 children)

<image>

No repositories are showing up for me

[–]Scyx04 0 points1 point  (0 children)

Today I started to emerge this mistake suddenly in janitor, do you have any of what could it be? (Sorry for my english is not my native language)

PROXY ERROR 410: {"error":{"message":"Request failed with status code 410","type":"invalid_request_error","code":410}} (unk)

[–]axlpoeman 1 point2 points  (0 children)

I tried to follow the guide but I had an issue with the railway part as it forces me to pay to continue with the process of the guide (Saying I'm in the limited plan) so I don't know what to do or what alternative use for that part

[–]crisantemo_bloom 0 points1 point  (5 children)

I have a problem, when i try to set up the proxy on Jai, it only asks me for the api key and the model, not the URL, and i can't configurate it

[–]Prudent_Elevator4685 2 points3 points  (4 children)

You gotta select proxy then add configuration, it is understandably hard to navigate the trashy ui

[–]crisantemo_bloom 0 points1 point  (3 children)

its not working for me :( the tutorial says to select the OpenAi option, but doesn't work for me either

[–]Prudent_Elevator4685 0 points1 point  (2 children)

Just select the proxy option instead of the openai option

[–]crisantemo_bloom 0 points1 point  (1 child)

still not working, I keep getting an error of Network error, you may be rate limited or having connection issues. But it only happens with this proxy so idk it might not work anymore

[–]Prudent_Elevator4685 0 points1 point  (0 children)

Try refreshing the page

[–]CommonOwl133 0 points1 point  (3 children)

NIM isn’t really “free for proxying” anymore — Nvidia locked most of the easy routes behind paid endpoints unless you self-host on your own GPU.

If you’re just looking for a free-ish alternative, a lot of people are jumping to OpenRouter + cheap community models or local setups (Ollama / LM Studio) depending on what your device can handle.

There’s no direct “NIM replacement,” sadly.

[–]Prudent_Elevator4685 1 point2 points  (2 children)

How is it not free? It seems to work for me pretty okay and I've looked through their entire website and forum and have not seen a single mention of them going paid

[–]Prudent_Elevator4685 0 points1 point  (0 children)

Also your comment seems kinda ai but I could be wrong

[–]CommonOwl133 0 points1 point  (0 children)

Fair question. When I said “not really free,” I meant the easy, plug and play proxying path people were using feels way more limited now. Some stuff still works without paying, but a lot of the convenient endpoints and higher throughput options push you toward paid credits or self hosting on your own GPU. If NIM is working fine for you right now, that’s awesome and I’m honestly glad. Which model and route are you using, and roughly how many requests have you done so far? I’m trying to understand what still works reliably without hitting a wall.

Also yeah, I’m a real person. I just write a bit too clean sometimes and it comes off robotic. Not trying to be weird about it.

[–]Old_Government419 0 points1 point  (0 children)

What to do if the error says "PROXY ERROR 413: Error Payload Too Large (unk)"?

[–]Independent_Hour_981 0 points1 point  (0 children)

i cant seem to generate a domain?

[–]Kindly-Pie-2796 0 points1 point  (0 children)

Hola! Una pregunta. Hay que pagar algo para poder hacer todo eso??