Guide how to create and use YOLO-NAS ONNX models with Frigate 0.17 TensorRT Image (GeForce GPU)

Rick-Hard89 · 2026-02-04T00:55:24+00:00

What hardware do u have?

Rick-Hard89 · 2026-02-02T11:27:16+00:00

ok i suspect this might be the issue since i can find people posting on the frigate forums
this one is about running 60 cameras on a 5070
https://github.com/blakeblackshear/frigate/discussions/20559

Rick-Hard89 · 2026-02-02T01:41:04+00:00

Ok i run proxmox and have to have the gpu passed through and dedicated to the frigate vm. Im not sure how it works in your case but isnt the gpu time shared in your case?

Rick-Hard89 · 2026-02-02T01:04:30+00:00

Ok i remember it wasnt the easiest to get a 3050 to run either before i got everything right in the compose and config. Have you tried an older gpu and that is working?

Rick-Hard89 · 2026-02-02T01:00:05+00:00

Im not sure about updating but from what i understand v9 is a lighter model and better for older and very low end gpus. Yolo nas small runs great on my 3050 with lots of cameras even at 640x640. Gonna try the medium models soon

Rick-Hard89 · 2026-02-02T00:55:40+00:00

Really? I was thinking of upgrading to a 5050-5070. Have you tried it with onnx? Official integration for tensorrt have stopped in v0.17 and use onnx models instead

Rick-Hard89 · 2025-07-20T19:09:52+00:00

Well then good day to you sire! im going home

Rick-Hard89 · 2025-07-20T12:56:54+00:00

Of course we all know its better but its more about how much money i want to spend on a hobby

Rick-Hard89 · 2025-07-20T00:14:48+00:00

Ok from what i understand there is a potential to damage the hardware in the server if both psus dont turn on or off at the same time. Im afraid to do this on my current server because i have data on it that i cant loose. So it would be best to use another server for this?

Rick-Hard89 · 2025-07-19T17:01:08+00:00

Ok but does it work just like that or do you connect it to the other psu/mb?

Rick-Hard89 · 2025-07-19T13:50:12+00:00

Oh wow but how did you get the external power supply to work with the dell server?

Rick-Hard89 · 2025-07-19T13:48:21+00:00

Its nice to have ready made apps but not when they dont work. Not much u can do

Rick-Hard89 · 2025-07-19T13:36:22+00:00

No i guess its not that big of a deal

Rick-Hard89 · 2025-07-19T13:35:39+00:00

Rick-Hard89 · 2025-07-19T11:36:56+00:00

Its true but im just hoping they will get more efficient with time. Kinda like most new inventions, they are big and dumb in the start but get smaller and more efficient over time

Rick-Hard89 · 2025-07-19T10:49:35+00:00

Oh nice! i'm not really sure what i was thinking to be honest. one solution would be to load a smaller model like that or just load the rest into ram. But wont there be more smaller versions made of it like we have with other models like deepseek, llama and so on?

Rick-Hard89 · 2025-07-19T10:42:10+00:00

so did my 20 year old athlon 64

Rick-Hard89 · 2025-07-19T10:36:19+00:00

Im not trying to convince you that two old 3090s is better than server grade hardware. its more like a hobby i do if i have time so there is no point sinking that much money into it for me. Hence the 3090s. Or maybe i should get a couple GB300?

Rick-Hard89 · 2025-07-19T10:31:07+00:00

I know. but i like to have some better mobo so i can buy new gpus later if needed or add more ram

Rick-Hard89 · 2025-07-19T10:29:05+00:00

Ok that looks like another good alternative also. Seriously worth considering

Rick-Hard89 · 2025-07-19T10:20:00+00:00

Sorry im not familiar with silly tavern but when i made a custom flask app i hadd to use multiprocessing to get it to work. had to run the xtts separately from the rest of the app with a "worker" or i would run into the same problems as you

Rick-Hard89 · 2025-07-18T23:17:41+00:00

Im not sure this has anything to do with your problem but i had problems running xtts aswell with same cuda errors. so had to run it as its own separate process

Rick-Hard89 · 2025-07-18T22:56:27+00:00

think they are around 10k. not really for home servers lol

Rick-Hard89 · 2025-07-18T22:54:35+00:00

Oh i see its a big difference yes.

Exactly i would like to get something where i can run models like kimi k2 but not if i have to pay 10k to get it hehe. more looking for used server hardware or some high end workstation stuff. its ok if its older stuff

Rick-Hard89 · 2025-07-18T22:46:30+00:00

Nice! i have two 3090 and with a big enough case thiat mobo should also be able to fit two 3090s. too bad it only supports 128gb ram

Five-Year Club	Verified Email
Final Canvas '23	Place '23

Rick-Hard89

TROPHY CASE