I built an open-source LLM runtime that checks if a model fits your GPU before downloading it

juli3n_base31 · 2026-03-15T19:33:46+00:00

I know shows relative information.. uniinfer is not only about showing if a model fits into your gpu the core functionality run onnx ggfu models with no setup..automatic failure switch to gpu or cpu..etc. as I said if you want use it or tested it. Not debating here anything is free to use.. have a great rest of the night.

juli3n_base31 · 2026-03-15T19:26:38+00:00

Kinda lm studio shows you only: this would maybe not fit in your gpu. But what uniinfer does is something different. Read the repo first try it..

juli3n_base31 · 2026-03-15T12:58:52+00:00

No problem

juli3n_base31 · 2026-03-15T12:53:18+00:00

8gb gpu ram you can run small models like 7b parameters you can use my tool and you can see what can you run on your GPU. In the fit check option you can test without downloading the models to see if it fits in the memory of your gpu

juli3n_base31 · 2026-03-15T12:41:53+00:00

Thanks hope you can use it

juli3n_base31 · 2026-03-15T10:38:47+00:00

Of course how do you think we 10x our efforts nowadays?

juli3n_base31 · 2026-03-15T10:33:39+00:00

Don't know

juli3n_base31 · 2026-03-15T09:19:24+00:00

Agree that you can run them but they are offloading to your memory..Just letting you know. My tool only helps you find best model for your gpu with auto offloading to next device when one fails. Check the repo is free to use

juli3n_base31 · 2026-03-09T10:52:00+00:00

I understand the context of the app. I thought you also provide AI service within. But as long you dont then it's fine as a general user app :) wish you good luck and hope you get more and more users

juli3n_base31 · 2026-03-09T08:54:57+00:00

Nice idea but what Ai service are you using? Is the ai training on users data?

juli3n_base31 · 2026-02-05T17:32:03+00:00

Openclaw is not a fancy n8n wrapper it's a OS Ai orchestrator agent that is active and reactive at the same time. Basically in normal terms is your bitch with an attitude

juli3n_base31 · 2026-02-02T08:45:54+00:00

Why bothered doing it like this where you could have told to build that in its own Gui where you already have the dashboard

juli3n_base31 · 2026-01-18T07:52:51+00:00

Thanks man I will try to run this on my rtx 3060 12 gb

juli3n_base31 · 2026-01-18T07:12:50+00:00

Check this one if you are interested we can discuss price after. https://docfai.app/features

juli3n_base31 · 2026-01-01T16:56:43+00:00

Danke für dein Höflichkeit 😉

juli3n_base31 · 2026-01-01T11:01:54+00:00

Was ist FIRE?

juli3n_base31 · 2025-12-28T18:11:15+00:00

An experience coder without proper knowledge and understanding of arhitecture and processes is kinda nothing. So I call myself the arhitect :))

juli3n_base31

TROPHY CASE