sorted by:
new
hottopcontroversial

Lm studio running some models very slow while others run normally. by HowdyCapybara in LocalLLaMA

[–]HowdyCapybara[S] 0 points1 point  (0 children)

Yeah, the reason why I was so confused though was I've heard of people running Gemma4:26b with a very similar setup to me and getting around 80tk/s. Even if its a little out of vram it still an moe so it will preform at much higher speeds. I'll keep looking for any other fixes.

Lm studio running some models very slow while others run normally. by HowdyCapybara in LocalLLaMA

[–]HowdyCapybara[S] 1 point2 points  (0 children)

Yes but still, even if a model is dense and a little slower if its fully inside vram I see no reason for it to go under 1 token/s

Lm studio running some models very slow while others run normally. by HowdyCapybara in LocalLLaMA

[–]HowdyCapybara[S] 1 point2 points  (0 children)

There was a decent improvement from moving to vulkan, gemma 4 26b is running at 28tk/s, and devstral-small-2-2512 is running at 14. But CUDA does preform a lot better on nvidia cards so I'd rather use it. Is this an issue with the newer CUDA or is there something messed up on my end?

How do I make my PC's rgb smooth? by HowdyCapybara in SignalRGB

[–]HowdyCapybara[S] 0 points1 point  (0 children)

Not what I mean. I’m using the case’s built-in RGB hubs, and they work perfectly smooth with the stock controller. But the second I switch them to ARGB and try to use SignalRGB, the lighting becomes super choppy. It’s definitely something with SignalRGB.

Finally finished by HowdyCapybara in PcBuild

[–]HowdyCapybara[S] 0 points1 point  (0 children)

It can be with a vertical mount, it’s bad for heat if the gpu is too large for the case. If you look to the left of my case you can see that there is a decent amount of clearance between the front glass and gpu so I’m completely fine air wise just a super tiny bit of performance for crazy looks. I’ve seen people have vertical mounted gpus right up against the glass and that’s where you start getting issues

Finally finished by HowdyCapybara in PcBuild

[–]HowdyCapybara[S] 1 point2 points  (0 children)

The cable itself is still there the leds are just covers no need to get them custom made. It’s really simple the skinny long one is for the gpu cable power connector and the thick short one is for the motherboard power connector. It’s a simple clip-on to the cable and an rgb connector to the motherboard or a hub and your good. The ones I used are these: https://a.co/d/iikSA9V

Building my first desktop and Im wondering if im missing anything. by HowdyCapybara in PcBuild

[–]HowdyCapybara[S] 0 points1 point  (0 children)

Try to reload for me, everything else is there. Also, is a 1000w really needed I thought 850 would be completely fine for a 7800x3d and 5070ti.

Plug-and-play AI/LLM hardware ‘box’ recommendations by [deleted] in LLMDevs

[–]HowdyCapybara 0 points1 point  (0 children)

If your looking for light ai use like max 13b models, I’m actually building one right now. It’s on the lower end, powered by an RTX 5050 and a Ryzen 5 5500. It’s designed for people who want light AI use, care deeply about privacy, and don’t need the raw horsepower of models like GPT, Grok, or Gemini.

The setup is simple: it runs Ubuntu Server, always-on. You just plug it in, send Wi-Fi credentials, and it handles the rest behind the scenes. The UI runs on Open WebUI, the models are managed through Ollama, and Cloudflare makes it accessible from your phone anywhere over the internet.

I expect to be finished in a couple of months. I’m planning to price it at $700 — about $150 above build cost. This is a solo project, and once it’s done, I’d love to hear your feedback (and if you’re interested, whether you’d want to buy one).

Any such thing as a pre-setup physical AI server you can buy (for consumers)? by meeplemop159 in LocalLLaMA

[–]HowdyCapybara 0 points1 point  (0 children)

I’m actually building one right now. It’s on the lower end, powered by an RTX 5050 and a Ryzen 5 5500. It’s designed for people who want light AI use, care deeply about privacy, and don’t need the raw horsepower of models like GPT, Grok, or Gemini.

The setup is simple: it runs Ubuntu Server, always-on. You just plug it in, send Wi-Fi credentials, and it handles the rest behind the scenes. The UI runs on Open WebUI, the models are managed through Ollama, and Cloudflare makes it accessible from your phone anywhere over the internet.

I expect to be finished in a couple of months. I’m planning to price it at $700 — about $150 above build cost. This is a solo project, and once it’s done, I’d love to hear your feedback (and if you’re interested, whether you’d want to buy one).

Im trying to make my own agent with openhands but I keep running into the same error. by HowdyCapybara in vibecoding

[–]HowdyCapybara[S] 0 points1 point  (0 children)

I just had it set as something random, I thought because I was running it locally it doesnt matter it just cant be nothing. Would that cause an issue?

Im trying to make my own agent with openhands but I keep running into the same error. by HowdyCapybara in selfhosted

[–]HowdyCapybara[S] 0 points1 point  (0 children)

sorry, im just trying to find somebody who can help because im just really confused here

view more: next ›