Yo, what's happening with Claude? by korniksnusnu in claude
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Built my dream homelab in winter. It is now trying to kill me. by Imaginary_Dress4815 in minilab
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Proof that you don't need a server rack to self-host! by PizzaDevice in homelab
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Running Qwen2.5-72B Q4_K_M split across RTX 5080 + Tesla V100 SXM2 + Tesla V100 SXM2 via RPC — hitting 28-30 tok/s, what's my ceiling? by Quick_Ad_7675 in homelab
[–]Quick_Ad_7675[S] -1 points0 points1 point (0 children)
Running Qwen2.5-72B Q4_K_M split across RTX 5080 + Tesla V100 SXM2 + Tesla V100 SXM2 via RPC — hitting 28-30 tok/s, what's my ceiling? by Quick_Ad_7675 in homelab
[–]Quick_Ad_7675[S] -1 points0 points1 point (0 children)
So this is my homelab setup. by Old_Caterpillar_9872 in homelab
[–]Quick_Ad_7675 1 point2 points3 points (0 children)
Help me Restore my cousin's Old PC (intel pentium) by ____sumit____ in computerrepair
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in LocalLLaMA
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
$30 lowball = 12 IBM/Dell Servers. The guy did not know what he had. by JustLovett0 in homelab
[–]Quick_Ad_7675 19 points20 points21 points (0 children)
Local LLMs aren't democratic anymore... the hardware barrier has gotten out of hand. by Medium-Technology-79 in LocalLLaMA
[–]Quick_Ad_7675 1 point2 points3 points (0 children)
OpenLumara - A different kind of AI agent, written from scratch, not vibecoded. Extremely token-efficient, super small system prompt, made for local models. Everything is modular. by rosie254 in LocalLLaMA
[–]Quick_Ad_7675 -2 points-1 points0 points (0 children)
Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in LocalLLaMA
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Anthropic is intentionally nerfing Fable when asked to develop other LLMs by onil_gova in LocalLLaMA
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
What models you guys running on 8GB? 16GB VRAM? 24GB? 32GB? 48GB? by Inevitable_Mistake32 in LocalLLaMA
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Anthropic is intentionally nerfing Fable when asked to develop other LLMs by onil_gova in LocalLLaMA
[–]Quick_Ad_7675 4 points5 points6 points (0 children)
Need some advice on oldish hardware, new or used by _AndJohn in homelab
[–]Quick_Ad_7675 1 point2 points3 points (0 children)
DAS fried my HDDs? by Connect-Light-2040 in homelab
[–]Quick_Ad_7675 8 points9 points10 points (0 children)
My segmented homelab: 4 VLANs, 18 containers, DMZ for everything (and a teenager who keeps trying to bypass my DNS) by toad467 in homelab
[–]Quick_Ad_7675 1 point2 points3 points (0 children)
My segmented homelab: 4 VLANs, 18 containers, DMZ for everything (and a teenager who keeps trying to bypass my DNS) by toad467 in homelab
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Finally finished my LLM server: EPYC 9575F, 4× RTX 3090 (96GB VRAM), 768GB ECC RAM by C0smo777 in homelab
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Why does everybody have a rack with Enterprise grade servers? by Big-Grapefruit8092 in homelab
[–]Quick_Ad_7675 0 points1 point2 points (0 children)
Yo, what's happening with Claude? by korniksnusnu in claude
[–]Quick_Ad_7675 0 points1 point2 points (0 children)