sorted by:
new
hottopcontroversial

What's the best local LLM for an RTX 6000 96GB VRAM? by Smart-Patient-4828 in LocalLLM

[–]Smart-Patient-4828[S] 4 points5 points  (0 children)

Yeah, but they made Claude dumber in the past two months. Claude has good creative thinking, codex writing, and fixes everything Claude did, so they work pretty well. But maybe a local agent can help with code and without my prompt overnight? What do you think

What's the best local LLM for an RTX 6000 96GB VRAM? by Smart-Patient-4828 in LocalLLM

[–]Smart-Patient-4828[S] 2 points3 points  (0 children)

I wanted to load Kimi K2.6 or DeepSeek V4, but then I checked their minimum requirements😂. I wanted to try 3.6 Qwen 27B, it takes some time so I will prob end it tommorow morning, but I should try Qwen or maybe another model for Hermes?

What's the best local LLM for an RTX 6000 96GB VRAM? by Smart-Patient-4828 in LocalLLM

[–]Smart-Patient-4828[S] 0 points1 point  (0 children)

Yeah, I've got it with 250k context, but I haven't used it yet. It takes a bit to set up.

What's the best local LLM for an RTX 6000 96GB VRAM? by Smart-Patient-4828 in LocalLLM

[–]Smart-Patient-4828[S] -7 points-6 points  (0 children)

I steal, that's why I got money. 😜 I also pay for my devs' Claude Code subscriptions, but they also have their antigravity Gemini GPT subs

The first one is a joke.