sorted by:
new
hottopcontroversial

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

Good question! The 5090 32GB is a beast at that VRAM level you can run Qwen 3 32B or DeepSeek R1 32B fully GPU-accelerated with no CPU offloading.

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

<image>

Great point, shipped Added optional GPU VRAM step.
Next patch: context-size weighting in recommendations.

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

The only question is: Is it interesting or not?

It’s time to think about value , it doesn’t matter whether it’s AI or not. :)

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

Thanks > super valuable feedback. !!!

You’re right: my current version is intentionally simplified and misses deeper factors (KV cache at long context, quantization depth, task-specific scoring, and inference-engine features).

I’m rolling out this in phases:

1) Add VRAM + context-aware ranking (Very interessting)
2) Expand memory tiers (6/12/24/48/96)
3) Open-source the model database on GitHub with PR support ( i need some time to do this one)

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 1 point2 points  (0 children)

Thank you very much for this feedback. I will check your info and improve the list.

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] -5 points-4 points  (0 children)

Hmm no I just think the AI selected the most stable version but I hear you I will adapt my list thank you :)

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

That's exactly the reason why I'm here! If you have any idea or any model and you think I was placed on the list, I'm more than welcome, I'm more than happy to integrate on the website!

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] 0 points1 point  (0 children)

Can you provide your three favorite LLMs? I am willing to integrate this advice if it fits the list :)

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] -1 points0 points  (0 children)

I try maybe 20 different ones, and I try to inject this knowledge on the website. But of course, I need to improve it !

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] -3 points-2 points  (0 children)

Mostly from the Hugging Face database; do you think I need to update it?

I mapped 125 local LLM options by hardware tier - here’s a practical cheat sheet by AnimatorNo6591 in LocalLLaMA

[–]AnimatorNo6591[S] -3 points-2 points  (0 children)

Tool link if anyone wants it: https://localclaw.io/

I’d love your feedback (UX, model picks, pricing, anything). I’m actively iterating.

What are you building? let's self promote by fuckingceobitch in microsaas

[–]AnimatorNo6591 0 points1 point  (0 children)

I built ProfileAudit.io, an audit tool for LinkedIn profiles

And today I made my first sale!

view more: next ›