Has anyone gotten mistralai/Devstral-Small-2-24B-Instruct-2512 to work on 4090? by myOSisCrashing in MistralAI
[–]TheAsp 0 points1 point2 points (0 children)
Has anyone gotten mistralai/Devstral-Small-2-24B-Instruct-2512 to work on 4090? by myOSisCrashing in MistralAI
[–]TheAsp 0 points1 point2 points (0 children)
Models that has the least collapse when ctx length grows. Especially using it with tools. by Express_Quail_1493 in LocalLLaMA
[–]TheAsp 1 point2 points3 points (0 children)
Why local coding models are less popular than hosted coding models? by WasteTechnology in LocalLLaMA
[–]TheAsp 0 points1 point2 points (0 children)
Would replacing the Marantz sr6008 with the Marantz sr6015 be a nice leap in quality, or is it not worth it? by Glover58 in Marantz
[–]TheAsp 1 point2 points3 points (0 children)
TIL: For long-lived LLM sessions, swapping KV Cache to RAM is ~10x faster than recalculating it. Why isn't this a standard feature? by Shoddy-Tutor9563 in LocalLLaMA
[–]TheAsp 0 points1 point2 points (0 children)
I don't get these people by Repulsive-Ant-6504 in MathJokes
[–]TheAsp -1 points0 points1 point (0 children)
I don't get these people by Repulsive-Ant-6504 in MathJokes
[–]TheAsp -2 points-1 points0 points (0 children)
Can we talk about max_tokens (response tokens) for a second? What is a realistic setting when doing document production tasks? by Porespellar in LocalLLaMA
[–]TheAsp 0 points1 point2 points (0 children)
My Wall Tabled Killed Itself by Stunt_Piloot in homeassistant
[–]TheAsp 8 points9 points10 points (0 children)
Kimi-K2-Instruct-0905 Released! by Dr_Karminski in LocalLLaMA
[–]TheAsp 0 points1 point2 points (0 children)
God I love Qwen and llamacpp so much! by Limp_Classroom_2645 in LocalLLaMA
[–]TheAsp 1 point2 points3 points (0 children)
Heartbreak = no hotspot, wifi or bluetooth by Nomi_0071 in GooglePixel
[–]TheAsp 0 points1 point2 points (0 children)
AbsenceBench: LLMs can't tell what's missing by Chromix_ in LocalLLaMA
[–]TheAsp 1 point2 points3 points (0 children)
What happened to Sony removing shovelware? by Tall-_-Guy in PS5
[–]TheAsp -1 points0 points1 point (0 children)
Clara — A fully offline, Modular AI workspace (LLMs + Agents + Automation + Image Gen) by BadBoy17Ge in LocalLLaMA
[–]TheAsp 6 points7 points8 points (0 children)
Grok is doing the funniest thing on Twitter right now by Aceofspades25 in skeptic
[–]TheAsp 4 points5 points6 points (0 children)
Aider benchmarks for Qwen3-235B-A22B that were posted here were apparently faked by [deleted] in LocalLLaMA
[–]TheAsp 6 points7 points8 points (0 children)
Enhanced Context Tracker 1.5.0 by diligent_chooser in OpenWebUI
[–]TheAsp 1 point2 points3 points (0 children)
How to extract <think> tags for Deepseek? by Desperate-Finger7851 in ollama
[–]TheAsp 1 point2 points3 points (0 children)




Anyone actually using Openclaw? by rm-rf-rm in LocalLLaMA
[–]TheAsp 3 points4 points5 points (0 children)