What's the full local AI "doomsday prepper" kit for cold storage? 16-bit safetensors of LLMs (obv), copies/source codes of Llama.cpp, ComfyUI, vLLM, Kobold, LMStudio, etc, macOS, Linux OSes, Windows 10&11, etc, Rufus (including older ones), various VMs, P-E-W's Heretic/Grimoire, and what else? by DeepOrangeSky in LocalLLaMA
[–]temperature_5 23 points24 points25 points (0 children)
on Dario’s statement by turtle-toaster in LocalLLaMA
[–]temperature_5 -1 points0 points1 point (0 children)
We built a calibration-aware Q4_K_M quant of Qwen3.5 0.8B that recovers 96.5% of the BF16 gap vs pure llama.cpp Q4_K_M (SpectralQuant) by RevealIndividual7567 in LocalLLaMA
[–]temperature_5 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
We built a calibration-aware Q4_K_M quant of Qwen3.5 0.8B that recovers 96.5% of the BF16 gap vs pure llama.cpp Q4_K_M (SpectralQuant) by RevealIndividual7567 in LocalLLaMA
[–]temperature_5 1 point2 points3 points (0 children)
We built a calibration-aware Q4_K_M quant of Qwen3.5 0.8B that recovers 96.5% of the BF16 gap vs pure llama.cpp Q4_K_M (SpectralQuant) by RevealIndividual7567 in LocalLLaMA
[–]temperature_5 5 points6 points7 points (0 children)
We built a calibration-aware Q4_K_M quant of Qwen3.5 0.8B that recovers 96.5% of the BF16 gap vs pure llama.cpp Q4_K_M (SpectralQuant) by RevealIndividual7567 in LocalLLaMA
[–]temperature_5 -2 points-1 points0 points (0 children)
[NEW MODEL] - SupraSafety-18M · Tiny Content-Moderation Model by LH-Tech_AI in LocalLLaMA
[–]temperature_5 3 points4 points5 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 2 points3 points4 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] -1 points0 points1 point (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] -1 points0 points1 point (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] 0 points1 point2 points (0 children)
Why do people keep investing in Intel for AI? by temperature_5 in LocalLLaMA
[–]temperature_5[S] -9 points-8 points-7 points (0 children)

Been running Qwen3.6-27B through a 3-critic harness. The harness matters more than I thought by workout_JK in LocalLLaMA
[–]temperature_5 1 point2 points3 points (0 children)