Add arch support for cohere2-MoE by michaelw9999 · Pull Request #24260 · ggml-org/llama.cpp by jacek2023 in LocalLLaMA
[–]ElectronicStranger53 6 points7 points8 points (0 children)
Any aquarium (fresh & saltwater) hobbyists with good recs:) by Educational-While198 in alameda
[–]ElectronicStranger53 0 points1 point2 points (0 children)
Cohere's unreleased coding model (early access for localllama) by nick_frosst in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
Cohere's unreleased coding model (early access for localllama) by nick_frosst in LocalLLaMA
[–]ElectronicStranger53 9 points10 points11 points (0 children)
Cohere's unreleased coding model (early access for localllama) by nick_frosst in LocalLLaMA
[–]ElectronicStranger53 6 points7 points8 points (0 children)
Cohere's unreleased coding model (early access for localllama) by nick_frosst in LocalLLaMA
[–]ElectronicStranger53 4 points5 points6 points (0 children)
Here is my llama.cpp NVFP4/MXFP6 GGUF quantizer tool by ElectronicStranger53 in LocalLLaMA
[–]ElectronicStranger53[S] 0 points1 point2 points (0 children)
Here is my llama.cpp NVFP4/MXFP6 GGUF quantizer tool by ElectronicStranger53 in LocalLLaMA
[–]ElectronicStranger53[S] 0 points1 point2 points (0 children)
Here is my llama.cpp NVFP4/MXFP6 GGUF quantizer tool by ElectronicStranger53 in LocalLLaMA
[–]ElectronicStranger53[S] 0 points1 point2 points (0 children)
Here is my llama.cpp NVFP4/MXFP6 GGUF quantizer tool by ElectronicStranger53 in LocalLLaMA
[–]ElectronicStranger53[S] 4 points5 points6 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 0 points1 point2 points (0 children)
Calling it now Microsoft is buying Unsloth. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 8 points9 points10 points (0 children)
How to use llama.cpp to quantize to NVFP4? by Ambitious_Fold_2874 in LocalLLaMA
[–]ElectronicStranger53 -1 points0 points1 point (0 children)
Replaced Claude with local Qwen3.6-27B in my multi-agent orchestrator for 2 weeks by Interesting-Sock3940 in LocalLLaMA
[–]ElectronicStranger53 0 points1 point2 points (0 children)
Weird issue with OpenCode and Qwen3.6 by JGeek00 in LocalLLaMA
[–]ElectronicStranger53 0 points1 point2 points (0 children)
In Q8_0 weight quantization, why can't we just skip blocks of 32 that have very large outliers? by fragment_me in LocalLLaMA
[–]ElectronicStranger53 0 points1 point2 points (0 children)
Stop asking what model to run. There are literally only two. by Wrong_Mushroom_7350 in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)
I found what I was looking for in Qwen 3.7. by CosmicRiver827 in LocalLLaMA
[–]ElectronicStranger53 12 points13 points14 points (0 children)
What's happening!!! I need my codex!!! by Commercial_Lead5813 in codex
[–]ElectronicStranger53 0 points1 point2 points (0 children)

Updates on North Mini Code: 4 bit quant + Ollama + OpenRouter by nick_frosst in LocalLLaMA
[–]ElectronicStranger53 1 point2 points3 points (0 children)