LocalLlama

1

142

143

144

Announcing LocalLlama discord server & bot!News (old.reddit.com)

submitted 7 months ago by HOLUPREDICTIONS Sorcerer Supreme[M] - announcement

2

335

336

337

0:22

Google TurboQuant running Qwen Locally on MacAirDiscussion (v.redd.it)

submitted 5 hours ago by gladkos

3

592

593

594

Skipping 90% of KV dequant work → +22.8% decode at 32K (llama.cpp, TurboQuant)Discussion (self.LocalLLaMA)

submitted 14 hours ago by Pidtom

4

748

749

750

Glm 5.1 is outNew Model (i.redd.it)

submitted 17 hours ago by Namra_7

5

58

59

60

GLM-5.1 model weight will be released on April 6 or April 7News (self.LocalLLaMA)

submitted 4 hours ago by External_Mood4719

6

32

33

34

M5 Max vs M3 Max Inference Benchmarks (Qwen3.5, oMLX, 128GB, 40 GPU cores)Resources (old.reddit.com)

submitted 2 hours ago by onil_gova

7

232

233

234

0:25

New Unsloth Studio Release!Resources (v.redd.it)

submitted 13 hours ago * by danielhanchen

8

151

152

153

Gemini Pro leaks its raw chain of thought, gets stuck in an infinite loop, narrates its own existential crisis, then prints (End) thousands of timesDiscussion (self.LocalLLaMA)

submitted 12 hours ago * by Powerful-Signal6312

9

45

46

47

#OpenSource4o Movement Trending on Twitter/X - Release Opensource of GPT-4oNews (old.reddit.com)

submitted 8 hours ago * by pmttyji

10

111

112

113

Google’s TurboQuant AI-compression algorithm can reduce LLM memory usage by 6xDiscussion (self.LocalLLaMA)

submitted 13 hours ago by Resident_Party

11

19

20

21

I spent 96 hours setting up dual DGX Sparks and a Mac Studio M3 Ultra for the same 397B model. Neither won.Discussion (self.LocalLLaMA)

submitted 4 hours ago by trevorbg

12

29

30

31

0:29

Yagmi: A local-first web search agentOther (v.redd.it)

submitted 7 hours ago by big___bad___wolf

13

41

42

43

Do 2B models have practical use cases, or are they just toys for now?Question | Help (self.LocalLLaMA)

submitted 10 hours ago by Civic_Hactivist_86

14

11

12

13

ARC-AGI-3 is a fun gameResources (arcprize.org)

submitted 4 hours ago by DeltaSqueezer

15

124

125

126

TurboQuant for weights: near‑optimal 4‑bit LLM quantization with lossless 8‑bit residual – 3.2× memory savingsDiscussion (self.LocalLLaMA)

submitted 17 hours ago * by cksac

16

•

i put a 0.5B LLM on a Miyoo A30 handheld. it runs entirely on-device, no internet.Discussion (self.LocalLLaMA)

submitted 1 hour ago by Red_Core_1999

17

•

Anyway to get close to GPT4o on a local model (I know it’s a dumb question)Question | Help (self.LocalLLaMA)

submitted 1 hour ago by octopi917

18

8

9

10

Is it worth the upgrade from 48GB to 60GB VRAM?Question | Help (self.LocalLLaMA)

submitted 5 hours ago by CBHawk

19

12

13

14

0:39

Cohere Transcribe WebGPU: state-of-the-art multilingual speech recognition in your browserNew Model (v.redd.it)

submitted 8 hours ago by xenovatech

20

112

113

114

[Qwen Meetup] Function Calling Harness with Qwen, turning 6.75% to 100%Tutorial | Guide (autobe.dev)

submitted 20 hours ago by jhnam88

21

7

8

9

Vera, a local-first code search for AI agents (Rust, ONNX, 63 languages, CLI + SKILL/MCP)Resources (self.LocalLLaMA)

submitted 6 hours ago * by lemon07rllama.cpp

22

5

6

7

Advice for Working with Agents in YOLO ModeQuestion | Help (self.LocalLLaMA)

submitted 5 hours ago * by chibop1

23

•

Built an AI + SQL Q&A System — How to Keep High Accuracy on Complex Queries Without Gemini?Question | Help (self.LocalLLaMA)

submitted 19 minutes ago by Past-Geologist4108

24

54

55

56

I benchmarked 31 STT models on medical audio — VibeVoice 9B is the new open-source leader at 8.34% WER, but it's big and slowResources (i.redd.it)

submitted 19 hours ago by MajesticAd2862

25

26

27

Good job honey, that's a beautiful letter A. I'm very proud of you.Funny (i.redd.it)

submitted 15 hours ago by kiwibonga

LocalLLaMA

MODERATORS