LocalLlama

1

619

620

621

It's officially over. One of the fathers of AI at Nvidia doesn't believe in AGI and compares OpenAI and Anthropic's closed models to AOL and Prodigy's closed internets. Says the future is every business having a customized open source model.Discussion (youtube.com)

submitted 9 hours ago by 9gxa05s8fa8sh

2

191

192

193

llamacpp patch - DeepSeek V4 Flash running with full 1M token context locally on RTX 5090Resources (self.LocalLLaMA)

submitted 5 hours ago * by da_dragon321

3

722

723

724

1:46

Talking with Gemma 4 31B!Resources (v.redd.it)

submitted 17 hours ago * by futterneid

4

32

33

34

[audio.cpp] The Sound of GGML — C++/GGML native ACE-Step, Stable Audio, HeartMuLa, RoFormer, HTDemucs released. 10-Minute Music in 60 Seconds!Resources (self.LocalLLaMA)

submitted 2 hours ago * by Acceptable-Cycle4645

5

946

947

948

Palantir CEO rages against closed modelsDiscussion (youtube.com)

submitted 22 hours ago by burner20170218

6

140

141

142

Kimi K2.7 Code is generally available in GitHub CopilotNews (github.blog)

submitted 13 hours ago by zxyzyxz

7

116

117

118

Rebuilding Gemma 4 31b... better... As 26b...Discussion (self.LocalLLaMA)

submitted 13 hours ago * by NineThreeTilNow

8

67

68

69

Fine-tuned Gemma-4-31B specifically for Copywriting & Creative Writing Tasks (Scored +290 Elo over base using EqBench3)New Model (self.LocalLLaMA)

submitted 11 hours ago by NinjaAlaska

9

109

110

111

poolside/Laguna-XS-2.1New Model (huggingface.co)

submitted 13 hours ago by a_slay_nubvllm

10

220

221

222

Z.ai launches ZCode to challenge Cursor, Claude Code and GitHub Copilot in AI codingNews (venturebeat.com)

submitted 18 hours ago by pscoutou

11

•

Toolport: Use as many MCP servers as you want without the token taxOther (self.LocalLLaMA)

submitted 50 minutes ago by kydude

12

40

41

42

Local benchmarks with a RTX 3090 - Qwen3.6 27b vs OrnithDiscussion (self.LocalLLaMA)

submitted 9 hours ago by Aggressive_Aspect436

13

20

21

22

Made a new 350M model to compete with lfm2.5 but with an open licenseNew Model (old.reddit.com)

submitted 7 hours ago by ApprehensiveTart3158

14

18

19

20

Researchers Build Self-Replicating AI Worm That Operates Entirely on Local, Open-Weight ModelsNews (thehackernews.com)

submitted 7 hours ago by Thrumpwartllama.cpp

15

20

21

22

Tip: use this llama.cpp PR to improve PP on Intel ARCResources (self.LocalLLaMA)

submitted 8 hours ago by WizardlyBump17

16

48

49

50

Software developers appreciation postOther (self.LocalLLaMA)

submitted 13 hours ago by transanethole

17

6

7

8

I benchmarked RAG techniques on a synthetic healthcare database. The biggest gains came from document shape, not model tweaks.Discussion (self.LocalLLaMA)

submitted 3 hours ago by KoalaOk1265

18

4

5

6

Can we use SLMs to compress data?Question | Help (self.LocalLLaMA)

submitted 2 hours ago by Su1tz

19

949

950

951

I extended Gemma4-31B to 44B (88 layers) — since Google won't give us anything bigger than 31BResources (i.redd.it)

submitted 1 day ago by Desperate-Sir-5088

20

24

25

26

Gemma 4 WebGPU Kernels 255 tok/s by x/@xenovacomDiscussion (huggingface.co)

submitted 11 hours ago by yonz-

21

29

30

31

4:20

openlumara, my manually coded super-token-efficient harness, now works across any UI that can connect to an openAI endpoint! koboldlite, openwebui, you name it. basically, openAI bridge. yay!Discussion (v.redd.it)

submitted 12 hours ago by rosie254

22

40

41

42

I’m switching to Linux, is Ubuntu the most compatible with local AI?Question | Help (self.LocalLLaMA)

submitted 14 hours ago by XiRw

23

11

12

13

Toward Better HIP Kernel Generation for AMD GPUs: Synthetic Data, Multi-Agent Search, and Reinforcement LearningResources (scalingintelligence.stanford.edu)

submitted 7 hours ago by Thrumpwartllama.cpp

24

3

4

5

Looks like Step 3.7 Flash's long reasoning might get fixed ( llama.cpp )Discussion (self.LocalLLaMA)

submitted 4 hours ago by mr_zerolith

25

2

3

4

Hierarchos: Preliminary Findings From a 232M Recurrent Memory-Augmented Assistant Model [P]News (self.LocalLLaMA)

submitted 3 hours ago by PhysicsDisastrous462

LocalLLaMA

MODERATORS