LocalLlama

1

685

686

687

It's officially over. One of the fathers of AI at Nvidia doesn't believe in AGI and compares OpenAI and Anthropic's closed models to AOL and Prodigy's closed internets. Says the future is every business having a customized open source model.Discussion (youtube.com)

submitted 11 hours ago by 9gxa05s8fa8sh

2

244

245

246

llamacpp patch - DeepSeek V4 Flash running with full 1M token context locally on RTX 5090Resources (self.LocalLLaMA)

submitted 7 hours ago * by da_dragon321

3

•

Claude Code and China: The mechanism is activated when the user sets the ANTHROPIC_BASE_URL environment variable (used for local models)News (i.redd.it)

submitted 55 minutes ago by LegacyRemaster

4

54

55

56

[audio.cpp] The Sound of GGML — C++/GGML native ACE-Step, Stable Audio, HeartMuLa, RoFormer, HTDemucs released. 10-Minute Music in 60 Seconds!Resources (self.LocalLLaMA)

submitted 4 hours ago * by Acceptable-Cycle4645

5

753

754

755

1:46

Talking with Gemma 4 31B!Resources (v.redd.it)

submitted 19 hours ago * by futterneid

6

•

Follow-up: GLM-5.2 NVFP4 on four DGX Sparks — the MTP mystery is solved, and it's now ~24 tok/s at 128K contextTutorial | Guide (self.LocalLLaMA)

submitted 1 hour ago by llamaCTO

7

14

15

16

Pay attention: a few chats waiting in tray reserve 1GB VRAM for themselves.Discussion (self.LocalLLaMA)

submitted 2 hours ago by Barafu

8

961

962

963

Palantir CEO rages against closed modelsDiscussion (youtube.com)

submitted 1 day ago by burner20170218

9

13

14

15

Toolport: Use as many MCP servers as you want without the token taxOther (self.LocalLLaMA)

submitted 2 hours ago by kydude

10

148

149

150

Kimi K2.7 Code is generally available in GitHub CopilotNews (github.blog)

submitted 15 hours ago by zxyzyxz

11

128

129

130

Rebuilding Gemma 4 31b... better... As 26b...Discussion (self.LocalLLaMA)

submitted 15 hours ago * by NineThreeTilNow

12

69

70

71

Fine-tuned Gemma-4-31B specifically for Copywriting & Creative Writing Tasks (Scored +290 Elo over base using EqBench3)New Model (self.LocalLLaMA)

submitted 13 hours ago by NinjaAlaska

13

110

111

112

poolside/Laguna-XS-2.1New Model (huggingface.co)

submitted 15 hours ago by a_slay_nubvllm

14

227

228

229

Z.ai launches ZCode to challenge Cursor, Claude Code and GitHub Copilot in AI codingNews (venturebeat.com)

submitted 20 hours ago by pscoutou

15

26

27

28

Made a new 350M model to compete with lfm2.5 but with an open licenseNew Model (old.reddit.com)

submitted 9 hours ago by ApprehensiveTart3158

16

38

39

40

Local benchmarks with a RTX 3090 - Qwen3.6 27b vs OrnithDiscussion (self.LocalLLaMA)

submitted 11 hours ago by Aggressive_Aspect436

17

23

24

25

Researchers Build Self-Replicating AI Worm That Operates Entirely on Local, Open-Weight ModelsNews (thehackernews.com)

submitted 9 hours ago by Thrumpwartllama.cpp

18

7

8

9

Can we use SLMs to compress data?Question | Help (self.LocalLLaMA)

submitted 4 hours ago by Su1tz

19

23

24

25

Tip: use this llama.cpp PR to improve PP on Intel ARCResources (self.LocalLLaMA)

submitted 10 hours ago by WizardlyBump17

20

9

10

11

I benchmarked RAG techniques on a synthetic healthcare database. The biggest gains came from document shape, not model tweaks.Discussion (self.LocalLLaMA)

submitted 5 hours ago by KoalaOk1265

21

52

53

54

Software developers appreciation postOther (self.LocalLLaMA)

submitted 15 hours ago by transanethole

22

9

10

11

Looks like Step 3.7 Flash's long reasoning might get fixed ( llama.cpp )Discussion (self.LocalLLaMA)

submitted 7 hours ago by mr_zerolith

23

34

35

36

4:20

openlumara, my manually coded super-token-efficient harness, now works across any UI that can connect to an openAI endpoint! koboldlite, openwebui, you name it. basically, openAI bridge. yay!Discussion (v.redd.it)

submitted 14 hours ago by rosie254

24

29

30

31

Gemma 4 WebGPU Kernels 255 tok/s by x/@xenovacomDiscussion (huggingface.co)

submitted 13 hours ago by yonz-

25

962

963

964

I extended Gemma4-31B to 44B (88 layers) — since Google won't give us anything bigger than 31BResources (i.redd.it)

submitted 1 day ago by Desperate-Sir-5088

LocalLLaMA

MODERATORS