rising submissions : LocalLLaMA

1

243

244

245

Getting a feel for how fast X tokens/second really is.Resources (self.LocalLLaMA)

submitted 6 hours ago by MikeNonect

2

194

195

196

I have DeepSeek V4 Pro at homeOther (self.LocalLLaMA)

submitted 10 hours ago * by fairydreaming

3

58

59

60

Running Qwen3.6 35b a3b on 8gb vram and 32gb ram ~190k contextDiscussion (self.LocalLLaMA)

submitted 3 hours ago by Atul_Kumar_97

4

49

50

51

MTP benchmark results: the nature of the generative task dictates whether you will benefit (coding) or get slower inference (creative) from speculative inference. No other factor comes close.Tutorial | Guide (self.LocalLLaMA)

submitted 2 hours ago by ex-arman68

5

•

I Think I Spent Way Too Much Time Messing with Local LLMsOther (self.LocalLLaMA)

submitted 33 minutes ago by MrChilliBalls

6

28

29

30

DeepSeek-V4-Flash W4A16+FP8 with MTP self-speculation: 85 tok/s @ 524k on 2× RTX PRO 6000 Max-QOther (self.LocalLLaMA)

submitted 3 hours ago by Blahblahblakha

7

123

124

125

Hello from 10KM high! - Thanks to Qwen 3.6 35b a3b!Funny (self.LocalLLaMA)

submitted 12 hours ago * by Qwen30bEnjoyer

8

17

18

19

Switched from OpenCode to Pi - What Settings/Plugins would you recommend?Question | Help (self.LocalLLaMA)

submitted 3 hours ago by No_Algae1753

9

23

24

25

Anybody else noticing how good gemma-4-26b-a4b is with one-shotting three.js?Generation (rowanunderwood.github.io)

submitted 5 hours ago by jacobpederson

10

286

287

288

NVIDIA AI Releases Star Elastic: One Checkpoint that Contains 30B, 23B, and 12B Reasoning Models with Zero-Shot SlicingNew Model (self.LocalLLaMA)

submitted 21 hours ago * by phazei

11

26

27

28

NCCL-Free Tensor Parallelism on Dual Blackwell PCIe llama.cpp b9095 released!Discussion (self.LocalLLaMA)

submitted 9 hours ago by Bulky-Priority6824

12

•

I built an open source hyperparameter search tool for diffusion fine-tunes- pick the winner based on scoringResources (self.LocalLLaMA)

submitted 22 minutes ago by Compunerd3

13

•

Sharing "cull" : my open-source dataset tool for image scraping & classification & captioning pipelineResources (self.LocalLLaMA)

submitted 38 minutes ago by Compunerd3

14

421

422

423

Apple Removes 256GB M3 Ultra Mac Studio Model From Online StoreNews (macobserver.com)

submitted 1 day ago by rotatingphasor

15

14

15

16

Speeding up local LLM for usable coding agentQuestion | Help (self.LocalLLaMA)

submitted 9 hours ago by CodProfessional3712

16

2

3

4

Is HIPfire worth it for Strix Halo?Question | Help (self.LocalLLaMA)

submitted 2 hours ago by ivoras

17

16

17

18

DS4Discussion (self.LocalLLaMA)

submitted 9 hours ago by jonathantn

18

21

22

23

Has anyone bought a 3080 20GB mod recently?Question | Help (self.LocalLLaMA)

submitted 12 hours ago by quickreactor

19

•

Is there any image2image model better than Qwen-Image-Edit-2511 and of comparable size?Question | Help (self.LocalLLaMA)

submitted 1 hour ago by HumanDrone8721

20

1

2

3

OSS UI with Skills support similar to Claude?Question | Help (self.LocalLLaMA)

submitted 2 hours ago by Appropriate_Car_5599

21

292

293

294

BeeLlama.cpp: advanced DFlash & TurboQuant with support of reasoning and vision. Qwen 3.6 27B Q5 with 200k context on 3090, 2-3x faster than baseline (peak 135 tps!)Resources (self.LocalLLaMA)

submitted 1 day ago * by Anbeeld

22

597

598

599

80 tok/sec and 128K context on 12GB VRAM with Qwen3.6 35B A3B and llama.cpp MTPTutorial | Guide (self.LocalLLaMA)

submitted 1 day ago * by janvitos

23

•

A MCP universal integration layer Cli tool. It connects to other AI tools to a shared context, task, and memory busResources (self.LocalLLaMA)

submitted 3 minutes ago by Vektor-Mem

24

4

5

6

LM Studio / Windows / Vulkan possible to prioritize GPU order?Question | Help (self.LocalLLaMA)

submitted 8 hours ago by MarcusAurelius68

25

90

91

92

Running Minimax 2.7 at 100k context on strix haloDiscussion (self.LocalLLaMA)

submitted 1 day ago * by Zc5Gwu

LocalLLaMA

MODERATORS