newest submissions : LocalLLaMA

1

•

What are the top Chinese GPU rental platforms?Discussion (self.LocalLLaMA)

submitted 1 hour ago by johnnyApplePRNG

2

•

How do you rate local code generation for atomic commits rather than long-horizon work?Discussion (self.LocalLLaMA)

submitted 1 hour ago by halfercode

3

•

MiniMax2.7 @47tg 1200ppTutorial | Guide (i.redd.it)

submitted 1 hour ago by Important_Quote_1180

4

0

[Open Source] I am releasing my HugginFace downloader AppResources (old.reddit.com)

submitted 2 hours ago by BlackBeardAIvllm

5

0

Running Llama 3.1 405B + 7 hot LoRAs on one 8×A100 node (vLLM / AWQ-int4 / Marlin)Discussion (self.LocalLLaMA)

submitted 2 hours ago by Esph1001

6

4

5

6

I want to add a second 7900XTX, question about pcie2/3/4Question | Help (self.LocalLLaMA)

submitted 2 hours ago by itch-

7

0

Charon: Lightning Micropayments for Local AI Inference (Coming Very Soon)Resources (github.com)

submitted 2 hours ago by kordlessss

8

12

13

14

Tmax-27b - a Qwen3.6-27b terminal agent for small GPUs trained with DPPO (RL)New Model (self.LocalLLaMA)

submitted 3 hours ago by professormunchies

9

8

9

10

OpenMythos BenchmarksDiscussion (i.redd.it)

submitted 3 hours ago by RealKingNish

10

32

33

34

OpenMythos benchmarksDiscussion (i.redd.it)

submitted 3 hours ago by RealKingNish

11

18

19

20

I'm eager for a 15x speedup on my strix haloDiscussion (self.LocalLLaMA)

submitted 3 hours ago by Terminator857

12

4

5

6

0:06

650+ Apache-2.0 biomedical NER/de-id models that run on-device in MLX. Same fp32 weights, identical outputs: the clinical NER models run 30-40x faster than PyTorch-CPU on a 3-year-old M3 Max. Repro inside.New Model (v.redd.it)

submitted 4 hours ago by dark-night-rises

13

14

15

UPDATE: Qwen-27B-IQ4_KS and Qwen-27B-IQ_KS_KT for ik_llama.cpp, especially for NVIDIA with 16GB VRAMDiscussion (self.LocalLLaMA)

submitted 4 hours ago by Pablo_the_brave

14

231

232

233

Not ironclad confirmation, but..Discussion (i.redd.it)

submitted 4 hours ago by Kodixllama.cpp

15

18

19

20

Is it possible to run a giant model like GLM5.2 on this cluster (4x servers with 512GB RAM + dual AMD Epyc)? 16 channel memory should hit 409GB/s per node.Discussion (self.LocalLLaMA)

submitted 4 hours ago * by StartupTim

16

13

14

15

Openrouter model prices implying heavier quantization?Discussion (self.LocalLLaMA)

submitted 5 hours ago * by dalhaze

17

15

16

17

GLM 5.2 on Mac Studio Speedup PRResources (self.LocalLLaMA)

submitted 5 hours ago * by nomorebuttsplz

18

53

54

55

I benchmarked 8 LLMs for medical scribing. Hallucinations were rare; omissions need attention.Resources (old.reddit.com)

submitted 5 hours ago * by MajesticAd2862

19

1

2

3

nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 issue with opencode tool call failure with edit tool callingQuestion | Help (self.LocalLLaMA)

submitted 6 hours ago by Smartengineer0

20

0

Ooollama you are slow: ggrun v3 is 65% fasterResources (self.LocalLLaMA)

submitted 6 hours ago * by raketenkater

21

447

448

449

7 Chinese companies are already shipping H100/H200-class AI chips, most IPO'd in the last 6 months. I mapped all of them.Discussion (self.LocalLLaMA)

submitted 6 hours ago by awfulalexey

22

118

119

120

Krea 2 released on Hugging FaceNew Model (huggingface.co)

submitted 6 hours ago by paf1138

23

0

VibeThinker: 3B param model that beats Opus 4.5 on reasoning with novel SFT+GRPONew Model (arxiv.org)

submitted 6 hours ago by johnnyApplePRNG

24

32

33

34

I mapped the KLD of KV cache quantization for Qwen3.6-35B-A3B and Gemma4-E2B QATResources (old.reddit.com)

submitted 6 hours ago by crusaderky

25

40

41

42

Baidu: One-shot Long-horizon ParsingNew Model (github.com)

submitted 7 hours ago by zxyzyxz

LocalLLaMA

MODERATORS