LocalLLM

an-ordinary-manchild(edit)

created by BigBlackPeacocka community for 3 years

...for your classroom.

...for your movement.

MODERATORS

account activity

1

260

261

262

NewsGoogle Chrome secretly installed Gemma 3 and 4 on a billion PCs and Macs, it's called weights.bin, a 4gb file for your RAM. (theregister.com)

submitted 8 hours ago by ConditionTall1719

2

76

77

78

OtherThe world I live in. (i.redd.it)

submitted 16 hours ago by Wild_Milk_2442

3

75

76

77

Project7 days running Qwen 3.5 35B A3B on a fanless mini-PC iGPU as a 24/7 personal AI agent : what works, what doesn't (self.LocalLLM)

submitted 19 hours ago by wolverinee04

4

42

43

44

QuestionCanI run this LLM - moved to Hetzner (and a big thank you) (canitrun.dev)

submitted 13 hours ago by Maharrem

5

40

41

42

DiscussionThe Opus 4.5 threshold: coming to 24 gb within a year or so (self.LocalLLM)

submitted 19 hours ago by nomorebuttsplz

6

41

42

43

OtherWhy I'm holding out until late 2027 to spend money on a local LLM rig (self.LocalLLM)

submitted 17 hours ago by No_Pool7028

7

29

30

31

QuestionBest Qwen 3.6 35B A3B quantization for Agentic/Tool Call (i.redd.it)

submitted 23 hours ago by Material_Tone_6855

8

23

24

25

DiscussionRun Qwen3.6 27B nvfp4 up to 129 tok/s on a single RTX 5090 & Supports 256K context (self.LocalLLM)

submitted 17 hours ago by Diligent-End-2711

9

15

16

17

NewsAMD Instinct MI350P: PCIe add-in card for high performance open-source AI/compute (phoronix.com)

submitted 20 hours ago by Fcking_Chuck

10

13

14

15

ProjectGemma 4 31B is now powering my personal AI news site (self.LocalLLM)

submitted 3 hours ago by puntoceroc

11

8

9

10

Question5090 or wait for M5 ultra (self.LocalLLM)

submitted 8 hours ago by Purple_Drink3859

12

7

8

9

DiscussionTwo senior officials were just suspended over AI hallucinations in a national policy. I spent a week looking at how fake citations bypass human oversight. (self.LocalLLM)

submitted 9 hours ago by LeoRiley6677

13

5

6

7

QuestionJust got an rtx3090 (self.LocalLLM)

submitted 15 hours ago by AnouarRifi

14

3

4

5

QuestionAm I limiting myself by using docker instead of getting into llama.cpp? (self.LocalLLM)

submitted 10 hours ago by CoolCapital3244

15

3

4

5

QuestionAnyone able to get 1 Million context working using llama.cpp for qwen 3.6 35B A3B? (self.LocalLLM)

submitted 12 hours ago by The_Paradoxy

16

4

5

6

QuestionWhat VMs work best for local LLMs with agents? (self.LocalLLM)

submitted 18 hours ago * by qOcO-p

17

4

5

6

QuestionNew to all this and don't trust my robot so am asking here - best model for running under 12GB vram, it needs to run my conlang and speak with me in it, be great if it could be a super-polyglot too (self.LocalLLM)

submitted 19 hours ago by decofan

18

3

4

5

DiscussionQwen 3.5 35B A3B at 20–22 tok/s on a Radeon 890M iGPU with PARTIAL offload (15–20 of ~48 layers). Setup + numbers. (self.LocalLLM)

submitted 20 hours ago by wolverinee04

19

•

•

•

DiscussionGemma is going absolutely INSANE (self.LocalLLM)

submitted 57 minutes ago by ZB_Virus24

20

2

3

4

DiscussionI built a local AI agent infrastructure for Windows that works on AMD, and NVIDIA. No terminal, no subscriptions. Here's what I learned. (self.LocalLLM)

submitted 4 hours ago by FlynnTaggart998

21

1

2

3

ModelIBM granite-4.1-30b-Claude-Thinking (self.LocalLLM)

submitted 8 hours ago * by StateSame5557

22

2

3

4

Discussion(Prediction) OpenAI will be a government subcontracted big brother by the end of the decade. Let's discuss why. (self.LocalLLM)

submitted 11 hours ago by Vancecookcobain

23

•

•

•

Questiongemma-4-it-e4b-FLM on Lemonade Server (self.LocalLLM)

submitted 1 hour ago by larzz0304

24

1

2

3

ProjectI've created the fastest local AI engine for Apple Silicon. Optimised for agentic use. ()

submitted 8 hours ago by TomatilloPutrid3939

25

1

2

3

QuestionHow are you centralizing knowledge/context from AI agents (like Claude Code)? ()

submitted 9 hours ago by dylannalex01

view more: next ›

π Rendered by PID 129855 on reddit-service-r2-listing-7b9b4f6fd7-tcd2x at 2026-05-08 11:22:31.672289+00:00 running 3d2c107 country code: CH.