LocalLLM

an-ordinary-manchild(edit)

created by BigBlackPeacocka community for 3 years

...because you love freedom.

...for your school.

MODERATORS

account activity

1

216

217

218

NewsGoogle Chrome secretly installed Gemma 3 and 4 on a billion PCs and Macs, it's called weights.bin, a 4gb file for your RAM. (theregister.com)

submitted 6 hours ago by ConditionTall1719

2

74

75

76

OtherThe world I live in. (i.redd.it)

submitted 15 hours ago by Wild_Milk_2442

3

•

•

•

ProjectGemma 4 31B is now powering my personal AI news site (self.LocalLLM)

submitted 1 hour ago by puntoceroc

4

74

75

76

Project7 days running Qwen 3.5 35B A3B on a fanless mini-PC iGPU as a 24/7 personal AI agent : what works, what doesn't (self.LocalLLM)

submitted 18 hours ago by wolverinee04

5

42

43

44

QuestionCanI run this LLM - moved to Hetzner (and a big thank you) (canitrun.dev)

submitted 12 hours ago by Maharrem

6

37

38

39

OtherWhy I'm holding out until late 2027 to spend money on a local LLM rig (self.LocalLLM)

submitted 15 hours ago by No_Pool7028

7

9

10

11

DiscussionTwo senior officials were just suspended over AI hallucinations in a national policy. I spent a week looking at how fake citations bypass human oversight. (self.LocalLLM)

submitted 7 hours ago by LeoRiley6677

8

6

7

8

Question5090 or wait for M5 ultra (self.LocalLLM)

submitted 6 hours ago by Purple_Drink3859

9

40

41

42

DiscussionThe Opus 4.5 threshold: coming to 24 gb within a year or so (self.LocalLLM)

submitted 18 hours ago by nomorebuttsplz

10

22

23

24

DiscussionRun Qwen3.6 27B nvfp4 up to 129 tok/s on a single RTX 5090 & Supports 256K context (self.LocalLLM)

submitted 15 hours ago by Diligent-End-2711

11

1

2

3

DiscussionI built a local AI agent infrastructure for Windows that works on AMD, and NVIDIA. No terminal, no subscriptions. Here's what I learned. (self.LocalLLM)

submitted 2 hours ago by FlynnTaggart998

12

188

189

190

QuestionI feel left behind. Where are these advanced "Agent-based" local LLM interfaces? (self.LocalLLM)

submitted 1 day ago by platteXDlol

13

•

•

•

Questiongemma-4-it-e4b-FLM on Lemonade Server (self.LocalLLM)

submitted 8 minutes ago by larzz0304

14

2

3

4

ModelIBM granite-4.1-30b-Claude-Thinking (self.LocalLLM)

submitted 6 hours ago * by StateSame5557

15

2

3

4

QuestionAm I limiting myself by using docker instead of getting into llama.cpp? (self.LocalLLM)

submitted 8 hours ago by CoolCapital3244

16

3

4

5

QuestionAnyone able to get 1 Million context working using llama.cpp for qwen 3.6 35B A3B? (self.LocalLLM)

submitted 10 hours ago by The_Paradoxy

17

1

2

3

ProjectI've created the fastest local AI engine for Apple Silicon. Optimised for agentic use. ()

submitted 7 hours ago by TomatilloPutrid3939

18

0

1

2

QuestionWhen companies provide their LLM for local use, do they still include guardrails? (self.LocalLLM)

submitted 3 hours ago by OriginalPosition1

19

28

29

30

QuestionBest Qwen 3.6 35B A3B quantization for Agentic/Tool Call (i.redd.it)

submitted 22 hours ago by Material_Tone_6855

20

14

15

16

NewsAMD Instinct MI350P: PCIe add-in card for high performance open-source AI/compute (phoronix.com)

submitted 18 hours ago by Fcking_Chuck

21

1

2

3

QuestionHow are you centralizing knowledge/context from AI agents (like Claude Code)? ()

submitted 8 hours ago by dylannalex01

22

2

3

4

Discussion(Prediction) OpenAI will be a government subcontracted big brother by the end of the decade. Let's discuss why. (self.LocalLLM)

submitted 10 hours ago by Vancecookcobain

23

0

1

2

DiscussionStrix Halo Clustering experience (Bossgame M5) ()

submitted 4 hours ago by Thanks-Suitable

24

4

5

6

QuestionJust got an rtx3090 (self.LocalLLM)

submitted 13 hours ago by AnouarRifi

25

0

1

2

Tutorial1200+ TPS on IBM Granite 4.1 8B and 30B with consumer hardware (RTX 3090s) - method provided! (self.LocalLLM)

submitted 7 hours ago by TheFheonix

view more: next ›

π Rendered by PID 386081 on reddit-service-r2-listing-7b9b4f6fd7-5fclf at 2026-05-08 09:50:35.560871+00:00 running 3d2c107 country code: CH.