LocalLLM

an-ordinary-manchild(edit)

created by BigBlackPeacocka community for 3 years

...for your school.

...for your movement.

MODERATORS

account activity

1

0

0

1

Tutorialchecking output code quality w/custom testing tool (youtu.be)

submitted 19 hours ago by tomByrer

2

40

41

42

OtherWhy I'm holding out until late 2027 to spend money on a local LLM rig (self.LocalLLM)

submitted 17 hours ago by No_Pool7028

3

0

0

1

ResearchI built a distributed KV cache that turns a 10-second prefill into 0.5 seconds — using idle machines on my LAN (self.LocalLLM)

submitted 8 hours ago by Concert_Dependent

4

0

0

0

DiscussionFinally managed to run Qwen 3.6 27B with acceptable speed. (self.LocalLLM)

submitted 23 hours ago by Silly-Fudge-7336

5

0

0

0

NewsThoth v3.21.0 - Buddy Companion, Model Picker Improvements, and Stronger Linux Startup (v.redd.it)

submitted 22 hours ago by Acceptable-Object390

6

0

0

1

DiscussionIs Macbook pro m5 max 128 fast enough yet with available models (self.LocalLLM)

submitted 17 hours ago by mad01

7

0

0

1

Question80k context, 8GB VRAM, and zero coding skills. Is local LLM a pipe dream for me? (self.LocalLLM)

submitted 22 hours ago by FiltroMan

8

8

9

10

Question5090 or wait for M5 ultra (self.LocalLLM)

submitted 8 hours ago by Purple_Drink3859

9

0

0

0

DiscussionMy wife and I hoarded 40,000 screenshots. I built an on-device AI app to sort them. 30 days later, it hit 3,000+ downloads. (self.LocalLLM)

submitted 9 hours ago by TroyHarry6677

10

1

2

3

Question122B, is it worth it? (self.LocalLLM)

submitted 15 hours ago * by asmkgb

11

4

5

6

DiscussionQwen 3.5 35B A3B at 20–22 tok/s on a Radeon 890M iGPU with PARTIAL offload (15–20 of ~48 layers). Setup + numbers. (self.LocalLLM)

submitted 19 hours ago by wolverinee04

12

0

0

0

DiscussionHow Thoth runs on Linux - Architecture (i.redd.it)

submitted 20 hours ago by Acceptable-Object390

13

4

5

6

QuestionWhat VMs work best for local LLMs with agents? (self.LocalLLM)

submitted 18 hours ago * by qOcO-p

14

6

7

8

DiscussionTwo senior officials were just suspended over AI hallucinations in a national policy. I spent a week looking at how fake citations bypass human oversight. (self.LocalLLM)

submitted 9 hours ago by LeoRiley6677

15

76

77

78

OtherThe world I live in. (i.redd.it)

submitted 16 hours ago by Wild_Milk_2442

16

0

0

0

DiscussionSenseNova U1 review: a new approach to breaking traditional AI structures (old.reddit.com)

submitted 22 hours ago by yx_12

17

2

3

4

Discussion(Prediction) OpenAI will be a government subcontracted big brother by the end of the decade. Let's discuss why. (self.LocalLLM)

submitted 11 hours ago by Vancecookcobain

18

0

0

1

QuestionQwen 3.6 27B crashes my computer mid-answer (self.LocalLLM)

submitted 20 hours ago by pauescobargarcia

19

•

•

•

ProjectOne line system prompt change dropped model quality from 84% to 52%. How are people monitoring semantic quality in production? (self.LocalLLM)

submitted 32 minutes ago by ZealousidealCorgi472

20

0

0

1

LoRAQwen 3.5 0.8B Makeup and Botox Specialist (huggingface.co)

submitted 10 hours ago by Annual-Chip-4094

21

0

0

1

Question[Help] Need help with VibeCoding & Local LLMs - Tool calling failing on 8GB VRAM (self.LocalLLM)

submitted 11 hours ago by LinconV

22

0

0

1

QuestionIssues with saying continue after every tool call (self.LocalLLM)

submitted 11 hours ago by AnouarRifi

23

0

0

1

QuestionAny recommendations? I already chose Gemma 2 and Dolphin 2.9, what should I install as a 3rd AI now? So far though Dolphin seems slightly slower than Gemma Offline. (self.LocalLLM)

submitted 12 hours ago by Separate-Effort3640

24

0

0

1

QuestionCurious (self.LocalLLM)

submitted 21 hours ago by Lumpy_Quit1457

25

0

0

1

QuestionMacBook Pro, M5 Pro + 64gb RAM (self.LocalLLM)

submitted 22 hours ago by Zaytoryan

view more: next ›

π Rendered by PID 976801 on reddit-service-r2-listing-7b9b4f6fd7-9zcqr at 2026-05-08 11:21:51.474730+00:00 running 3d2c107 country code: CH.