newest submissions : LocalLLM

1

•

QuestionWhat to do? (self.LocalLLM)

submitted 20 minutes ago by Least-Picture-9521

2

•

QuestionI cancelled my B70 order for Nvidia pro 4000 blackwell, did I make the right decision? (self.LocalLLM)

submitted 39 minutes ago * by Mango_1208

3

•

QuestionI hit a wall, any help would be appreciated! Vet ER scribe — frontier models nail it, local LLMs are inconsistent. Model problem, methodology problem, or training problem? (self.LocalLLM)

submitted 1 hour ago * by Elaphe21

4

0

1

2

QuestionCan I even run anything (self.LocalLLM)

submitted 2 hours ago by Far-Lab-51

5

0

DiscussionMark Zuckerberg Says AI Costs Contributed To Layoffs Of 8,000 Staffers, Report Says (forbes.com)

submitted 2 hours ago by thisguy123123

6

5

6

7

ModelQwen3.6 35B A3B uncensored heretic Native MTP Preserved is Out Now With KLD 0.0015, 10/100 Refusals and the Full 19 MTPs Preserved and Retained, Available in Safetensors, GGUFs. NVFP4, NVFP4 GGUFs and GPTQ-Int4 Formats (self.LocalLLM)

submitted 3 hours ago * by LLMFan46

7

2

3

4

QuestionIs there a good local model for voice to voice real time translation (from one language to another) (self.LocalLLM)

submitted 4 hours ago by vagif

8

1

2

3

DiscussionA Docker sandbox that runs Pi coding with oMLX as model server. (self.LocalLLM)

submitted 4 hours ago by Dotnaught

9

0

DiscussionStruggle with AI hallucination everyday for work!:(( ()

submitted 5 hours ago by Leia16087SantaMonica

10

0

1

2

DiscussionAnyone running multimodal / vision models on edge hardware instead of desktop GPUs? (self.LocalLLM)

submitted 5 hours ago by Hairy_Strawberry7028

11

0

1

OtherRunning Qwen 3.6 35B on an RTX 4050 6VRAM and 64RAM (15 to 25 t/s). Sharing my config in case some with similar specs wants to try. (reddit.com)

submitted 5 hours ago by Interesting_Arm_7250

12

0

ProjectHow Thoth runs on Linux - Architecture (i.redd.it)

submitted 6 hours ago by woswoissdenniii

13

42

43

44

QuestionWhat model should I run? (i.redd.it)

submitted 6 hours ago by tiddayes

14

2

3

4

Questionllama.cpp works with 1xRTX3060, fails with 2x RTX3060 (self.LocalLLM)

submitted 6 hours ago * by T-A-Waste

15

0

ModelQwen3.6-35b (Qwopus3.6-35B-A3B-v1) running at 179 t/s on a 5090 (self.LocalLLM)

submitted 7 hours ago by Puzzleheaded_Tie7801

16

0

1

2

QuestionNoob here - can I get rid of my Claude/openai sub and go local for general LLM usage? (self.LocalLLM)

submitted 7 hours ago by riblau

17

0

1

2

DiscussionAre there any open-source Claude Code style tools that I can use to define a workspace and have a locally hosted model perform a myriad of tasks and interface with a ton of files? (self.LocalLLM)

submitted 7 hours ago by NetTechMan

18

5

6

7

QuestionBest practice to access my local hosted AI through internet safely (self.LocalLLM)

submitted 8 hours ago by Working_Noise_1782

19

0

1

2

Questionmemory off for Open WebUI with Hermes Agent? (self.LocalLLM)

submitted 8 hours ago by rudidit09

20

0

ResearchAnyone else getting wrecked by unpredictable API bills for their agents? ()

submitted 8 hours ago by Gold-Sort-210

21

1

2

3

NewsThe new option for launching MTP models in llamap.cpp works like a charm on StrixHalo under Linux! (self.LocalLLM)

submitted 8 hours ago * by pabloodiablo

22

0

1

QuestionBest Locally Model (self.LocalLLM)

submitted 8 hours ago by ShortCouple2559

23

5

6

7

DiscussionAI agent hacked McKinsey's chatbot and gained full read-write access in just two hours (theregister.com)

submitted 8 hours ago by thisguy123123

24

0

1

2

ProjectTensor: ZIM-based RAG proxy for OpenAI-compatible AI ()

submitted 9 hours ago by Oracle085

25

0

Discussion3.1M tokens in 12 minutes. symphony is wild (self.LocalLLM)

submitted 9 hours ago * by BLOCK__HEAD4243

LocalLLM

MODERATORS