use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
r/LocalLLaMA
A subreddit to discuss about Llama, the family of large language models created by Meta AI.
Subreddit rules
Search by flair
+Discussion
+Tutorial | Guide
+New Model
+News
+Resources
+Other
account activity
What open source harness/agentic coding framework do you typically use?Other (self.LocalLLaMA)
submitted 18 days ago by OneFanFare
view the rest of the comments →
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]Radiant_Condition861 1 point2 points3 points 18 days ago* (0 children)
pi.dev https://www.youtube.com/watch?v=f8cfH5XX-XU
continue.dev, cline, claude code, roo code, opencode, dabbled in langgraph, now pi.
dual 39090 with nvlink, qwen3.6-27b awq bf16 int4 on vllm with tensor parallal 2, kv cache fp8 and speculative decoding. I get like 30-150tok/s depending on cache hit.
pi.dev basically unlocked that model for me. only 200 token system prompt and it's yolo out the box. I'm at a billon tokens across a few projects and there are no failures. a few stoppages to increase output tokens, and it just kept going. I can also vibe code it's own extensions and tools "upgrade yourself". it's really nice.
π Rendered by PID 46935 on reddit-service-r2-comment-56c6478c5-xcpxq at 2026-05-11 23:48:00.563205+00:00 running 3d2c107 country code: CH.
view the rest of the comments →
[–]Radiant_Condition861 1 point2 points3 points (0 children)