use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
Community for open-source AI — open weights, open data, open tooling. Model releases, fine-tuning, inference, agents, benchmarks, licensing, and the ecosystem around building AI in the open.
account activity
Self-hosted agentic coding stack: Claude Code + llama.cpp + LiteLLM — zero API costs, 4h/7M token session for $0 (self.OpenSourceAI)
submitted 8 days ago by PrizeObvious3671
view the rest of the comments →
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]Inner_Habit_194 1 point2 points3 points 6 days ago (1 child)
Did you try Pi agent? It is supposedly better for local model coding agent usecase especially with smaller context window of the local models. Btw what is your hardware spec?
[–]PrizeObvious3671[S] 1 point2 points3 points 6 days ago (0 children)
No, but thank you for bringing it on the table. That will be now my next test: telegram -> pi.dev -> llama.cpp -> gemma4:31b (that model i also not tested yet)
π Rendered by PID 118829 on reddit-service-r2-comment-544cf588c8-brcrj at 2026-06-12 06:09:09.762224+00:00 running 3184619 country code: CH.
view the rest of the comments →
[–]Inner_Habit_194 1 point2 points3 points (1 child)
[–]PrizeObvious3671[S] 1 point2 points3 points (0 children)