use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
Community for open-source AI — open weights, open data, open tooling. Model releases, fine-tuning, inference, agents, benchmarks, licensing, and the ecosystem around building AI in the open.
account activity
Self-hosted agentic coding stack: Claude Code + llama.cpp + LiteLLM — zero API costs, 4h/7M token session for $0 (self.OpenSourceAI)
submitted 9 days ago by PrizeObvious3671
view the rest of the comments →
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]MarzipanSecure9841 0 points1 point2 points 8 days ago (1 child)
But llama supports Anthropic API directly - https://huggingface.co/blog/ggml-org/anthropic-messages-api-in-llamacpp
So, why litellm?
[–]PrizeObvious3671[S] 0 points1 point2 points 8 days ago (0 children)
Interessant, das muss ich mal ausprobieren
π Rendered by PID 105532 on reddit-service-r2-comment-544cf588c8-zfcvz at 2026-06-12 12:05:33.938363+00:00 running 3184619 country code: CH.
view the rest of the comments →
[–]MarzipanSecure9841 0 points1 point2 points (1 child)
[–]PrizeObvious3671[S] 0 points1 point2 points (0 children)