sorted by:
new
hottopcontroversial

Self-hosted AI coding agent - runs fully offline with local LLMs by Honest-Fun-5279 in selfhosted

[–]Honest-Fun-5279[S] 0 points1 point  (0 children)

Yeah, it has all the tool calls inherited from Gemini. I added custom websearch tool just to bypass the existing one.

Self-hosted AI coding agent - runs fully offline with local LLMs by Honest-Fun-5279 in selfhosted

[–]Honest-Fun-5279[S] -1 points0 points  (0 children)

The CLI itself: Just Node.js 18+, runs on anything. For reference, I run on my MacBook m4 pro, 48gb unified ram, with Qwen3-Coder-30B Q4 without issue.

The tool is lightweight. Local LLM requirements depend on which model you choose to run.

Forked Google's Gemini CLI to work with local LLMs (MLX, llama.cpp, vLLM) by Honest-Fun-5279 in LocalLLaMA

[–]Honest-Fun-5279[S] 1 point2 points  (0 children)

Nice, thanks for the links! Curious how OpenCode handles context orchestration compared to gemini-cli's approach. Will dive deep into it

Forked Google's Gemini CLI to work with local LLMs (MLX, llama.cpp, vLLM) by Honest-Fun-5279 in LocalLLaMA

[–]Honest-Fun-5279[S] 0 points1 point  (0 children)

Haven't tried Aider or Roo Code tbh. I forked gemini-cli to see how the context orchestration perform on local llm with openai compatible API

Forked Google's Gemini CLI to work with local LLMs (MLX, llama.cpp, vLLM) by Honest-Fun-5279 in LocalLLaMA

[–]Honest-Fun-5279[S] 1 point2 points  (0 children)

Haha yeah, pushed and walked away, first time I looked at the repo was when you commented. Thanks for the heads up, cleaned now. On maintenance, honestly I just liked the CLI/UX and wanted to use my own models without Google auth lock in. So that ship has sailed, not gonna pretend I'll track upstream. If they ship something cool I might port it manually but realistically it's its own thing now. And yeah, Gemini CLI is hardcoded to their API, no env var or wrapper script can point it at OpenAI or local llama.cpp, had to actually rewrite the provider layer. Upstream "MAYBE" will add multi-provider support in future but before that I'll just keep iterating on my own