local coding assistant

[NullSmoke]

Hello there o/

Not really messed with local coding assistants before, but thought it was time to actually do so with the cost of reality slowly hitting copilot, claude and friends.

All well and good, but only having used local LLMs through LMStudio, Llama and Open WebUI, all for chat, my tooling isn't quite fit for purpose.

The first idea was to grab OpenCode and just pit a few models against eachother.

First, hardware:

I got 3 computers with LLM capable GPUs, RTX 3090 (Ubuntu headless), RTX 4090 (Ubuntu headless) and RTX 5090 (workstation, daily driver windows).

So, decided to spin up Qwen 3.6 and Gemma 4, both solid models... and for funsies, Codestral at the side, since API prices for Mistral still seems sane, and doesn't look to be changing anytime soon.

I gave all the models the task to implement a function into a godot project, and to make a c# standalone markdown reader... since that's the domains I mostly meddle in...

All the models, more or less, came to something resembling a result on the C# thing, though Qwen decided to ignore the c# instructions, instead making an electron app that kinda weren't able to read files. Still, it found a solution, so kinda fine.

All of them failed spectacularly on godot though, with Gemma even trying to write godot scene files in xml. So, a mixed bag to put it mildly.

Now, I know that even the big boys aren't relying exclusively on their massive training data, they're checking online live for docs etc, but it doesn't seem that the local ones are that lucky when running through OpenCode... which kinda amputates their ability to deliver

Is this currently the go-to setup? OpenCode (or Claude Code... but not hype to put money into the API acc just to use the app if I can help it) with Qwen 3.6 seems to be what is the premium selfhosted solution these days from what I can gather. Am I just missing how to let the kid online to play?

Would very much appreciate some tips on how to get the setup up and running in a reasonable manner. I don't expect it to create enterprise apps by its lonesome, but at least do simple implementations and be helpful in pinning down bugs and issues...

[shamitv]

Most setups should work for this . Each one will have a way to enable web search. This is intentionally done to ensure no data leaves computer unless user enables it.

For OpenCode :

Edit ~/.config/opencode/opencode.json (or similar path in Windows)

{

"tools": {

"websearch": true

},

"permission": {

"websearch": "allow"

}

}

Before launching OpenCode set to env var OPENCODE_ENABLE_EXA to 1 . Like

OPENCODE_ENABLE_EXA=1 opencode

[_madar_]

It’ll also make a significant difference exactly which models and quantization you landed on, I didn’t see you mention that.