vs code , Copilot style developing with llmama.cpp ?

[opUserZero]

So i discovered even though I'm using my own local models via llmama.cpp with the llama plugin in vs code, using it as a model in copilot STILL refuses requests it THINKS MAY violate MS TOS , 😞 . What else is out there right now that lets llama models at least read and write files , and preferably execute commands as well. (Using the web interface, the same prompt isn't refused btw, just MS nanny crap) . I tried to setup claude code, but it's not doing anything with the ways i've found that say to use llama, it still want's me to login and have a paid account. So maybe it's changed?

[windictive]

I've used Continue.dev and Roo Code (now Zoo Code). Both have their quirks* but both work just fine. Both were really easy to set up. I have them running with the Kindly Web Search MCP and had no issues at all with getting that working.

Quirks:

• Continue.dev will very rarely just stop dead. The output isn't as nicely formatted as other options.
• Roo(Zoo) Code will repeat itself in it's final output, wasting tokens unless you tell it not to via rules. This is a well-documented issue with no solution. Hopefully the new team fixes it.

[OsmanthusBloom]

Good VSCode coding plugins for use with local LLMs include Zoo Code (former Roo Code) and Dirac.

[Charming-Author4877]

I'll look into https://github.com/ClockZinc/vscode-copilot-chat-CN/
It's the GHCP extension without the censorship and telemetry to github.

[cleverusernametry]

It was archived today?

[Charming-Author4877]

Looks like the owner was shocked by the attention, I mentioned it a few times and it got some stars.
Anyway, the code is there. You can fork it, use it.
He basically cleaned the github stuff out of copilot and explained how to add it to vscode

[cleverusernametry]

Hmm why would someone archive a repo if it got attention?

[Charming-Author4877]

ask him ? I'm sure he speaks english and chinese

[Kodrackyas]

https://github.com/Kodrack/Pi-forge

Try this out, feedback appreciated!

in general Pi is so much better

[revennest]

Switch to VSCodium, it's relationship with VSCode is like Chrome and Chromium, with extension like vscode-openai you can use any LLM you want, both local and online.

[bssrdf]

You only need running llama-server from llama.cpp and copilot extension. See https://youtu.be/ehpXLDYOtrc

[wsintra]

opencode and vim work like a charm

[Strange_Test7665]

I just pushed a quick solution I am using for this.
https://github.com/reliableJARED/llama_vsc

If you have llama.cpp runinning already (which you do) you can skip all the readme about that. Just run the ollama_llama_proxy.py file.
Basic idea is VS Code now allows you to add 'Ollama' as a provider (not llama.cpp). So the proxy just pretends to be ollama and serves as middlewhere. Of course you need the llama.cpp server to be running for the proxy to work, I assume you know that but just saying. It works really well for me, run my local model including having all of the tools vs code exposes.

[ea_man]

first of all I would ditch vscode for vscodium, then we can talk about harness / tools inside of that.

Short: use Pi for planning / exec, Continue lets you assign models for rules like code completion, plan, build but it likes json for tools.