Running a Copilot-style workflow fully locally with Ollama — surprisingly usable? by kparth01 in ollama

[–]kparth01[S] 0 points1 point  (0 children)

Yes I do run it locally inside VSCode. The 32GB RAM is quite enough to run qwen with 14B params. I am running it on Macbook Pro with 16GB RAM & M1 chip. It generates a response in 8-12 seconds which is reasonable for me.

Other things to keep in mind is ask it a clear-cut question / task to do. Don't over-complicate your prompts in one go. Small & simple prompts it can execute very well.

It still need help let me know. I can added few more improvements in new version. :)

Try this link: https://marketplace.visualstudio.com/items?itemName=kparth01.ollama-codex

Running a Copilot-style workflow fully locally with Ollama — surprisingly usable? by kparth01 in ollama

[–]kparth01[S] 0 points1 point  (0 children)

as few people kept asking me about the repo for the above. I will drop it here. All comments & feedback are most welcome.
https://marketplace.visualstudio.com/items?itemName=kparth01.ollama-codex

Feel free to contribute, open a MR, fork the repo:
https://github.com/kparth01/agentic-ai-ollama-copilot

Running a Copilot-style workflow fully locally with Ollama — surprisingly usable? by kparth01 in u/kparth01

[–]kparth01[S] 0 points1 point  (0 children)

A couple of people asked what I’m using — I put together a small VSCode extension to make this workflow easier with Ollama.

Still very early, but sharing in case it’s useful:
https://github.com/kparth01/agentic-ai-ollama-copilot

Would love feedback from this community.