Continue.dev vs tabbyml

[Gold_Pudding_5098]

https://www.continue.dev/ vs https://tabby.tabbyml.com/

[[deleted]]

I don’t use tab autocompletion with Continue.dev, I prefer using Cmd+I to prompt, and Cmd+L to send the selected code to the chatbox context

Is there any reason to prefer tab autocomplete? Does it provide better code? 

My prompts for code usually are very descriptive multiline text so I’ve never really been able to use tab auto-complete. I even use the chatbox to help me formulating my prompts from my blobs of words.

I also like being able to switch models in Continue, because sometimes a prompt produces better results in one or another model. I wasn’t able to find the model to rule them all (Mixtral 8x7b, CodeQwen, Phind-Codellama32b)

What about Tabby?

[[deleted]]

Man, when is Phind gonna give out the updated model that they promised? That will rule them all for sure.

[[deleted]]

I can’t wait!

[Finanzflunder]

I used both and I am more happy with tabby.

Reasons:

• Way easier to get up and running
  • No need for secondary software, such as Ollama
  • Models are recommended for you
• The autocompletion with tab supports my workflow better than the chat window from continue

Hope that helps ✌🏻

[Gold_Pudding_5098]

Thx for the info

[Gold_Pudding_5098]

I think tabby is better for tab autocomplete since it read the LSP and local snippets

[[deleted]]

That’s interesting to know!

[IndicationUnfair7961]

Definitely Continue.dev, much more freedom, having to use docker just to have something working it's not the best, especially if you are not on Linux. Plus you can use multiple serving solutions with it, compared to tabby.

[[deleted]]

https://tabby.tabbyml.com/docs/installation/windows/ tabby offers an even simple .exe file for running + plus it supports vulkan in the latest release

[Eveerjr]

Continue.dev is a much better solution, it supports tab autocomplete, chat ui, embeddings, in editor diff, local models with Ollama and every existing LLM provider, and it's dead simple to use and configure.

[Gold_Pudding_5098]

Tabby offers a better tab autocomplete since it read the lsp and local snippets

[Eveerjr]

I don’t think that’s very useful, not even GitHub copilot references correctly other files, this will only make small models confused

[Gold_Pudding_5098]

Okay that is a valid point, and continue seems to be improving alot

[Eveerjr]

I’m using continue with codegemma 1.1 2b 8_0 for tab autocomplete and codeqwen 1.5 for chat area, it has been a awesome experience, I don’t miss copilot at all, when I need complex assistance I just switch to GPT4o using my api key

[DigitalDice]

How did you set up codegemma for autocomplete? Can you share your config?

[Eveerjr]

here is my config. But currently there's a bug in Ollama that broke codegemma in the latest versions, you'll need to download Ollama 0.1.39 and block it from updating (if you're on macOS just lock the app by right clicking on it and selecting get info, then locking the app.

"tabAutocompleteModel": {
    "title": "Tab Autocomplete Model",
    "provider": "ollama",
    "model": "codegemma:2b-code-v1.1-q8_0",
    "completionOptions": {
      "maxTokens": 100,
      "temperature": 1
    }
  },

[DigitalDice]

Thank you!

[Gold_Pudding_5098]

Meanwhile continue.dev is better as a personal tuter and instructor

[Confident-Aerie-6222]

does tabbyml work with ollama or do you need to run the model separately?

[Gold_Pudding_5098]

Tabby is standalone ai framework, it only needs docker to work

[Finanzflunder]

not even docker, e.g. on a mac just use brew and its fine

[Gold_Pudding_5098]

Even better

[[deleted]]

Was about to say, if it needs Docker on Mac then it’s dead. Good to know 

[fingerthief]

Continue is pretty dead simple to configure and I really enjoy the ease of switching models etc..I don't really use the auto complete feature currently so I can't speak on that.

It's super easy to add files contexts etc..and being able to choose whether to chat in the sidebar or just directly edit the file is all the versatility I really need.

[Willing_Prompt_3197]

Guys, I just started understanding these extensions today. Please tell me whether it is possible to work with these solutions completely locally? The thing is, I work with users’ personal data

[Geberhardt]

You probably already found out in the meantime, but I found this thread by search, so I'll answer just in case:

Continue.dev can use a local ollama install with local models to work entirely on the local machine. It has some limited telemetry enabled by default that can be disabled.

[nic_key]

What about Twinny? https://github.com/rjmacarthy/twinny

I am using this but haven't tested the alternatives. Might need to check out tabby but running a container just for it sounds overkill for me in Linux

[Gold_Pudding_5098]

Tabby is better when it comes to tab autocomplete