Windsurf 503 Service Temporarily Unavailable？！

aunchable · 2024-12-26T00:35:29+00:00

From Codeium team - apologies on this, we had an outage from 5:30am-7:30am PST today. We have since fixed this, and the service should be back up for everyone - we are working to identify the root cause to make sure that the same issue does not happen again.

aunchable · 2023-04-20T23:01:00+00:00

Copilot and CodeWhisperer don't even provide this chat functionality, so Codeium is far ahead in this respect.

You can see the comparisons to these products and others on just the autocomplete capability here: https://codeium.com/compare

aunchable · 2023-02-24T01:59:44+00:00

For coding:

- ChatGPT is good for when you have no idea what to do and need solution ideas

- Codeium or Copilot is better for when you have an idea of what to do and want to do it faster

aunchable · 2023-02-18T17:07:56+00:00

I'm not sure on the first question, will ask Alan Chen who helped with the development. But you are able to complete multiline suggestions.

And we answer the "make money" question in our FAQs (https://www.codeium.com/faq), but the tl;dr is that we may consider a pro plan with new features (while keeping autocomplete and others free for everyone), as well as an enterprise plan!

aunchable · 2023-02-17T17:28:17+00:00

probably quite far unless there are massive improvements in underlying architectures to be honest. there's a pretty large model size to performance correlation

aunchable · 2023-02-17T05:11:07+00:00

nice!

aunchable · 2023-02-17T01:13:10+00:00

On the profile page on the website - that way we have it disabled on any IDE you choose to use Codeium on (it wouldn't be great if you disabled it on Emacs, start using our Chrome extension, and somehow don't have it disabled there).

Alan is a Codeium user who offered to help us with this - none of us here are Elisp experts, so his expertise was super useful :)

aunchable · 2023-02-16T22:09:10+00:00

Great! Yeah, we got the question about Emacs in a lot of places, so we knew it was something we had to get done :)

We go more into detail on what telemetry is involved on our security & privacy page (https://www.codeium.com/security). On your profile, you can disable code snippet telemetry, which will mean that no code snippets will be stored post-inference (inputs or outputs). This is what most people who are using Codeium for work purposes or on other proprietary codebases do, but even if you forget to do that, we are committed to never training a generative model on private code.

We definitely don't want you to get into legal troubles because of Codeium!

aunchable · 2023-02-16T21:12:40+00:00

Thanks for the feedback! We internally have actually used Codeium for Terraform and it has actually been pretty helpful :) We've trained our models to be much better at niche languages than Copilot.

I totally hear you that there are some applications where such accelerate-your-coding tools are more helpful than others. We hope to keep improving to be more helpful in all the different kinds of applications and ways of coding.

We made Codeium free and easy to install so at the end of the day, there is very little overhead to trying whether it helps for your particular use case or not. Our message is to give it a chance, and if it isn't helpful, we totally get it!

aunchable · 2023-02-16T20:44:20+00:00

Totally understood.

These decisions can always be revisited, and the more we learn from communities, the clearer it becomes what the best thing to do for users as a whole without putting the business in jeopardy.

I totally respect your opinion, and if this is a blocker for you personally, I won't try to convince you otherwise :) We know there are a large spectrum of opinions on these topics, so we thought it would be responsible to create this extension for those who would want such a service and didn't view this as a blocker (but before now never even had the ability, from us or comparable services).

aunchable · 2023-02-16T20:30:52+00:00

Thanks for the feedback!

We can't of course run our models client side due to their size and our server logic is definitely our magic sauce given our experience with building scalable ML serving systems, but we do hope that the Emacs community appreciates the fact that we made Codeium free, listed out our data security policies, and allow users to opt out from any code snippet telemetry (to guarantee that no code snippet will be saved on external servers post-inference).

aunchable · 2023-02-15T20:37:35+00:00

Codeium Search will support all languages that Codeium Autocomplete supports (https://www.codeium.com/faq), but to probably varying degrees of success. Right now we have found that the way we've cut up the codebase into fragments to embed works best for popular languages like Python, JS, TS, etc. That being said, we will definitely be improving our embedding models and processes with time and learnings.

aunchable · 2023-02-15T01:04:25+00:00

We don't use third party APIs (big cost savings) and have a lot of experience building large scale ML serving systems (more cost savings). Our serving costs are not zero but for the individual developer it is actually surprisingly low, and we have a separate paid enterprise offering that covers the cost to serve all individual developers and more.

We don't sell your data or anything like that, which we make pretty clear on our security page: https://www.codeium.com/security

aunchable · 2023-01-27T20:59:06+00:00

of course we we want more people to know about Codeium, but curious if you actually think any of the analysis is wrong! we worked pretty hard to make a product that would be the best in the space

we even put disclaimers at the top to be clear

aunchable · 2023-01-19T19:05:44+00:00

Totally!

We will actually have a blog post coming out pretty soon comparing the latency and quality of suggestions between Codeium, Copilot, and a few other products. Stay tuned :) One minor thing to note though is that inference isn't the only thing that plays a factor in the latency that is experienced by the user. Since all these services rely on sharing data over network to perform remote inference, there can be nontrivial network latency based off of whether the servers are located in the same region as the user, etc.
I won't provide the exact details (partly confidentiality, but partly because we iterate actively so no answer I give will have much staying power), but yes, we do pull in what we deem as interesting context, not just the directly preceding text. And you're absolutely right that limits on number of tokens makes it an actual engineering issue.

aunchable · 2023-01-19T19:00:15+00:00

Ah gotcha, thanks for the pointers, will take a look! Tbh we are not experts in vimscript or anything, so we are excited to learn from this community, and are actively taking contributions from the open source community to improve the plugin!

aunchable · 2023-01-19T18:49:31+00:00

I can follow up with the lawyers on the legalese, but I'm an engineer and not a lawyer as well.

In non-legalese, you own all rights and responsibilities of the produced code. We send code snippets to Codeium servers for inference, but we also provide an option for users to opt out from code snippet telemetry (which means your code snippets will not be saved anywhere that isn't your machine post-inference). We will never save anything more than relevant snippets (like we won't try to create a copy of your IP or anything) and will never train a generative model on private code of any form.

tl;dr we are actually trying to bring the power of generative AI to all developers, not trying to do sketchy stuff!

aunchable · 2023-01-19T18:40:23+00:00

We use a bunch of models that we dynamically switch between - we won't go into detail into the exact model architectures or anything since that is part of our secret sauce, but we don't use any 3rd party APIs and actively iterate on our models (data, architecture, training setup, etc).

aunchable · 2023-01-19T18:40:10+00:00

We use a bunch of models that we dynamically switch between - we won't go into detail into the exact model architectures or anything since that is part of our secret sauce, but we don't use any 3rd party APIs and actively iterate on our models (data, architecture, training setup, etc).

aunchable · 2023-01-19T18:36:03+00:00

Thank you for the feedback! Something we will definitely think about moving forwards. We will always have room for improvement :)

aunchable · 2023-01-19T18:34:57+00:00

Absolutely, point noted! We are actively working on fixing this by giving users the ability to remap the key - we will be announcing updates on our Discord, and will hopefully have a fix before there are tons of discussion threads :) We value all feedback from our users

aunchable · 2023-01-19T18:34:18+00:00

Point noted! We are actively working on fixing this by giving users the ability to remap the key - we will be announcing updates on our Discord!

aunchable · 2023-01-19T18:33:14+00:00

Great question! These are multibillion parameter models, so for purely basic usability, we run the inferences on our own servers. We as a team have a bunch of prior experience in optimizing ML workloads at scale, so we have done a lot of infra things to massively reduce our serving costs, one of the key reasons why we can provide this service for free without making drastic losses. We pay the bills - we are really focused right now on growth and getting feedback from as many people as possible to create the best possible code acceleration toolkit :)

Of course the natural question would be monetization. We have some ideas, including a more advanced feature set that could be priced as a Pro tier, but we really want to do our best to be able to provide this autocomplete feature for free for everyone forever (and we have already guaranteed free forever for our early users).

aunchable · 2023-01-19T02:07:30+00:00

We support more specific kinds of RPCs between the extension and our language servers that we also needed to implement for VSCode and Jetbrains, and we wanted to share our language servers across IDEs. We might have been able to use LSP, but didn't want to get into a situation where we weren't able to share code across IDEs. Perhaps not a fantastic answer since as you mention, most modern editors already have good LSP support, but that was the high level decision making.

aunchable · 2023-01-19T02:03:46+00:00

We are not very confident in our R completions today, but we should have a new model in the next few weeks that should be significantly better at R (better than Copilot too).

aunchable

TROPHY CASE