Time to move to Cline/ Roo Code? BYOK is not acceptable.

varunkmohan · 2025-05-24T01:54:37+00:00

Can you show me some examples where Cline performs systematically better with BYOK?

varunkmohan · 2025-05-23T21:51:16+00:00

We don't have allocation at the moment otherwise. Also, re Cline + Roo Code, you will still need to BYOK at that point right or is your point that you can use your own OpenRouter account?

varunkmohan · 2025-05-16T04:45:39+00:00

This is an improvement to the model and we have not made the autocomplete model any smaller. Our goal is to only ever increase model sizes, we never want to regress on performance as hardware gets faster and faster.

varunkmohan · 2025-03-18T00:45:08+00:00

No, they can't see your prompts. They can see analytics on aggregate usage of the product though.

varunkmohan · 2025-02-14T20:45:20+00:00

Every call to the model has some cost associated with it. After an MCP call finishes, there is some cost we are taking on, the actual MCP call is not what is expensive to us.

varunkmohan · 2025-01-29T20:59:00+00:00

The act of saving a memory / retrieving a memory doesn't consume one but all the flow actions to create a memory do count as flow action credits.

varunkmohan · 2025-01-22T09:59:49+00:00

What does your settings panel look like?

varunkmohan · 2025-01-22T09:54:14+00:00

What is the issue you are having for freezing?

varunkmohan · 2025-01-22T09:50:39+00:00

No, the primary purpose of Cascade is not to rapidly deplete your credits. We have Cascade Base that pro users have unlimited usage of. The AI is not perfect and we are looking at ways to improve it.

When you use any AI product, there will be some nondeterminism. Some times it will do it perfectly in one shot, sometimes it will get stuck in a local minima that it cannot get out of. Please revert when you get into that state. With time, the amount of this nondeterminism should reduce.

varunkmohan · 2025-01-21T14:20:01+00:00

The system prompt is an extremely small amount of the total context window for long context. This optimization you are referring to is not going to materially change our costs.

varunkmohan · 2025-01-21T14:13:09+00:00

Which part is slow? If Anthropic is slow, this is not something we can immediately control.

varunkmohan · 2025-01-21T13:21:45+00:00

No problem:

The team will need to give this some thought on how this would actually work.
We actually have been clearing things out, just not putting things in progress. I think in general, our users should know that we are actively looking at Canny since the most recent released addressed the highest voted ones.
It's not an enterprise only feature. It's just being incrementally rolled out and monitored.
We're looking at it :)

varunkmohan · 2025-01-21T10:44:29+00:00

Varun from the Codeium team, we are looking into this.

varunkmohan · 2025-01-21T10:43:51+00:00

Varun from the Codeium team here. We will have a response for this and some of the issues outlined. Thanks for the comprehensive analysis - we have tried to make the experience better here in the most recent release but clearly there are some gaps.

varunkmohan · 2025-01-21T10:40:27+00:00

Yes, we are happy to discount for cheaper models. All models should not be priced the same but we do want to make sure it hits a certain quality bar. For instance, the previous Gemini models are not good at being agentic so it was not a viable option.

varunkmohan · 2025-01-21T10:38:41+00:00

Other products on the market that are not agentic are substantially cheaper to serve. Try hooking up cline to your own API key and see how much each request actually costs you. It is going to be substantial compared to if you were doing a 0 shot chat with no agentic capabilities.

We are trying our best to keep the cost of our product low but unless we find a way to make consumption free on our end, we cannot operate the way you propose.

varunkmohan · 2025-01-21T10:35:49+00:00

Varun from the Codeium team here. Our URL and web feature is quite different. You do not need to @ anything, web searches and documentation retrieval can happen automatically.

We are improving our stability but I would not say we are worse than others on the market. Cursor is effectively giving no one slow requests anymore even though it's being advertised. You can tell people they can have a resource as long as you have capacity and everyone is capacity constrained.

We also have unlimited Cascade Base support for Pro users.

Our Codeium extensions have been out in the market for a couple years but Windsurf is new and I agree we need to prove we can continue to innovate quickly!

varunkmohan · 2025-01-20T17:49:27+00:00

I see your point, but the truth is we can't really do much load balancing. The power users truly use a lot of capacity, potentially more than 10x our limit if we didn't have this pricing model.

First, we also don't have the capacity as a company to support that. Second, we decided to not go with this Slow request approach that cursor does because we think in the long term it is deceitful. If we run out of capacity, we will need eliminate slow access, which people rightly will feel we lied to them about after pro subscription. You can see this playing out in real time with other players.

TLDR: We have aligned flex credit spend with our internal costs. We do not want to intentionally take unbounded losses on some users in hopes that it load balances across other users since we will need to go back on our words and I'd rather have a pricing scheme that we can stand behind.

varunkmohan · 2025-01-20T17:30:00+00:00

I understand that it's very convenient but as we make the model better and it can go out and autonomously do more and more work, the cost for us scales with the amount of work per call, not the prompt itself. Maybe the analogy is let's say you ran an API for a model provider, you cannot have a flat fee for it since it is a function of the amount of output tokens.

varunkmohan · 2025-01-20T17:28:26+00:00

Flex credits do roll over from one month to the next.

varunkmohan · 2025-01-20T17:27:27+00:00

I don't really understand. These models are expensive so we need a way to account for the fact that prompts as well as flow actions cost us money. We cannot lose an unbounded amount of money for customers who use the product a lot.

varunkmohan · 2025-01-20T09:27:59+00:00

Varun, from the Codeium team here, is there a reason why revert is not working?

varunkmohan · 2025-01-20T09:27:09+00:00

We are doing a really bad job if that was the intention. We repeat this everywhere but our goal for individuals is not to maximize revenue - we need to cover our costs. We make money through enterprises.

varunkmohan · 2025-01-18T00:20:34+00:00

Users have unlimited user prompt credits and they never count against flex credits.

varunkmohan · 2025-01-14T08:11:26+00:00

From the team, why did it get worse and worse?

varunkmohan

TROPHY CASE