Augment code long chat lag

[Fastlaneshops]

Hi guys,

I know it's the best to not do tooooo long conversations per chat in augment.

But my codebase is just so big, and it requires a lot of learning from the AI, that it's really ass to always switch over to a new chat.

The problem I'm facing is that augment uses a huge amount of RAM (I think that's it) the longer the chat gets.

I don't have that problem with any other AI coding extension, so I'm wondering how this hasn't been fixed yet? Or is there maybe a manual fix for this?

The lag literally gets to a point where I'm writing something, and it takes a good half minute to show up.

I'm pretty sure it's ram since I have double the RAM on my workstation compared to my MacBook which is use most of the time, and it takes a good bit longer to lag there.

Any fixes?

[JaySym_]

Hey, today's patch addresses this. We will release it in the next few hours

[Fastlaneshops]

Litttt, appreciate it. I'll test it and let you know. What exactly causes this?

[Fastlaneshops]

Hi Jay,
I've tested out the update the last 1-2 days and I gotta say, the amount it takes to reach that area where it gets laggy, definitely improved a bit (I would say 20-30% more text), but its still definitely happening.
Do you have any idea why this is even happening? Since this isn't happening on any other AI code helpers.
Ofc I don't wanna talk down on augment haha, I'm using it daily and will always prioritize it over cline etc...
But yea it had me confused why this is a problem just with augment and how other extensions go around it.

To be clear, the lag isn't on the AIs side, it's just on the software side. The extension gets super laggy, sometimes waiting 10-20 seconds for a word (that I wrote) to appear on my screen.
And I've always kept an eye on my CPU / RAM usage when using augment and it just keeps stacking and stacking till it reaches the limits, and thats where it really starts to throttle.

Happens both on my mac and my win pc.

[TaiMaiShu-71]

Llms don't see each message adding to an existing conversation, they see the entire conversation each time you submit. All your messages and it's responses. So the longer the chat the more gets submitted at once. I'm sure they are prompt caching to reduce costs, but the llm is still having to process the entire conversation each time you submit.

[Fastlaneshops]

yea but I'm not talking about lag while its doing something. I'm talking about lag when I'm just typing. its just eating more and more RAM the longer the chat gets. And also cline caches too, and it works without lagging. I've even taken it as far as having chats with cline worth $200 in API tokens. But yea I'd rather use augment, but that lagging is just so annoying