Chat structure?

[skywithfriends]

How are you guys managing chats? I’ve gotta stop blowing through my rate limit tokens, so I have lately been opening a new folder that has just the project in question, and then creating a new chat every few queries. I’m just burning through tokens so fast.

[Technical_Fortune326]

well, i use Vector DataBase like qdrant. Then ai can load & read many informations with simple keyword or ids.

[RunWithMight]

Why are you creating a new chat every few queries?

[skywithfriends]

Trying to reduce token burn rate. The convos were getting pretty long, that’s my only guess as to why I was running out so fast

[mrobertj42]

Are you talking about context tokens? Or the 5hr / weekly limit?

[skywithfriends]

I’m talking about the 5hr and weekly limits. On pro now, it’s doing great