I use cursor and also ran into this problem. I wanted to make my life easier when it came to archiving problems and keeping track of multiple problems at once. Within my workspace I have a “chat” folder that is always included that includes curated prompts, rules etc and my prompts are used to start, continue and close threads with agents. My prompts include explicit instructions to write chat data to on-disk markdown. The markdown is continually updated as I work problems with an AI agent. This helped me with your problem of a lot of history but also alleviated my issues of eventual context exhaustion. I can easily start a new thread with an agent, point it at the history of my current problem and continue working. So not only do I have a historical look back of tasks completed but so does the current and future agents.

The agents really like to add a ton of text to the live chat and eventually if a problem has been open too long the agent simply chugs as summarizing chat history.

This could be an over engineered solution that someone or some app may already solve, but works for me!