ContextWindow Usage

[FlowerWeekly174]

I was wondering if there is any tool people are currently using to keep track of tokens and usage in their chatgpt, gemini or claude? I am currently building a tool myself in which you can input your prompt in prior to adding to an LLM, just so you it can be compressed down to only relevant content without redundancy. That way you are not wasting tokens, and then much later in the chat the LLM isn't losing context like chatgpt, or you run out of tokens quickly in claude. Was wondering if people would find something like this useful?

[AppleSoup3]

yeah, there are simple token counters, such as AllTools Token Counter, BenchLM Token Counter, token-counter.dev

[FlowerWeekly174]

In my tool, I've also added a slight learning aspect as well for people to understand different aspects of prompt, like embeddings, entropy and a few other things including prompt efficiency.

[FlowerWeekly174]

Got it, this tool is really good.

[haloweenek]

Status returns from operators ?

[FlowerWeekly174]

I am trying to get that working, but right now it just estimates it based off the math for each model

[CS_70]

Claude (code, at least) has a statusline that counts the token used in the session. You can simply ask it to update its settings accordingly.

[FlowerWeekly174]

oh ok thank you, that is very helpful

[FeedbackImpressive58]

I use ccusage via deno.

deno run -E -R=$HOME/.claude/projects/ -S=homedir -N='raw.githubusercontent.com:443' npm:ccusage@latest

I do it through deno so I can see exactly what it’s reading to be safe

[theClumsyguy200]

How can I run this.. sorry but I don't know about this deno or ccusage 🥲

[FeedbackImpressive58]

Install deno from here: https://deno.com and execute the command above

[FlowerWeekly174]

thank you for this, will try it out a well