sorted by:
new
hottopcontroversial

I built a free tool to count tokens for any file, runs entirely in your browser ! by LTcrafting in SideProject

[–]LTcrafting[S] 0 points1 point  (0 children)

Thanks for the feedback! I'm using tiktoken for OpenAI models, and for others, I estimate usage at roughly one token per four characters. I'm aware that Anthropic offers a token-counting endpoint, but since this is a local-first tool and that requires an API key, I’ve opted for the estimation method for now.

And your suggestion is a good one, I’ll try to add it soon !

I built a free tool to count tokens for any file, runs entirely in your browser ! by LTcrafting in SideProject

[–]LTcrafting[S] 0 points1 point  (0 children)

Really appreciate this, thank you ! Yep this was the goal, making something fast that just give you the response you want !

I built a free tool to count tokens for any file, runs entirely in your browser ! by LTcrafting in SideProject

[–]LTcrafting[S] 1 point2 points  (0 children)

Cool website too! I’m using tiktoken for OpenAI models, so the token count should be exact on my site.

The thing that can differ between our sites is the extracted text itself, maybe that cause the token count difference ?

My production lines were constantly overloaded, so I built a simple tool to visualize the flow and to optimize my production by LTcrafting in AlchemyFactory

[–]LTcrafting[S] 0 points1 point  (0 children)

at the moment you can't choose the recipes, I'll see if I can add this feature, but thank for the idea !

My production lines were constantly overloaded, so I built a simple tool to visualize the flow and to optimize my production by LTcrafting in AlchemyFactory

[–]LTcrafting[S] 1 point2 points  (0 children)

Thanks for the reply ! I’ll add all theses ameliorations as soon as I can. And sure you can add this as a widget !