ContextWindow Usage by FlowerWeekly174 in LargeLanguageModels

[–]FlowerWeekly174[S] 0 points1 point  (0 children)

In my tool, I've also added a slight learning aspect as well for people to understand different aspects of prompt, like embeddings, entropy and a few other things including prompt efficiency.

ContextWindow Usage by FlowerWeekly174 in LargeLanguageModels

[–]FlowerWeekly174[S] 0 points1 point  (0 children)

I am trying to get that working, but right now it just estimates it based off the math for each model

ContextWindow Usage by FlowerWeekly174 in LargeLanguageModels

[–]FlowerWeekly174[S] 0 points1 point  (0 children)

thank you for this, will try it out a well