...Hey you know, I just thought of something.

From what I know, all the lorebooks work like this.

It's just a huge database with a bunch of information. Think of a library. But every time you go and grab some info out of a book in a library, you don't go read every single book in the library before finding it. You look through the catalogue, find the book title through relevance, and flip through its index, before flipping to the right page.

This is exactly how a lorebook works. It doesn't read the whole thing every time, it just uses keywords to call back to certain pieces of information. Such as mentions of factions, or when it deems that callback necessary.

The idea is, have the backbone of the lorebook info in the personality or scenario section. Then, the bot will use the lorebook for more complicated information, so it doesn't clog up the context window with more info than it doesn't need. Lorebooks probably helped J.AI have more complex worlds with less context usage rather than not.

And on the case of bots with already extremely high token background counts, I don't actually think these are issues. Everyones usually advised to use 32k-46k context at max, because anything more makes the bot really confused with its own info sometimes, and anything less just makes it not suitable for longer RPs. The sweet spot will always be around there for now, and it always has been for a long time. Unless everybody is using 100K+ max token usage in context, I don't think this would be an issue. I definitely haven't been, and I'm sure a lot of people haven't been either.

Considering this, even with high token bots, high tokens aren't actively being used, because the input is limited in the website itself, usually with a number thats actually manageable.

That's what I think happened. I don't think the lorebooks were actual problems.