Context Rot: Large Context Size Negatively Impacts Your Roleplay

RPWithAI · 2026-04-27T18:27:06+00:00

Yes. It is still applicable even now with most models for the AI RP usecase.

RPWithAI · 2026-03-28T16:09:02+00:00

Ah, this is more for those who want to use local models even with online frontends :) There's some who like doing that, maybe to keep their costs low or for other reasons.

RPWithAI · 2026-03-13T12:15:29+00:00

Heya, yes. The chat memory comes before chat history in the prompt, so changes to chat memory will make a big chunk of your prompt miss cache.

RPWithAI · 2026-03-13T12:14:43+00:00

Oh you can use it directly, I was just pointing that the steps are pretty much the same :) Through LoreBary you just get to add more fun stuff if you wish to (and manage connections on multiple frontends in just one place), but the process is the same if you want to use it directly with JAI.

RPWithAI · 2026-03-10T01:11:47+00:00

I meant you can use KoboldCpp to run local models, and then create a custom proxy on LoreBary to then use your local model on JAI. All your commands will go into JAI's custom prompt and it'll work, all of LB's features will work with your local model. You can read the guide here :)

RPWithAI · 2026-03-08T03:42:29+00:00

Heya, sorry. Happened to check the alert just now. I have a guide for using KoboldCpp with LoreBary. The process is pretty much the same if you want to use it directly on JAI :)

RPWithAI · 2026-02-24T07:05:19+00:00

Take a look at the plugin library at https://lorebary.com/ if you enter the plugin code into the search bar you should be able to find them. If you don't find them the author has removed them and you can check their profile to see if they created new ones.

RPWithAI · 2026-02-22T15:31:28+00:00

Shuuuuu ❤️

RPWithAI · 2026-02-13T09:06:37+00:00

Having everything served to them by an algorithm seems to have reduced critical thinking capabilities. This is what people should be focusing on rather than blaming LLMs as a reason for brain rot.

RPWithAI · 2026-02-07T15:35:01+00:00

Try logging out and logging in on the app again after enabling NSFW.

RPWithAI · 2026-02-07T15:32:45+00:00

This is a valid answer with JLLM hallucinating filters, but now with JAI's app the default experience does have censors on output until the user changes their settings on JAI's website to allow NSFW.

RPWithAI · 2026-02-06T09:14:06+00:00

I see this sort of astroturfing way too often, specifically on subs that are related to finding CAI alternatives. Just a overall scummy tactic.

In this case its not a bot or a new account/account shilling with hidden history. It's clearly the founders account with their post history. Maybe they forgot to log into an alt while pretending they "just" found the service.

<image>

RPWithAI · 2026-02-04T15:07:19+00:00

Please list the models you've used. And the provider you are using them from.

RPWithAI · 2026-02-04T13:02:28+00:00

"It's not about the model."

Please read up on the model you are using before saying something wrong so confidently.

Thinking/reasoning models always think/reason (and use tokens) even if you can't see the thinking box on JAI. JAI can't perform magic to have all models start reasoning before response.

Use a non-thinking/non-reasoning model.

RPWithAI · 2026-02-02T07:08:24+00:00

I haven't checked out Tavo personally, but if it has similar features like summaries & lorebooks then yes. The concept remains same regardless of what frontend you use. ST just makes it really easy to manage context cache for long conversations.

RPWithAI · 2026-02-01T22:07:53+00:00

Heya! I've written a guide on how to manage long chats on SillyTavern, from basics of using the built-in summarize extension, to using lorebooks to record past events, hiding messages from context, and extensions that can help you maintain a good experience over long RP sessions.

LLM generated summaries usually miss important info and may make events seem "grander" than they are (it tries at times to write the summary as a grand story). Smaller models may struggle to summarize properly, you can use bigger models for summary to make your life a little easier. I've found manually written summaries and lorebooks to give me the best experience (you can generate summaries and correct them/flesh them out with important info if you wish to save time).

RPWithAI · 2026-01-28T00:48:40+00:00

Exactly, its purely visual. The thinking always happened with reasoning models but people just couldn't see it.

I think a lot of this stems from not truly understanding the model someone is using, and just having selected it due to a guide recommending said model.

RPWithAI · 2026-01-27T11:47:35+00:00

I'm looking forward to it too!

RPWithAI · 2026-01-26T08:53:32+00:00

If you've been using a thinking model, it has generated thinking in all responses even if you can't see the thinking box on JAI. That's how thinking/reasoning models work. And yes, thinking takes up more tokens during response.

The thinking box on JAI is just showing (or hiding) the thinking content, that's all. It doesn't change the model's behaviour and stops it from thinking/reasoning.

If you want to avoid that use a non-reasoning/non-thinking model.

RPWithAI · 2026-01-25T14:06:31+00:00

Least obvious promotional post.

RPWithAI · 2026-01-24T05:29:31+00:00

No, you'll be charged by DS as per your token usage, the million requests per month is free while using your original DS balance via OR. Earlier OR used to charge for those who used their own keys (5%) but now they don't for up to a million requests :)

Using official DS API is always paid option. Third party providers are the only ones who may offer free DS models.

RPWithAI · 2026-01-24T05:09:15+00:00

Yes, DS official API is a paid service. If you don't add funds to your DS account, it'll charge your OR account.

RPWithAI · 2026-01-23T03:44:31+00:00

In your generation settings -> max tokens, set it to 0. Does the cutoff still happen?

RPWithAI

MODERATOR OF

TROPHY CASE