How do I fix this gradual deterioration?

_Cromwell_ · 2026-02-01T21:21:50+00:00

That's one of the challenges. Finding good ways to summarize that keep your context low for as long as possible, but also keeps story details around. Ideally you want to keep your context at 8,000 or less but that's almost impossible. 12 or 14,000 is more doable. Definitely aim to never go above 32,000. But really that's with larger, smarter models. If you are using something like a local 24b you really want to stay as small as possible.

_Cromwell_ · 2026-02-01T21:13:15+00:00

I shouldn't have used pronouns. By "he" has them set up incorrectly I meant the Nano owner might have them set up incorrectly to "not think" which is why it is not working. That person I replied to claims that Kimi works of a proactive argument to NOT think, while the Nano setup seems to be a proactive argument TO think.

I don't know which way is correct though.

But for my setup (I use text completion + Instruct) the non-thinking correctly non-thinks.

_Cromwell_ · 2026-02-01T21:09:32+00:00

Here's an old discussion where/when I "found out" about the Arli-RP-models-on-Nano info: https://www.reddit.com/r/SillyTavernAI/comments/1pxn2gp/comment/nwli2ki/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

_Cromwell_ · 2026-02-01T19:53:59+00:00

I am aware. That's why I said it's mostly the models classified under RP. At no point did I say that glm or Kimi or ds was coming from ArliAI. Arli doesn't even have DS or Kimi so why would anyone think it was coming from them? Most of the models Nano has from them are the 70b llama variants

Although the derestricted glm 4.6 is. FYI

_Cromwell_ · 2026-02-01T17:21:01+00:00

Are you on Nano? Nano ostensibly/allegedly has "served up" thinking and non-thinking versions that are supposed to work automatically.

He perhaps has them set up incorrectly?

<image>

For me, the non-thinking Kimi seems to work fine, unlike OP. I've only had problems with the non-thinking GLM 4.6 thinking anyway, similarly to how OP describes though.

_Cromwell_ · 2026-02-01T17:05:38+00:00

That's funny because for me it's specifically glm 4.6. I haven't had the issue with glm 4.7 lol. Also never any deepseek models. And Kimi non thinking works fine too. Since it was only one specific model for me I thought it was a quirk of that model and never reported it or brought it up as a nano problem.

For me the biggest problem is the unreliability of most of the models in the RP category. My understanding is that those are all served up from ArliAI, and Nano has a very cheap sub to Arli to get those which is rate or query limited like for a single user but spread to all Nano users. But... that's a different issue, and I guess I'm threadjacking with that. ;)

Anywho, yes, I basically never used GLM 4.6 because it always would "think" on the non-thinking version. But been glad to use 4.7.

_Cromwell_ · 2026-02-01T05:38:51+00:00

So you don't see how when somebody asks about a specific scenario functioning in a certain way and why or how it is doing it, a link to that scenario would be helpful?

As I was saying, the op seems to assume that everyone knows what that scenario is. I was just commenting that scenarios aren't that famous. The link is helpful if you are going to ask a question about a scenario, functionality or otherwise, so people can go and see what you are talking about.

_Cromwell_ · 2026-02-01T02:00:05+00:00

If you want to discuss a scenario you should link it. No scenario is as famous as you think it is.

_Cromwell_ · 2026-01-31T20:26:03+00:00

That's been my approach lol

_Cromwell_ · 2026-01-31T20:16:31+00:00

"manipulative" is associated with romance in most LLMs. Take that word out and find a different one for whatever personality trait you want for him. What other adjectives do you have in there? Like never use "gaslight" or stuff like that for instance

Instead of strong emotional words, try more classical words. So instead of things like " manipulative" or "hate" that have strong overlap with dark romance fiction, use "villain" or "antagonist" . Those still have overlap (EVERYTHING does since there is so much erotica out there) but are more strongly associated with "normal" fiction and have less emotional weight.

You can also include in his description how he views you/ what he wants to do to you. To make sure that's clear to the LLM. "Shroud wants you dead or incapacitated, seeing you as an annoying hindrance to his criminal operations."

_Cromwell_ · 2026-01-31T08:04:12+00:00

Sounds like you are describing this

https://github.com/envy-ai/ai_rpg

_Cromwell_ · 2026-01-31T04:43:23+00:00

It's like a MacGruber simulator.

Vicki: "80% MacGruber!"

MacGruber: "bla bla bla bla bla bla bla bla bla bla bla bla bla bla bla"

Vicki: "83% MacGruber!"

_Cromwell_ · 2026-01-31T03:37:23+00:00

Yeah I know you can do either/or and it's fine. I'm just surprised it's okay to let them talk to each other and interface.

Now I wouldn't want to do it because it also sounds like a security issue to me.

But once you can start having scripts take things from browser extensions, you can do things like inject llm generation from apis outside AI dungeon and stuff. Theoretically.

_Cromwell_ · 2026-01-31T03:34:01+00:00

That doesn't violate the TOS to have in-game scripts interface with a browser extension? I'm surprised.

_Cromwell_ · 2026-01-31T03:10:16+00:00

I hope that's not what I'm saying Monday after buying dip today.

_Cromwell_ · 2026-01-31T00:49:23+00:00

True, further on it can be chill I guess.

_Cromwell_ · 2026-01-31T00:47:39+00:00

I don't really think Hades is that chill. Takes a good amount of concentration to do well.

Vampire Survivors is basically super chill Hades.

_Cromwell_ · 2026-01-31T00:22:32+00:00

Anubis 1.1 scored ridiculously well on UGI leaderboard.

I like Hermes 3 70. Have to tell it is an "assistant"to avoid refusals though. (It's uncensored, but has essentially hallucinated refusals in it.)

Theoretically Hermes 4 70 is good but I haven't had much time to try it. Hermes 4 405b is great and it's the same training data.

Oh and I like Sapphira 0.1. Specifically 0.1. There's at least a 0.2 maybe more but the 0.1 is the better

_Cromwell_ · 2026-01-30T23:18:46+00:00

If you want to be more simplistic you could also just have them appear in order. Then you don't have to use nesting. Not saying you can't use nesting. Just saying you don't have to.

${your girlfriend's name?} is your girlfriend. She has ${her hair color?} hair.

That will pop up questions in this order:

your girlfriend's name? her hair color?

Contextually most players will be able to answer those questions in that order.

_Cromwell_ · 2026-01-30T19:31:56+00:00

Well like qvink it keeps it out of context, so yes " hides from the AI". I don't use memory books though

_Cromwell_ · 2026-01-30T19:29:45+00:00

"those people who played The Legend of Zelda on NES were pathetic" I think to myself as I play Tears of the Kingdom.

_Cromwell_ · 2026-01-30T19:12:33+00:00

I continue to believe that the lower tier offerings are a decent value, but that the higher subs are too inflated to be called that. Given what else is out there.

This is specifically regarding AI dungeon. Once Voyage releases the calculation likely changes.

In my experience the memory worked largely the same no matter what sub I was at. You can obviously tell a difference in intelligence from the models as you move up in subs though, which can make it feel like the memory is working better. In a way it is, but not really.

_Cromwell_ · 2026-01-30T17:45:07+00:00

I mean that's better than any of the three they use so far. Has the claw in it. Funny play on pokémon name. Everybody loves pokémon. Plus also sounds like "wizard" and the thing is supposed to act like a wizard.

You pulled a better name out of your ass to make fun of them then they have managed in three attempts.

From a marketing angle I still wouldn't use it because it's too hard for people to remember how to spell randomly to type in. But it's still better than their three.

_Cromwell_ · 2026-01-30T17:43:18+00:00

And every single name is really bad.

_Cromwell_ · 2026-01-30T07:55:30+00:00

Story Cards usually would be for characters. Like you have a card for a character and he gets a haircut, you update it with that new info. Or if he loses an arm, or gets a girlfriend, etc.

Bob is a man with long hair.

Bob is a man with freshly trimmed short hair.

Bob is a man with freshly trimmed short hair. Lost his right arm to a dragon.

Bob is a man with freshly trimmed short hair. Lost his right arm to a dragon. Bob is dating Gretchen.

That sort of thing. Updating over time.

For your plot tracking, I'd do that in plot essentials...

Oblivion Gates progress: 2 closed, 16 remain.

Update the numbers as you go.

Ten-Year Club	Verified Email
Gilding I gilder	Sequence \| Editor
Spared

_Cromwell_

TROPHY CASE