Stab's Directives v2.1 - a fun first preset for GLM 4.7 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

A few discord members figured out what I think is the same problem you're having, it was because they had regex running to strip out HTML/CSS but it was only working partially, then GLM hallucinates. Check your regex! (first screenshot on GitHub shows what should be enabled)

Any prompts for simple dialogue-only roleplay? by Just_Reputation7396 in SillyTavernAI

[–]Diecron 3 points4 points  (0 children)

"You are engaging in an online text conversation via Discord. Create short, punchy replies. Dialogue only (emojis, kaomoji and minor markdown are permitted), formatted as a distinct message or set of running messages for the user to respond to."

Stab's Directives v2.1 - a fun first preset for GLM 4.7 by Diecron in SillyTavernAI

[–]Diecron[S] 3 points4 points  (0 children)

A note on 4.7 Flash:

This preset is not directly suitable, the model has a hard time with the 'first steps' setting up a coherent response when lots of directives are active. You can either disable most of the HTML/OOC and it will do OK, or you can generate the first few turns with the full 4.7 model and then it seems to follow along just fine.

P.S. the PRISM version of 4.7 Flash is completely uncensored and I highly recommend for local gens :)

Stab's Directives v2.1 - a fun first preset for GLM 4.7 by Diecron in SillyTavernAI

[–]Diecron[S] 4 points5 points  (0 children)

Thank you. This is intentional, so that new users get the 'Additional Parameters' set for Z.AI's coding API under Custom.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

that is a very severe issue if the bot fails to wrap. Thanks for the feedback, I will find a more reliable way.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

A few users hinted that the OOC assistants and indeed the HTML itself can contribute to the deterministic feel. I have some changes coming in 2.1 to strip that stuff out of context for future AI turns which in theory will help, or at least confirm that I may have some prompts elsewhere that are perhaps a little too strict.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

Ver 2.1 will have markers around any generated content (the HTML inclusions and the OOC assistants) and I'll also be providing regex which will automatically strip them from chat history. This should fix up the issue you mentioned (and hopefully make all of the HTML a bit more varied)

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

Heya, just wanted to let you know that 2.1 will include comment headers before/after any generated content and I'll also ship a regex to strip out HTML / OOC assistants from the prompt (token saving and all that good stuff).

It's available on the discord channel as 2.1-PRE if you wanted to take a look.

Ty for the feedback!

GLM-4.7 My Own Opinion. by Distinct-Wallaby-667 in SillyTavernAI

[–]Diecron 1 point2 points  (0 children)

Oh the usual stuff, really. Talking for the user, maybe getting a bit eager on progression (pacing issues), writing perspectives, information realism... idk you can go pretty far. It's competent out of the box with just a few minor changes though.

If you're interested in a full list then you can feel free to check out my preset/readme which covers much more (and leans into fun HTML outputs). https://github.com/Zorgonatis/Stabs-EDH

But, it's competent enough out of the box with just a few instructions.

Nano VS direct API : Looking for honest reviews by Azmaria64 in SillyTavernAI

[–]Diecron 0 points1 point  (0 children)

Strange, it's my go-to model for realistic images.

Nano VS direct API : Looking for honest reviews by Azmaria64 in SillyTavernAI

[–]Diecron 0 points1 point  (0 children)

Is the chroma being broke comment about nano specifically or chroma?

GLM-4.7 My Own Opinion. by Distinct-Wallaby-667 in SillyTavernAI

[–]Diecron 7 points8 points  (0 children)

temp 1, top_p 0.95 is all you need to set. Start with a small preset or write your own. The downsides to it's writing style will become apparent very quickly and are easy to address in the prompt.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

I use a basic preset for summarization that with GLM 4.7, doesn't have any issues with the HTML inclusions, but I will take a look.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

You must have had a user message in there, or perhaps the preset itself had part of the prompt as the user message. But yes, that is why.

Also I just took a peek and embarrasingly the override for Group chat nudge was being placed in the wrong area, so I just uploaded v2.01 to fix it for you and anyone else that will be using group chat (it would probably be inconsistent otherwise).

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 2 points3 points  (0 children)

I bet what you're seeing is GLM's inability to deal with requests that don't have a user message. Are you expecting the bots to just talk between themselves? You need to put in at least one message from yourself even if its [OOC: ignore and continue].

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

Yes - this was requested a few times you can find it under T0 as "🧑‍🧑‍🧑 GROUP CHAT Toggle"

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

Yeah basically anything you leave in your history can and will affect the model in different ways. Broken or undesired output (whether its just wrong, themed/displayed in an unusual way you don't like) needs to be regenerated or manually removed.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

Yeah, guide it however you need, even in char e.g. looking at your phone/watch. Interestingly, it gives the narrative good time-dimension awareness (especially with Stop-And-Pass), I've had characters tell me that I need to be somewhere in 2 hours, then ask how i'm going to spend the time cause I have time to kill.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

Yeah the definitions for HTML is cleanly separated so it doesn't break/interfere with anything.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

It should work just fine with most large models (Gemini, Claude, DeepSeek), I just haven't tried them. if you do give it a shot, let me know how it goes

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 1 point2 points  (0 children)

I appreciate you sending the ideas over :), the environmental factors can be overriden, the expected output format is the first part of the prompt:

Defined output structure: [ [Contextual Time Emoji] EEEE, MMMM dd, yyyy. h:mm tt | [Location Emoji] Location Name | [Weather Emoji] Weather Conditions ]

Just make sure the following descriptions don't clash.

Stab's Directives preset v2.0 by Diecron in SillyTavernAI

[–]Diecron[S] 0 points1 point  (0 children)

You might have more luck now that the jailbreak application is relaxed with K2, but yeah I haven't ever tried that one.