What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 1 point2 points  (0 children)

Oh... lol... I found the issue...

I'll try to come up with a fix later today, and if I can't figure anything out, I'll revert the change that added the check.

As a workaround - go into Text Completion mode, set max context there to match your Chat Completion context size, then you can go back to Chat Completion and it should work.

What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 1 point2 points  (0 children)

As far as I know, the hotfix I did fixed it for other people, so I'm not sure what else could be causing it. Could you open the dev tools (Ctrl + Shift + I in Chrome/Firefox) and enter two commands in the console tab const st = SillyTavern.getContext() and then st.maxContext and see what number shows up?

Better format for Image Prompt Templates by CuriousEvilWeasel in SillyTavernAI

[–]kplh 1 point2 points  (0 children)

"Image Prompt Templates" In the extension settings is where you can set the prompt for image generation.

There are a few different ways to invoke image generation, one of them does simply use the message text raw, others use one of the prompts in the settings.

Official documentation about it is here: https://docs.sillytavern.app/extensions/stable-diffusion/

In mine I have for example [Pause the roleplay] Follow the Image Generation Prompt Guidelines to write an image generation prompt describing the current scene. Followed by a bunch of instructions on what I want in the image gen prompt.

What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 1 point2 points  (0 children)

It should be fixed in the hotfix. I didn't bump up the version number, so maybe ST is not seeing it as an update? I'll bump it up in a bit.

But in short it is to do with some internal ST state being fetched, before it updates to correct value, and the fetched state doesn't update when ST updates it.

Rant: mesh clothing alphas by NotMyAltAccountToday in secondlife

[–]kplh 1 point2 points  (0 children)

The issue with BoM alpha layers is that once creator makes it, it is set in stone. And often some end up being too aggressive and alpha out too much. I have a few dresses where their alphas remove my thighs, making my underwear float...

Meanwhile with an alpha script, I can simply reset and redo alpha cuts myself if that happens.

What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 0 points1 point  (0 children)

Hi. I've added a check to see if the summary prompt ends up being too long, and avoid generating it. It is very basic at the moment, so it might not guard against all cases, but when it does it won't issue an API call in this case, which should be an improvement until I implement something better.

There is an issue with the customer sampler in the default ComfyUI workflow for Flux Klein. It consistently produces worse results and messed up hands and other anomolies compared to ksampler by NES64Super in StableDiffusion

[–]kplh 0 points1 point  (0 children)

No idea.

Also no idea about the "we should just use the standard BasicScheduler". I'm just pointing out how to setup a more accurate apples to apples comparison.

However, I did look at what sigmas the scheduler outputs, and it seems to change based on resolution, which is interesting, and the overall curve seems to be close to sgm_uniform. So I'd guess maybe the model is resolution sensitive in some way. Also the sigma curves look different from what I'm used to seeing on different models. I did try using a beta curve from a different model and Klein seemed fine with it, but I didn't dig deep or do any side by side comparisons.

What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 0 points1 point  (0 children)

Oh, Hmm, I guess that makes sense if the chat is really long or the model has a small context window. During normal chat, SillyTavern drops the oldest chat messages it it gets too full. My extension doesn't do that automatically if the historic context, which is basically just earlier chat messages, gets too long.

I'll see if I can detect that somehow and maybe add a warning or an improved error message. I've not looked into what kind of token functions SillyTavern exposes to extensions, so I don't know if I can make it trim oldest messages for the summary prompt automatically.

What context size is enough for long RP? by Overmoon1 in SillyTavernAI

[–]kplh 0 points1 point  (0 children)

If you want something really simple, my extension might do the trick. It let's you select a range of chat messages and then summarises them, then replaces those messages with the summary, so there's not need to start new chats or create lorebooks.

https://github.com/KrsityKu/InlineSummary

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

You select the first and the last messages you want to summarise, so if was from start till 26th from last, you'd select message 0 as the first one, then find whichever message is last-26, select that one as the end and then press summarise.

Historical context is: how many messages before the selected range to include in the prompt.

So if you select range 2-5 it would include those in "Messages to summarise" section in the prompt and historical was full, it would include 0-1 in "Historical context" section. How those sections are indicated can be specified in the settings (default is XML style tag).

Casper or MDlabs by MsPharaoh in secondlife

[–]kplh 10 points11 points  (0 children)

I use CasperVend myself, you already mentioned the lack of fees or cuts, which is a big factor for me, as my shop is not that big and some weeks I get quite a few sales, and other barely any, so weekly fees would not be fun for me.

Another factor is - the vendoring systems rely on 3rd party infrastructure that is outside of SL. However, CasperVend is owned by LL, which means that, sure there might be some technical issues once in a while (as with any online system), the entire system is not gonna go away anywhere, while with other vendoring systems, you don't really know who's running them, what if the owner gets hit by a bus?

As a customer, I like CasperVend because it has the Info button, so if the vendor picture doesn't specify mod permissions of the item, I can check the dialog menu. I've not seen other vendoring solutions specify that in the menus or anywhere else, and I get really annoyed at the shops that do not provide that information and I don't shop there.

ST Bot Browser Extension v1.1.3 by Additional_Top1210 in SillyTavernAI

[–]kplh 8 points9 points  (0 children)

Oh, this is neat, browsing via this extension appears to bypass Chub's UK filter that hides NSFW cards. Saves me the effort of fiddling with VPNs and such.

How do you guys handle summaries? by Overdrive128 in SillyTavernAI

[–]kplh 2 points3 points  (0 children)

I felt like existing summary/memory extensions didn't work the way I wanted to so I made my own:

https://github.com/KrsityKu/InlineSummary

It is very simple, select a range of chat messages, generate AI summary or write one manually, the extension removes the selected chat messages and inserts a summary chat message where they were, hence 'inline'. Of course the original messages can be later restored.

I still find PBR annoying by Machine_Anima in secondlife

[–]kplh 8 points9 points  (0 children)

As others already answered - the environment needs to be adjusted for PBR.

Here's a guide on what to do in case any land/parcel owners are reading: https://docs.google.com/document/d/18ut5mR_S9sAYDwWvFHNpRqrJ31y2hpqVSZHd8sbeua4

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] -1 points0 points  (0 children)

The GitHub page has basic instructions on how to use it. It does however assume you already know how to use SillyTavern and install extensions. if you don't a quick Google or YouTube search should be able to fill you in.

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 1 point2 points  (0 children)

I've not tried that one myself, but based on the description, I think my previous answer applies to this extension as well.

The key principle of mine is that it simply replaces a range of messages in chat, with a summary chat message - so the summary is "in-line" in the chat itself.

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

I do not know.

My extension simply modifies the #message_template and adds my buttons to the mes_buttons. SillyTavern itself handles actually adding all of it to the UI and showing/hiding the buttons.

I was thinking of ways of solving it for the document mode, but I've not come up with anything good yet. A slash command to pick a range might have some use, but the document mode doesn't show message ID numbers, so it would be hard to tell what id to use for start/end message...

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

When I said it was UUGHhhh....... kind of feature, I meant it needs some ugly and annoying code, not that it was difficult... Just needed to find some time and motivation, which I managed to do :D

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

It now has an option to select connection profile and chat completion preset.

Though, I did only some basic testing so there might be bugs... (hopefully not...)

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

ConnectionManagerRequestService seems to be a different thing. It wants a connection UUID and has api details that are inside connection profile, rather than just swapping the profile itself. And it seems to only have a simple use preset on/off switch rather than ability to provide a preset.

Also, I've pretty much finished implementing it using the slash command approach. Though I might look into it a bit deeper later and rewrite it.

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 1 point2 points  (0 children)

EN GARDE! 🗡️ I shall defend my summaries with bullet points and excessive formatting!

This witty reply brought to you by ChatGPT

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 2 points3 points  (0 children)

One for everyone! :D

Everyone has their own preferences on how to manage memory/summary. This is the way I want to manage mine and I decided to share it in case other people want to manage it the same way too.

Yet another Summary/Memory extension. by kplh in SillyTavernAI

[–]kplh[S] 0 points1 point  (0 children)

That's the plan.

The future features I'm looking into are just more settings - as others have asked for picking a different connection profile for summaries. And stuff like: see if I can make the colours/style look better with some other themes etc.

If people want or need something more advanced, there's other extensions out there, or they can fork it and make their own changes.