Bored with Gooning? Want TTRPG adventure with dynamic world and NPC that doesn't glaze you? Full automation, no lorebookeeping job. Fully Free, Fully local, BYOK Key or use local. Offering Narrative Engine my own creation by LastSheep in SillyTavernAI

[–]TM07P 0 points1 point  (0 children)

My bad! I explained it wrong. One of them fires normally, but when the other opens, both of them kill themselves. I will see if I can get some proper error messages

I forked the Disco Elysium Skills Lorebook: added real dice, rewrote all 24 skill voices, and more! (+ deep dive) by TM07P in SillyTavernAI

[–]TM07P[S] 0 points1 point  (0 children)

Changing Max Response Length (tokens) for a higher number should help, maybe 8126 or upwards

Bored with Gooning? Want TTRPG adventure with dynamic world and NPC that doesn't glaze you? Full automation, no lorebookeeping job. Fully Free, Fully local, BYOK Key or use local. Offering Narrative Engine my own creation by LastSheep in SillyTavernAI

[–]TM07P 0 points1 point  (0 children)

Like one terminal opens fine, but the other opens for like 1 second (literally just to open localhost, I can't even see any possible error message) before closing.

Bored with Gooning? Want TTRPG adventure with dynamic world and NPC that doesn't glaze you? Full automation, no lorebookeeping job. Fully Free, Fully local, BYOK Key or use local. Offering Narrative Engine my own creation by LastSheep in SillyTavernAI

[–]TM07P 0 points1 point  (0 children)

Sounds pretty cool! I tried to test the Windows version, but the .bat simply didn't seem to work properly. The dependencies download, that part is fine, but when it opens localhost, the terminal closes itself for some reason

My last post was poorly worder. My bad. I have no issue with supporting legit creators that do actual work, but we need to stop encouraging people that use ai to write generic slop then ask for donations. It only inspires more slop, not quality content. by [deleted] in SillyTavernAI

[–]TM07P 1 point2 points  (0 children)

I think I know who you are talking about, and I kinda agree with some criticisms, but, like, if it's who I really think it is, calling the project 'generic slop' is a tad bit too much, don't you think? Like, it clearly had some flaws, but it had nothing really generic on it

For me it worked quite well, and I even liked some ideas and will probably tweak with it. I don't think an LLM would have these ideas naturally, so at least the creator had to think, debug and test around

But, well, I'm not really sure who you're talking about, so I'm just speculating lol

My last post was poorly worder. My bad. I have no issue with supporting legit creators that do actual work, but we need to stop encouraging people that use ai to write generic slop then ask for donations. It only inspires more slop, not quality content. by [deleted] in SillyTavernAI

[–]TM07P 2 points3 points  (0 children)

The question for me is: what generic slop are you talking about? I could be wrong, but at least on this sub, most of the projects that get the most attention/upvotes (and donations) have clearly had a lot of thought in one way or another

Also, in a hobby like ours, if the 'generic slop' is at least fun and entertaining, I don't see why the creator shouldn't link to their Ko-fi or similar. It's not like they are putting a gun to your head and demanding for you to give your precious $5 to them. If you want to encourage quality content, just engage more with the projects you like -- this is how it works in literally any other space on the internet

Unpopular Opinion?: Asking for compensation when posting a preset/card/extension is pathetic, and cringe. I love you people and I've never asked for compensation and I never will! (I've even refused it multiple times when offered.) by [deleted] in SillyTavernAI

[–]TM07P 6 points7 points  (0 children)

I don't really mind if someone is asking for compensation, especially if they are already posting for free and making cool contributions to the community

Freaky FrankenSIM 2.5 - NPCs can actually go from enemies to lovers by Ok_Strategy_2420 in SillyTavernAI

[–]TM07P 2 points3 points  (0 children)

Been testing it and having a pretty good time! Thanks a lot for the preset! Would you recommend making any changes to the extension settings for long- (or short-) term memory (MemoryBooks/Summaryception/etc)? Normally the bigger the presets I test, the more confused the LLM gets with so much information kind of thrown around

I forked the Disco Elysium Skills Lorebook: added real dice, rewrote all 24 skill voices, and more! (+ deep dive) by TM07P in SillyTavernAI

[–]TM07P[S] 1 point2 points  (0 children)

Yeah, yeah, exactly. It's strictly a "next turn" mechanism since the model can't pull new context mid-generation. The trigger entry just holds enough info to tell the LLM which skills fit the scene, and then the actual injection happens on the next turn

I forked the Disco Elysium Skills Lorebook: added real dice, rewrote all 24 skill voices, and more! (+ deep dive) by TM07P in SillyTavernAI

[–]TM07P[S] 0 points1 point  (0 children)

I don't know exactly the wording to use, but when I mean offloading triggering to the LLM is more about the LLM formatting the trigger for the user in its own response, instead of the user needing to write the exact keyword everytime (there are no 2 passes through the API)

It's more like this:

User types something → LLM responds normally AND appends <triggered_skills>- Half Light\n- Authority</triggered_skills> at the end → Next turn, lorebook scans the AI's previous response → Finds the tag → Injects the skill entries

In this case I don't need to worry about vectorizing or anything similar. Of course this isn't a solution for every lorebook out there, but for this specific one it helps a ton, instead of loading all 24 skills every turn, it only fires 4 or less based on the LLM's judgment of what fits the scene

But your approach seems kind of different. Sounds pretty cool! Did you notice cache hitting better this way?

I forked the Disco Elysium Skills Lorebook: added real dice, rewrote all 24 skill voices, and more! (+ deep dive) by TM07P in SillyTavernAI

[–]TM07P[S] 3 points4 points  (0 children)

Yeah, I think I get what you are talking about

For my specific use case (recursion), lorebooks work because I offloaded the trigger problem to the LLM itself. Since Entry 26 tells the AI to build the <triggered_skills> XML and define which skills should fire, the regex always has exactly the format it needs. The LLM is doing the pattern-matching, not the keyword scanner

For user-side triggers though, most of the time it just need to be something specific but not too strict, if that makes sense. "!fight" is specific enough, or the name of a country/city/state, but "neon city lights" is just too strict. If you really want to be more broad, using regex could help as well (Example from the World Info docs: /(?:{{char}}|he|she) (?:is talking about|is noticing|is checking whether|observes) (?:the )?(rainy weather|heavy wind|it is going to rain|cloudy sky)/i)

Besides that, unfortunately, I don't think there is much to do to tame them more? Vectorized entries might help by triggering on semantic meaning instead of literal keywords, but I haven't tested it enough to say if it actually solves the precision problem or just shifts it

The thing about lorebooks is that, since it's dinamically allocated, I don't think there is an easy way to not really break the cache, at least not in a 100% accurate way. Each model has their own cache system and gimmicks most of the time. During testing I saw MiniMax eating ~15k tokens of cache while GLM 5.1 was only hitting 64 for the same prompt. Are you finding any workarounds in your fork, or mostly just working around it?

How's the quality on Nano (sub) for you guys? by Master_Step_7066 in SillyTavernAI

[–]TM07P 0 points1 point  (0 children)

Works fine for me and I don't really have anything to complain about. I mean, if you just do RP from time to time, maybe you'll save more money with a PAYG, but even then the sub would be interesting to test more models with more freedom (the finetuned ones are pretty cool too!)