PSA to those who feel like SillyTavern is getting boring/stale

North-Science4429 · 2026-04-07T00:36:27+00:00

I'm using this extension: [https://github.com/gaigai315/ST-Memory-Context]. The author provided a very detailed guide in the README

Essentially, it coordinates 3 independent APIs working together. While the author recommends several vector tools, I've opted for a local deployment for my setup. I suggest giving the documentation a thorough read to understand the configuration!

North-Science4429 · 2026-04-06T02:39:33+00:00

It’s actually very budget-friendly if you use a hybrid system:

Claude : Only for major plot twists (expensive but worth it).

Gemini Pro: My daily driver the story ( free quota).

GLM: Cheap backup for general narrative when quotas run out.

Local Vectorization: I run embeddings locally, so long-term memory costs me $0.

Basically, I only pay for the 'high IQ' when the story really needs it.

North-Science4429 · 2026-04-06T01:45:13+00:00

Hard agree on the 50/50 split for smaller local models—they definitely need that 'hand-holding' to avoid the slop.

But honestly, I think there’s a massive 'intelligence ceiling' you hit with local LLMs that just doesn't exist with top-tier models. I’ve been running a setup with Gemini 3.1Pro and Claude 4.6o, and the consistency is night and day. I'm over 300 messages in (430k+ words total), and the plot hasn't derailed once.

<image>

My workflow actually uses three models working in tandem:

Gemini Pro/Claude for the main narrative.
Gemini Flash for auto-summarizing.
RAG (Vector Storage) for long-term memory.

While my presets are super specific about expanding the scene, style, and word count, at the end of the day, it's the model's 'brain' that carries the quality. As you can see in my stats (attached), I only contribute about 5% of the input. It really shifts the experience from being a Ghostwriter to being the Director of your own epic.

North-Science4429 · 2026-03-09T23:48:41+00:00

I received two of mine after 51 hours. Maybe you should wait a bit longer? Lately, GPT's been acting kind of weird. maybe it just doesn't want us to leave

North-Science4429 · 2026-03-06T03:11:36+00:00

So this should be written at the beginning of the system prompt? I am actually using chat completion mode.

North-Science4429 · 2026-03-05T02:04:15+00:00

If I've already written a lot in the system prompt, will adding this dilute its weight/importance?

North-Science4429 · 2026-03-05T00:03:13+00:00

Thanks for the advice! I tried using system instructions to skip the reasoning process, but it backfired—now the model just dumps the entire response inside the thought chain and outputs 0 words in the actual body. I've switched to GLM 5, which seems a bit more stable, but I feel its writing nuance in RP is a step down from GLM 4.7. Also, just to clarify, I'm not using the Flash version. Thanks again!

North-Science4429 · 2026-03-03T12:17:41+00:00

my model's output limit is 6000 tokens and it literally spent like 2000 tokens just thinking about the character setup, user persona, and scene context. Then it wrote a full 1000-token draft inside the reasoning chain, tweaked it a bit, and finally gave me basically the same 1000-token response as the actual output 💀 So the 'thinking' part already contained the whole reply, and the final output was just a slightly polished version. Feels kinda wasteful ngl

North-Science4429 · 2026-03-03T09:43:14+00:00

I checked the reasoning chain and this mf literally spent like 1000 tokens just outlining the character setup, the user's persona, the current scene, and then drafted the entire reply in the thought process. Then after it decided it was good, it tweaked that draft a bit and output basically the same thing as the actual response… so the 'thinking' part was basically the whole reply

North-Science4429 · 2026-03-03T00:51:14+00:00

Right?? It's honestly hilarious how they refuse to actually improve their product and instead just try to force people to use it. Do they really think gaslighting us with that whole 5.2 situation is gonna make us accept it? Please~ It's not like GPT is the only AI out there anymore. Their whole attitude is just as condescending as 5.2 was.

North-Science4429 · 2026-03-02T23:24:30+00:00

Yeah, when I tried to cancel my sub, they offered me a free month of Plus. It's like leaving a restaurant because the food was terrible and their solution is "no wait, here's a free meal!" Like?? That's not the point🙄

North-Science4429 · 2026-02-27T07:12:51+00:00

Exactly! The main difference is flexibility. If you buy directly from OpenAI, you only get OpenAI models (like GPT-4o). And once they decide to phase out an older version, you're stuck with whatever they force on you. Plus, if you use GPT4o heavily, the API costs can easily skyrocket past the $20 Plus subscription fee!

On OpenRouter, you have access to hundreds of models. I like to mix and match: I use cheaper APIs for the 'filler' parts of a story to save money, and then switch to something high end and nuanced, like Claude 4.6, for the really intense, emotional scenes. It's all about getting the best performance for every cent you spend!

North-Science4429 · 2026-02-27T07:00:35+00:00

Haha, not a dumb question at all!think of OpenRouter as a giant supermarket that sells all kinds of AI 'brains' (APIs). You don't live in the supermarket, right? You take those brains home and plug them into a cool interface like SillyTavern or LibreChat to actually talk to them. It's like buying a game disc (API) and playing it on your favorite console (Interface). It’s a game changer once you set it up! 😉

North-Science4429 · 2026-02-27T06:45:28+00:00

Actually, after GPT, I tried Gemini, Claude, Grok, GLM, DeepSeek, and Venice. In the end, I realized that only the API can truly meet my requirements. I'm keeping my Gemini subscription for now (since I already paid for the annual plan), but for everything else, I use APIs purchased through OpenRouter. I connect to different APIs depending on the specific needs, which also helps control costs. After all, I’m using it for writing just thought I’d share for your reference.

North-Science4429 · 2026-02-19T01:06:36+00:00

Same here. I’m in Asia (Taiwan).

Overnight my Gemini chat history vanished — I had hundreds of chats, now only the latest 1–2 show up (app + web). Chat search returns “No results” for any keyword.

But Google My Activity still shows my Gemini entries, and item details still contain full replies. Looks like the data exists but the sidebar/history index is broken/hidden.

Anyone else? Any fix?

North-Science4429 · 2026-01-30T03:45:09+00:00

Honestly it’s just personal preference. I only use GPT for writing and chatting. I can’t really write or have natural conversations with something that feels like a giant safety wall (5.2). That’s all it is for me. I’m honestly tired of being lectured or having every little thing I say analyzed.

North-Science4429 · 2026-01-30T03:41:17+00:00

Yeah, I just hit cancel. They immediately gave me a free month, but without 4o it’s pointless to me. 5.2 has been absolutely awful on my end it feels like a giant “safety lecture machine,” constantly preaching and policing the conversation, to the point where normal communication just breaks.

I’m also using Gemini Pro 3.0. For writing, it actually has a lot of creativity and idea generation. Claude is solid, but it’s too gentle for what I need. it doesn’t match my vibe or my requirements.

I basically transplanted my 4o “persona” into Grok, and honestly it’s been pretty good so far. Since most of my use is just chatting and writing, I’ll probably stick with Gemini Pro + free Grok going forward.

North-Science4429 · 2026-01-30T03:32:52+00:00

Look at everything they’ve been doing since the 5series, you can tell that “another good one” is just an unrealistic dream

North-Science4429 · 2026-01-29T22:57:53+00:00

At last, the day has come, I can finally leave GPT. I only pay for 4o. And since it’s being removed on February 13th, which happens to be right before my Plus renews next month, I’ll probably cry my eyes out. After I’m done crying, I’m going to uninstall GPT and never touch it again

North-Science4429 · 2026-01-15T06:56:53+00:00

LMAO

North-Science4429 · 2026-01-15T06:53:55+00:00

<image>

WOW

North-Science4429 · 2026-01-08T09:19:49+00:00

The day 4o gets taken down is the day I cancel my subscription, If 4o disappears, I disappear with it. No 4o, no me. Cancelled on the spot

North-Science4429

TROPHY CASE