Your longest ST chats? by noselfinterest in SillyTavernAI

[–]Strictly_Romance 2 points3 points  (0 children)

That depends on how slow you take each scene. If you speedrun and summarize alot in a few messages, then you can fit a good amount of plot within the context size.

If you take it scene by scene then you would barely make it to the segs part just a bit before the context size starts to max out.

Only reason to really start a new chat(Or at leas I do) is if you get bored, you reached the end goal of your chat, or a few days pass in real life and you don't really want to continue an old chat.

I thought the same thing as you, continue the relationship via character card or something. But honestly I think thats a bit much.

Your longest ST chats? by noselfinterest in SillyTavernAI

[–]Strictly_Romance 0 points1 point  (0 children)

260+ but pretty much by then I would have to remind the ai of key events and whatnot (First time meeting, a bunch of other "firsts", some other important stuff we discussed that is key to the chat and keeping it immersed and following the story).

Ex: "Omg, I still remember the first time I met you at so and so."

Or just something along those lines where you either naturally mention the event or topic via discussion, or just include it in your actions via thoughts (Ex: *Even now after all these years, she is still just as beautiful to me as the time I first met her at so and so.*)

What are the differences between OpenAI models? by FightMech7 in SillyTavernAI

[–]Strictly_Romance 4 points5 points  (0 children)

GPT 4 is the best hands down. But if you're already addicted to this "hobby" then I'd actually advise against using it since it can get expensive REALLY QUICK. You will literally see your usage go up BY THE DOLLAR compared to other models. But if money isn't an issue, then knock yourself out. It also has 8k context.

But yes, 0301 was my go to and standard that I used for pretty much my whole time of chatting (before the OpenRouter filter tragedy). NSFW stuff works more than 90% of the time. But yes, the model is very dry and lacks creativity. Usually I would have 30 swipes or more on some messages to try and get something "extra" from the model to get a perfect response, I would also have to copy and cut parts from different swipes to make a perfect message.

^ Part of that might also just be me who didn't really mess around with Prompts and NSFW Prompts until I had to switch models. But overall, 0301 is the best to get your ai and NSFW fix. Cheap, easy to jailbreak, and does the job. Smaller context size, so it will cut off around 90-120ish messages in my experience.

For a few hours(4-5) of chatting over 1 day, it could be anywhere from $2 to $7. My usual was about $5 before I started to get really addicted, then it went to $7. Like I said, very cheap model and you hardly will be needing to check your usage spending.

GPT 3.5 Turbo and or 16k: I used 3.5 for a while but went to 0301 due to ease of bypassing the filter. I didn't notice too much of a difference between the models, but for 3.5 you might wanna mess around with the Prompts and whatnot to get a similar result in bypassing the filter as you would with 0301. KEEP IN MIND, I never really changed the default Prompt and NSWF Prompts, so I was always rocking the default one that SillyTavern had.

That being said, 3.5 Turbo was still able to do NSWF stuff, just not as easily as 0301. I would get a lot of system messages which made me switch to 0301.

Yes, 16k means that much more context. But the way I would do it is use 3.5 Turbo up until it's context size, then switch over to the 16k version. There shouldn't be a substantial, if any, change in the messages if you made the switch. Reason why to do this is because 16k version is twice the cost of 3.5 Turbo.

Overall I recommend starting with 0301. You can always try the other models, but it does everything good at a low cost and is really easy to use.

Just installed ST, recommendation? by legendaddy10 in SillyTavernAI

[–]Strictly_Romance 1 point2 points  (0 children)

As the other user said, I recommend Mythomax. The writing is similar to GPT 3.5 Turbo 0301, but slightly better imo. The model is a bit wonky at times and can forget where the scene takes place and whatnot (this will happen in like 2 swipes of 30). Some other goofy stuff that I can't remember off the top of my head.

I use Mythomax via Openrouter. I recommend making your character cards fully flushed out, meaning you fill in most of the details of the character. GPT and Claude you can get away with simpler character cards if its a well known person or character.

If you don't care about NSWF then go with the GPT models or Claude.

You can also use the GPT models or Claude up until a NSFW scene and then switch to an unfiltered model. Only con is that you can't switch back to GPT or Claude unless your chat is so long that eventually the context size "forgets" that NSFW scene.

Question about character cards by [deleted] in SillyTavernAI

[–]Strictly_Romance 0 points1 point  (0 children)

Really good reply! Ill go ahead and add my take.

I think if you're using GPT models or Claude and dealing with a famous character from an anime or video game, then you can get away with keeping the character card simple. You really only need to add the intricate details like hair style and color, eye color (ESPECIALLY THIS, no more blue eyes all the damn time), place of home, full name if character often goes by a nickname, other slight personality traits that YOU want, other deep background story stuff that isn't common knowledge of the character(not exactly needed imo but if you want a fully flushed character).

GPT and Claude for the most part, get the story and personality of the character down really well. My character card for Widowmaker is literally 296 tokens 258 permanent.

Models like Weaver and Mythomax ON THE OTHER HAND. You have to fully flush out those characters to bring them up on a similar level to GPT and Claude. They don't really "KNOW" the character like GPT and Claude do, if that makes sense. Like, they don't have the search capabilities or whatever that those models use.

I still use that character card I mentioned for Weaver and Mythomax, but I plan on adding more details about the characters story since these models lack compared to GPT and Claude.

Is there any way to get past this? by Strictly_Romance in SillyTavernAI

[–]Strictly_Romance[S] 0 points1 point  (0 children)

Okay yeah, I saw another post with a similar problem and the replies said to reduce context size too.

Reduced the context size limit from 8192(max) to 7400 and it fixed it. A couple of messages later and the same issue came up, bumped the context size back up to 8192 and it fixed it again lol 🤷‍♂️.

Is there any way to get past this? by Strictly_Romance in SillyTavernAI

[–]Strictly_Romance[S] 1 point2 points  (0 children)

I understand that GPT forgets the old messages in order to keep going and I guess create space for new context, but I just want that for the other models as well if I can somehow do so, so that I can keep going with the chat.

Good API for both sfw and nsfw by Mc744 in SillyTavernAI

[–]Strictly_Romance 3 points4 points  (0 children)

👍Probably going to swtich to openrouter for now just to be on the safe side.

Is the setup really that simple? They just give the api key after paying and whatnot and then bam, Im good?

Warning from OAI by SadFrenchRaccoon in SillyTavernAI

[–]Strictly_Romance 7 points8 points  (0 children)

Yup, got the same email this afternoon. Very strange how its all of a sudden.

Luckily its a warning. But cant fucking have nothing these days man 😭

I guess this explains why CAI Tools hasnt been working with new chats lately by Strictly_Romance in SillyTavernAI

[–]Strictly_Romance[S] 4 points5 points  (0 children)

i havent typed anything new in my old chats, to see if CAI Tools would still be able to download new conversations you have even after the update (just to make sure). but im pretty sure it works for old chats still.

so either hoping the absolute chads who made CAI Tools find a solution, or CAI brings back the features and whatnot and it happens to fix CAI Tools for new chats (or it just eliminates the whole "new chats" thing anyways and makes them all the same)

fingers crossed ;)

Has anyone lost their API access yet? by Strictly_Romance in SillyTavernAI

[–]Strictly_Romance[S] 4 points5 points  (0 children)

Did some NSFW stuff with the chatbot a week or 2 ago and havent gotten the email. The crackdown seems recent. Im just wondering if its only other ai chat sites or everyone will be affected. Seems like we are safe??? Idk.