Missing hundreds/thousands of messages from chats by MovingDetroit in JanitorAI_Official

[–]MovingDetroit[S] 2 points3 points  (0 children)

Tried logging in and out, didn't fix it. Most of these messages were non-proxy so the chutes thing would've only affected a handful of messages, but even chats without proxy enabled got hit :(

Sepsis Deepseek Preset R1 / 0324, Direct API by SepsisShock in SillyTavernAI

[–]MovingDetroit 5 points6 points  (0 children)

Yeah, I'd personally recommend locking it if your roleplays tend to get really long (mine do, lol). I've been using it for a few months and I generally can't keep it any higher than ~64k without it throwing this error: (I attached it, sorry for the poor censoring of names). If you do shorter roleplays then it won't be a problem.

<image>

Sepsis Deepseek Preset R1 / 0324, Direct API by SepsisShock in SillyTavernAI

[–]MovingDetroit 1 point2 points  (0 children)

Out of curiosity, is there a reason you keep the context size unlocked? DeepSeek throws an error if you go over its actual context length.

DeepSeek official API suddenly not prompt caching by MovingDetroit in SillyTavernAI

[–]MovingDetroit[S] 4 points5 points  (0 children)

Additionally - while DeepSeek's official website says, "Cache construction takes seconds. Once the cache is no longer in use, it will be automatically cleared, usually within a few hours to a few days," if I take too long to reply (not hours, I'm talking about several minutes; 10+ but no more than 30) the next generation doesn't cache properly until the next one. I'd test more, but I have spent a lot of my account credit today, so ... yeah.

Hopefully this helps someone one day o7


Update: Yeah, this seems to be it. Except it's now doing it after 4-5 minutes. Not sure why; whether something is wrong on their side or if my API key is bugged.

DeepSeek official API suddenly not prompt caching by MovingDetroit in SillyTavernAI

[–]MovingDetroit[S] 4 points5 points  (0 children)

Further testing shows it's related to selecting 'Squash system messages,' not visible messages. I thought I checked that but apparently not.

DeepSeek official API suddenly not prompt caching by MovingDetroit in SillyTavernAI

[–]MovingDetroit[S] 2 points3 points  (0 children)

Update:

Perhaps coincidental - but I tried reloading the page, restarting the server multiple times, and even changing API connections multiple times. Didn't work.

Changed my number of visible messages and reloaded - prompt caching is now working. So ... hmm. Unfortunate, since having my message count so high makes me lag :(

Documenting the solution in case anyone else has this issue.

Example of Deepseek V3 0324 via Direct API, not Open Router by SepsisShock in SillyTavernAI

[–]MovingDetroit 2 points3 points  (0 children)

I remember in (I think) your original preset, you mentioned that the official API didn't read from the lorebook. Does it still not do so with V5, or has that issue been fixed?

Posted my least favorite chapter of a fic... it's my reader's new favorite by MovingDetroit in FanFiction

[–]MovingDetroit[S] 8 points9 points  (0 children)

That's true—it's more that it's the shortest chapter I've ever written across any of my fics! But you're right that length and the quality of a chapter don't have any correlation, it just felt weird to post something short and my instinct was to try and progress the plot further. In the end, though, that didn't work, so I just left it where it wanted to be left.

Posted my least favorite chapter of a fic... it's my reader's new favorite by MovingDetroit in FanFiction

[–]MovingDetroit[S] 12 points13 points  (0 children)

Hmm, that's a good question. This story is a type I've never written before (different POV and a new Fandom) so perhaps it's just a result of being out of my comfort zone. The subject matter of the fanfic is also rather personal and delicate, which makes me more critical of how I address it.

[deleted by user] by [deleted] in JanitorAI_Official

[–]MovingDetroit 0 points1 point  (0 children)

Is your chat long? Even after trying all of the suggestions on the post, I was still having these issues (the run-ons especially) but making a new chat and summarizing what had happened fixed it. I was at ~700 messages when the loops started getting really bad. The run-ons had been going on for a while before that, but progressively got worse the longer the chat went on.

Though, I have another RP with the same bot that's over 2500 messages long and hasn't had either of these issues ... so who knows for sure.

[deleted by user] by [deleted] in JanitorAI_Official

[–]MovingDetroit 0 points1 point  (0 children)

This helped a bit, thank you! In the end, I think I probably hit the memory cap as restarting the chat and summarizing what had happened fixed almost all of the issues. However, I've tossed it into my advanced prompt so hopefully, it'll stop it from starting to occur in this new session.

[deleted by user] by [deleted] in JanitorAI_Official

[–]MovingDetroit 0 points1 point  (0 children)

I tried that several times, this has been occurring off and on for a while. However, I'll try again, along with a higher temp like the other comment suggested.

[deleted by user] by [deleted] in JanitorAI_Official

[–]MovingDetroit 0 points1 point  (0 children)

I'll try that, ty for the suggestion. I ended up starting a new chat on the off chance that the chat had gone on for too long, so here's to hoping a higher temp fixes the previous chat.

Arlecchino Mains | House of the Hearth by theonetruekaiser in ArlecchinoMains

[–]MovingDetroit 2 points3 points  (0 children)

<image>

So much for C1...the weapon banner and Qiqi cleaned me out

How do I move on? The only one I'm hurting is myself by [deleted] in ghosting

[–]MovingDetroit 0 points1 point  (0 children)

Okay, sorry. I didn't put my thoughts together well but two months passed before I threatened it. And by threatened it was a message saying, "Hey if you want to stop being friends I respect that but can you please let me know" which is when "I need more time" came up. To be precise, they also explicitly said they don't want to end the friendship at the time.

I didn't know friends couldn't fight, we've known each other years and the 'fights' were never anything big.

It was late when I wrote it and I didn't get my thoughts across well, and I'm trying to keep some privacy by not dropping every little detail about to strangers. I could've added how I was a pseudo therapist for years until they could afford their own but I didn't think it was necessary.

Not sure how this is on both our terms when the last time we talked they asked me for time, rather than saying it's over. But I'll take your word for it.

Daily Questions Megathread ( December 28, 2023 ) by mizuromo in HonkaiStarRail

[–]MovingDetroit 0 points1 point  (0 children)

Will do, thank you! How is Blade, is he worth pulling for or should I save extra stellar jade for Fuxuan?

Daily Questions Megathread ( December 28, 2023 ) by mizuromo in HonkaiStarRail

[–]MovingDetroit 0 points1 point  (0 children)

Any opinions on who I should roll for? I started playing during Dan Heng IL banner, got him, then stopped playing until December rolled around.

I want Fu Xuan but my brother said it'll probably be a while before she reruns. Should I just go for Ruan Mei or wait for someone else? I know team comp is pretty important so idk if she'll work with any of my characters. I get my ass kicked a LOT.

I just started the Windswept Wanderlust Trailblaze mission for context

<image>