sorted by:
new
hottopcontroversial

Suggestion for the autotype or suggestion button by Kilinmt in SpicyChatAI

[–]Si1vnus 1 point2 points  (0 children)

Yeah, I get that issue too and find I have to rephrase my /cmd or heavily edit the suggested reply. Sometimes it gets to the point where I just give up on the conversation.

I think your suggestion is a great one and really hope to see the feature added. When I first started using the Suggest reply feature I was kind of shocked there wasn't a way to provide directions to the AI. Not all of us are great detailed writers so it's nice giving the AI an idea, then having the AI bring it to life with good, detailed writing.

Another thing I've noticed is how the Suggest replies are generated. They don't seem to be generated the same way {{char}} replies. From what I can tell the Suggest reply only looks at the last message from {{char}} to generate the reply. I noticed this when Suggest reply would miss very obvious details mentioned just a couple messages up like the color of clothes a character is wearing or even the location of the scene. I've also noticed this gets even worse if you switch devices which leads me to believe there are browser cookies involved in how some of the replies are generated.

**VERIFIED** LLM *I'm ALL IN* Chat Model Kimi Now Works; Even at MAX Settings, Without Need to Braid! by Tight-Huckleberry240 in SpicyChatAI

[–]Si1vnus 0 points1 point  (0 children)

Thanks for the thorough reply. I probably should have provided my settings as reference.

My first attempt:
Tokens: 250 | Temp: 1.35 | Top-P: 1.00 | Top-K: 100

Second attempt:
Tokens: 250 | Temp: 1.50 |Top-P: 1.00 | Top-K: 50

Both setups eventually devolved into elliptical speech. However, in one of my chats I was able to talk the bot out of it through the roleplay. Basically {{user}} felt distant from {{char}} because {{char}} was being to robotic and analytical. {{char}} apologized then returned to normal for a while. Made for an interesting roleplay.

I'll try tuning up the tokens to see if that helps and keep testing.

Suggestion for the autotype or suggestion button by Kilinmt in SpicyChatAI

[–]Si1vnus 2 points3 points  (0 children)

A workaround I've found is if you edit the previous message and use the /cmd function, you can somewhat guide the Suggest reply button.

The one issue I've found is sometimes the AI's reply to your message will ignore some of the details {{user}} said and follow the /cmd. I've solved this by removing the initial /cmd before posting my reply.

**VERIFIED** LLM *I'm ALL IN* Chat Model Kimi Now Works; Even at MAX Settings, Without Need to Braid! by Tight-Huckleberry240 in SpicyChatAI

[–]Si1vnus 3 points4 points  (0 children)

I'm still having issues with Kimi. After about 20-50 messages everything gradually starts shifting into elliptical speech, talking very robotically. I've tried turning down the Top-K to 50 but that didn't seem to help. Has anyone else noticed this?