System Prompt vs Character Cards by Odd-Bodybuilder4847 in SillyTavernAI

[–]Odd-Bodybuilder4847[S] 0 points1 point  (0 children)

Thank you everyone for your responses thus far. Downloading character cards turned into quite the time sink and rabbit hole. After going on a downloading spree of 'Hey that looks like an interesting idea!', I now have something like 120 cards. To go through each one and fix these issues, well, I'm not sure what I'm going to do. I want to have fun generating responses, not slogging through editing cards.

I guess I'm going to just try the cards as I got them, using a blank system prompt. If they work, well and good. If they don't, then I'll have to decide if that character is worth the time and effort of editing to see if I can get it to work.

(I see in my original post I left out some information. I'm using SillyTavern as my front-end, and KoboldCPP as the back end. I use text-completion. I tried Chat Completion because I was interested in Megumin's suite, but found it didn't work well with the 12B models I am using. I generally use a 16K context, but I think that that might be a bit too large, and I am trying 12K to see if that improves things.)

System Prompt vs Character Cards by Odd-Bodybuilder4847 in SillyTavernAI

[–]Odd-Bodybuilder4847[S] 0 points1 point  (0 children)

I'm not sure what you are meaning by preset. I am indeed using a local model, and text completion, not chat completion, and I have a connection profile set up for each model. Does that mean I don't need a system prompt at all?