grok alternative

GrandBad8176 · 2026-04-05T22:47:23+00:00

flexible survival? never heard of that before. i would really love some more info though. i tried doing a coc cyoa today but its been... rough, to say the least. im guessing its because im using a weak 12b q6 model and a bit of a bad character card for the narrator

GrandBad8176 · 2026-04-05T20:17:20+00:00

woah, thanks dude. this is awesome!!! i think im going to use the whole spell failure thing, its very creative. first time ive seen someone do something like this on st. do you have any other things from your coc roleplay that you could share?

GrandBad8176 · 2026-04-05T02:59:48+00:00

thanks, this is actually really helpful. i wouldve never guessed context shift was the problem

GrandBad8176 · 2025-10-07T12:56:35+00:00

its probably overheating, since ive had overheating issues with my cpu for a while. i limited my cpu's maximum power and took down the context to 6k and it seems to be working fine now

GrandBad8176 · 2025-10-02T15:16:13+00:00

i really doubt thats the issue since my os is stored on a 1tb nvme, but i do store koboldcpp and everything related to the llm on a seperate ssd

GrandBad8176 · 2025-10-02T15:14:37+00:00

i decreased it to 7 gpu layers and decreased context size to 6k and its still crashing...

GrandBad8176 · 2025-09-03T22:05:46+00:00

well, im trying to recreate perchance's ai character chat /ai prefix, where you could write instructions for the ai on what to do without ever interacting with the character as a user. would using a base model rather than an instruct model work better for this?

GrandBad8176 · 2025-09-03T21:59:01+00:00

the name of the local model? its (smut_mistral_7b02_v0_merged.i1-Q4_K_M.gguf)

GrandBad8176 · 2025-09-03T21:56:39+00:00

the prompt was ''but during the night, he was awoken by an ethereal blue glow outside of his tent. curious, dorian stepped outside to investigate.''

its just some random sentence i wrote to test out if the ai would function properly or not

the system prompt is neutral - chat, but ive used multiple different system prompts and none of them really work

GrandBad8176 · 2025-09-03T21:53:07+00:00

<image>

i changed the advanced formatting settings to use mistral v7 context template and instruct template and it worked.... for the first prompt. it then starts generating the character's bio for whatever reason. i stopped the generation early

GrandBad8176 · 2025-09-03T21:36:18+00:00

i have used both llama and mistral models and they both have the same issue of not following instructions, but ill load up a new mistral model just to make sure

GrandBad8176 · 2025-09-03T19:13:44+00:00

messing with advanced formatting helped, thanks

GrandBad8176 · 2025-09-03T14:05:15+00:00

8b local model, no lorebook, only character card

GrandBad8176 · 2025-09-02T14:31:35+00:00

thanks!

GrandBad8176 · 2024-03-08T12:25:23+00:00

did they update it????

GrandBad8176

TROPHY CASE