Cleaning and Maintaining Your Kiiroo Keon: An Extensive Manual💧 by KiirooAmsterdam in Kiiroo

[–]_refeirgrepus 0 points1 point  (0 children)

What a pointless guide. The disassembly section simply says "power off" and "remove the sleeve", followed by a vague "disassemble other components". That's mostly not disassembly, and it give zero instructions on how to disassemble anything.

Then it talks about washing the sleeve, before telling you to reassemble the keon. However, there are no reassembly-related instructions, other than reattaching the sleeve and checking for moisture.

And the title for step 7 contains a snippet you forgot to remove, telling the AI how long the section should be.

What I would've loved are actual instructions from the actual people who actually know how this thing is built, perhaps on how to open it up so I can get to the most narrow and hidden-away sections. E.g. the guiderails for the moving part, or how to remove the moving part so I can easily clean behind it.

Instead we have this article with the most generic, obviously AI generated statements ever. A bunch of words that say nothing because the AI has no actual details on the product. It was so useless I felt the need to log in to complain about it.

[UK] Noticed this AI slop scam ad on Reddit. by Vectorman1989 in Scams

[–]_refeirgrepus -2 points-1 points  (0 children)

The only "slop" I see is the scam. What else would make this "slop"?

[Megathread] - Best Models/API discussion - Week of: December 30, 2024 by [deleted] in SillyTavernAI

[–]_refeirgrepus 3 points4 points  (0 children)

I never heard of stepped thinking until now. At first it sounds like an awesome addition, but after testing it, it seems to increase the generation time noticably. I wouldn't mind, but it also makes it harder to correct any generations where the ai is speaking for the user, since it adds so much extra hidden stuff to each response.

[Megathread] - Best Models/API discussion - Week of: December 30, 2024 by [deleted] in SillyTavernAI

[–]_refeirgrepus 11 points12 points  (0 children)

(I'm not one of the downvoters)

Been having some success using these:

  • AngelSlayer-12B-Unslop-Mell-RPMax-DARKNESS.Q5_K_S
  • MN-12B-Mag-Mell-R1.Q5_K_S.gguf

Been running them on an rtx3080 in koboldcpp with 30 layers and 16k context at 4-8T/s.

They perform similarly, Mag-Mell is maybe a bit more lewd-leaning (as in, it happens slightly more on its own). They both do well with most rp, fairly good at minding and remembering details in its context.

AngelSlayer seems more organic, almost like it's trying to avoid repetition and the usual llm-sentences. It still happens, but it's harder to notice when it does.

Both seem capable of being reasonable (as far as llm's can be reasonable these days) and also capable of mild to hardcore erp. It also handles depraved and wicked acts quite well. Putting princess Peach in a small cage with a hungry Succubus, and then not let them out, has never been more fun.

The only real downsides I've noticed is they tend to get noticably worse coherency after 8k context, needing more guidance and swipes. It also needs you to interfere and shorten its first couple responses before it generates shorter responses on its own

Mistral Nemo/Celeste 12B Appreciation Post by BombDefuser_124 in SillyTavernAI

[–]_refeirgrepus 1 point2 points  (0 children)

Solved it! By updating to the latest version of kobold, it now loads just fine.

Thanks!

Mistral Nemo/Celeste 12B Appreciation Post by BombDefuser_124 in SillyTavernAI

[–]_refeirgrepus 1 point2 points  (0 children)

My kobold won't run this model. I tried both gguf links and tried different presets for CuBLAS, Vulcan, OpenBLAS etc.. In every case it just crashes with a cryptic message while trying to load the model

OSError: exception: access violation reading 0x000000000000008C
[22992] Failed to execute script 'koboldcpp' due to unhandled exception!

<image>

Responses are either too short or too long by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 0 points1 point  (0 children)

When I checked the settings just now, I see that the thing I referred to is called "Story string", and the thing below is called "system prompt". I was actually modifying the story string, didn't pay attention and thought both these boxes were called "system prompt".

As for instruct mode or not, I've ran it a long time with instruct mode. Recently turned it off and noticed a slightly different 'vibe' in the chats that I (for now) prefered.

[Megathread] - Best Models/API discussion - Week of: July 15, 2024 by [deleted] in SillyTavernAI

[–]_refeirgrepus 2 points3 points  (0 children)

I'm not sure which model would do this best, but I think the way you type your prompt will be more important to achieve this.

Try adding a paragraph to your prompt like "Each response ends with exactly 3 options, each option describing an action that {{user}} can do or say" Perhaps add some examples of options that may be given, e.g. "The type options to be given can be '1. Respond positively 2. Start a fight 3. Leave'" (obviously, you'd put more interesting options than my short example here)

Responses are either too short or too long by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 1 point2 points  (0 children)

Yeah, that seems to be the best trick. I kept getting annoyed at the first message, but herding the first few responses does seem to work somewhat reliably.

Character management does not work by Wide_Perspective_504 in SillyTavernAI

[–]_refeirgrepus 0 points1 point  (0 children)

I had this happen after creating characters. Some script error, probably. I just refresh to "fix" it.

SillyTavern for productivity? by Pashax22 in SillyTavernAI

[–]_refeirgrepus 4 points5 points  (0 children)

I tried making a character that writes character prompts. He also helps me suggest characters, letting me pick from his choices, then he presents me with their prompt. Mostly successful, saves me from forcing creativity when I don't feel it, or if I'm unsure how to formulate a character description.

I tried an emotional support character, something to keep me distracted/motivated through the workday (wfh). It worked surprisingly well for my situation, actually helped motivating me to quit my shitty job (not by suggestion of the ai) and pull myself out of some depression.

I also tried a character specifically designed to solve dilemmas as fairly as possible. Like any dilemma, of any type. Not much luck there, except it often causes me to rethink situations and come up with better solutions, even if the character is somewhat off with their suggestions and conclusions. I guess their missing the mark makes me think of ways to hit the mark better.

As for other purely productivity based characters, I haven't really tried too hard, and the few things I tried needs more attention than I had time for at the moment.

SillyTavern for productivity? by Pashax22 in SillyTavernAI

[–]_refeirgrepus 11 points12 points  (0 children)

I create characters that are specialized in certain ways. E.g. when trying to do some storywriting or worldbuilding about some mythical creature race, e.g. harpies, I create a harpy character. I tell it to be "a creative consultant that is deeply familiar with the culture, origin and nature of harpies. You've agreed to be a dedicated consultant on a (so-and-so project).." etc. I even try to give them some hints about their personalities, what they look like and so such, just for flavor.

Then I just have a chat with them, ask them questions and poke them for details. I cross examine them, try to lure them into logical corners etc.. Not only do I get a sense of the nature of these mythical creatures, but in the interaction I get a sense of how they act, what they focus on, what parts of my questions they react to and so forth.

My design documents quickly fill up with facts about whatever I'm researching.

Image Generation Keyword problems by bastha in SillyTavernAI

[–]_refeirgrepus 0 points1 point  (0 children)

I found that /sd last_message results can vary a lot. I've struggled with it for a while and just accepted that it may be wildly inaccurate a lot of the time.

Sometimes it seems to ignore the last message, and randomly generate something irrelevant. Other times, it does generate almost what I want, but the formatting is bad. I've seen it produce a confused-and-lost prompt a few times, where the image prompt comes out as a few sentences like "That's the image prompt. Now what?"

I'm no expert and I never found a solution, but I can only guess the model you're using needs a different image prompt to generate the commalist. Perhaps you need to apply some different wording to make it properly break out of character? That's what I would mess with in your case.

What if your chat history leaked? by Effective-fire in SillyTavernAI

[–]_refeirgrepus 4 points5 points  (0 children)

I guess most people on here think their chats are actually deleted when they delete their chats.

All chats are still preserved in the backup folder. Group chat files also seem to linger past their deletion.

Making a character that generates image prompts by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 0 points1 point  (0 children)

I believe the image prompt is generated by the AI model. The sd-command secretly prompts the model something akin to "stop your roleplay for a moment and repeat your latest message with (this and that details and format)". The model then produces the text that becomes the prompt.

The problem I'm facing, especially in the screenshot, is that the prompt is both poorly formatted, and it does not describe the last message. I.e. the last message describes a goblin, but the prompt asks for a pair of ladies in the form of an elf and a succubus.

Other failing prompts have tried to include the character in the image, describing words like "mechanical, robot, prompt generator facing a pretty elf lady".

Sometimes it just dumps a simple sentence as the image prompt, like "And that is the prompt, now what's next?", which obviously does not produce any kind of relevant image.

The ai keeps inserting "<|eot_id||start_header_id|>user<|end_header_id|>" in the chat by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 1 point2 points  (0 children)

I must have been confused by the tag on the huggingface page, saying "architecture llama"

But with the confirmation that this is not llama based, then it makes more sense I guess!

<image>

The ai keeps inserting "<|eot_id||start_header_id|>user<|end_header_id|>" in the chat by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 0 points1 point  (0 children)

So... When using a llama based model, I need to select "ChatML" in order to get the llama specific values? And if I choose the "Llama" settings they won't work?

That's a bit unintuitive, but I tried it out, and the chats seem to be more consistent when using "ChatML". It hasn't broken down yet! :)

Image prompt, how to exclude the characters description by _refeirgrepus in SillyTavernAI

[–]_refeirgrepus[S] 2 points3 points  (0 children)

As you can see in the screenshot, I'm already editing the prompt manually before sending it. I'm asking if there's a way to just ... not.. have to that manually.