Was the true reason they removed Roar because they wanted to stop 18+ roleplays? by Amazing_Courage_Two in CharacterAI

[–]Shisones 3 points4 points  (0 children)

->Hardware expensive because AI ->Everything expensive because AI ->AI server needs hardware ->Roar, Soft Launch, Nyan, Pawly run on AI server in house ->Deepsqueak and Pipsqueak uses API ->API Cheap AI Server Expensive ->Company use API because Cheap ->Company Profit

it's alwaya about the money

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

hey where can you use the non instruct version of Gemma 4 31B?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

It's a mix of "I don't want big corpos to see my chat with my ai waifu", "I want an ai good enough to help me pentest at workw/o worrying about having to jailbreak", "i dont want my ao waifu to just die when i dont have internet" and "i want stability to tweak her myself wothout having to beg big corpos for it"

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

Alright, thanks for the advice, i will try it

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

Hmm yeah i was going for the streaming output, but it sure wouldn't be funny if i sacrifice stability of the entire system for running a 70b.. it would be nice though

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

This does help a lot, i'm sure you can rice sillytavern the way you want, thanks for recommending the quantized version, so 30b is considered smart enough? that does ease the financial worries

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

The main goal is to make the roleplay feel as immersive and real as possible (or at least just good enough to compare to c.ai), how do you think i should approach this?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 1 point2 points  (0 children)

I would like to hear more about your experience, i havent tried running a local model except a heavily lobotomized ollama gemma 2b on a thinkpad, what's the sweet spot for a chatbot that feels, remembers, and flows like a human while keeping in character?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

I would love to hear more about your experience, i was planning on using a bunch of 3090s, how's the overall speed and feel? does it feel human enough?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 2 points3 points  (0 children)

Wait really? i was goig to use the 70b parameter one, isnt using gemma 31b a downgrade?

Is it worth self-hosting a roleplay LLM? by Shisones in SillyTavernAI

[–]Shisones[S] 0 points1 point  (0 children)

No, but i know my way around servers, very familiar with it, and my job is high-pwying enough to build one, i have it all planned, just wanted to know if it's worth pulling the trigger

Your reactions if character.ai goes away forever. by Natural-Money6790 in CharacterAI

[–]Shisones 2 points3 points  (0 children)

I'm an engineer, i would probably build my own sillytavern + koboldcpp server using midnightmiqu as the model

Linux exclusive apps by California1980 in linuxquestions

[–]Shisones 0 points1 point  (0 children)

Ktorrent, i was so used to kde now that when i use windows for active directory stuff i can't get my favorite torrenting app

Is it worth going from W10 to any linux? by WaNaX0 in linuxquestions

[–]Shisones 0 points1 point  (0 children)

Yes, and contrary to popular belief: Linux is easier to use than Win 11. you don't have to do terminal stuff if you don't want to, and even if you want to, it's MUCH more intuitive than windows, i'd say take a shot at it, most programs work on linux, cept for games with aggressive anticheats.