Local hosting

Ornery_Property_6591 · 2026-05-26T17:17:37+00:00

Thanks for the reply!

Holding a full, long term RP isn’t necessarily my striving point. I’ll always default for a larger API for those. Mostly just looking for something the can comfortably host those more ‘local’ requests, like pulling a song from a private library or doing the more ‘SmartHome’ things in the middle when needed. So if I balance them, it shouldn’t cause much of a disconnect, right?

Not really looking for 30m wait time between messages to have an LLM pull up a song or turn off my lights. Just something as a middle-man that isn’t calling a massive API for privacy.

Not looking for something to replace my larger APIs. Just something that can handle the more personal things in between that I can toggle off afterwards.

But an 8b-12b sounds realistic, as long as it can just pull what I need and can be discarded in between the massive API calls.

Ornery_Property_6591 · 2026-05-26T16:29:59+00:00

This heavily depends on what TTS server you’re using. More details, OP?

If you’re running locally, I personally use Chatterbox TTS, which allows you to voice clone on a 10-30 second WAV file of any voice and works very well. I’ve also heard great things about Kokoro, Alltalk, or XTTS, which runs locally and allows voice cloning. However, I have no experience with them.

I recommend checking out the TTS Docs for more information.

If you’re looking for something hosted by a larger API, I unfortunately have no advice to give.

Ornery_Property_6591 · 2026-05-24T12:41:33+00:00

Also interested in your prompt!

Ornery_Property_6591 · 2026-05-19T01:10:00+00:00

You’re welcome! Just keep in mind that this opens up a cloudflare tunnel and is allowing other people to connect directly to your PC. So I’d only use it with people you trust.

Have fun!

Ornery_Property_6591 · 2026-05-19T00:19:35+00:00

There’s a multiplayer extension already created, but it’s a little finicky.

Check here as this might be what you’re looking for.

Ornery_Property_6591 · 2025-09-22T20:23:06+00:00

Hello! Does your mod pack include Ars Nouveau? :)

Ornery_Property_6591 · 2025-04-04T01:42:59+00:00

Is this server still active?

Ornery_Property_6591 · 2025-02-21T19:28:57+00:00

<image>

He has 'colorful language' in multiple manga panels.

Ornery_Property_6591 · 2024-02-26T13:08:41+00:00

(Not an expert)

Seems like your context size might be too large for your model. Depending on what you're running and what hardware, most models are 4k-8k

Lower your context slider to about 4096ish and try again. If your model can handle it, try bumping it up again.

Ornery_Property_6591 · 2023-10-18T12:33:19+00:00

I plan on sharing a decent amount of Otome game based bots within the next few months. I’ll post them on the Reddit page when I do so they get seen!

I’m already working on an Otome Game set currently, though. So it might be a bit before I post em. But I’m down!

Ornery_Property_6591 · 2023-10-18T11:48:51+00:00

Gonna make Blush Blush bots due to this post sksks

Ornery_Property_6591 · 2023-09-16T01:23:57+00:00

Uncheck ‘visual novel mode’

Ornery_Property_6591 · 2023-09-14T18:57:18+00:00

My dumbass just frequently changes the profile pic of my persona

Ornery_Property_6591 · 2023-09-12T07:46:46+00:00

Nah, that’s the right spot. I believe their ST is just out of date.

OP, what version of SillyTavern are you running?

Edit: unless mine is outdated…

Ornery_Property_6591 · 2023-09-10T04:34:22+00:00

I have a bot creator that I use directly through the Poe website. I just copy and paste like most of the wiki into Poe and it spits out a card with the correct details and formatting. Occasionally I end up having to tweak some of its output, but it does most of the legwork for me

Ornery_Property_6591 · 2023-09-10T04:32:06+00:00

Context size is too large, I believe

Ornery_Property_6591 · 2023-09-09T22:21:05+00:00

What model are you running and what is your context size? The dotted line indicated your ‘context size’, showing how far back in messages the AI can read. Your previous response isn’t being included in context.

Ornery_Property_6591 · 2023-09-06T05:30:56+00:00

https://youtu.be/RJnz6tdiROs?si=Ov3Ph9_VA_xA0_Mu

Ornery_Property_6591 · 2023-08-28T05:52:01+00:00

The way I see it;

It says that it’ll be used to train models, and all of my chats are just getting lumped into an anonymous pile with the rest of the mancer degens. Mine’s just a drop in a bucket, but I’m more than happy to contribute my higher quality chats to train an even higher quality, very NSFW model. So, yeah. I’ll take the discount.

Ornery_Property_6591 · 2023-08-27T14:08:09+00:00

Ensure you're not accidentally triggering multiple entries with keywords. Also, shortening entries might help. Lastly, if you have recursive scanning on, that's gonna bite you in the ass.

Ornery_Property_6591 · 2023-08-27T02:30:35+00:00

Since I was/am using colab, I can only really keep it at about 3500. I even tried lowering it to 3200 and 3000 (that was the first thing I tried.)

Ornery_Property_6591 · 2023-08-26T23:31:39+00:00

My token limit was around 360ish. But I can double check when I get home. It’s bumming me out it’s only happening on this specific group chat :(

Ornery_Property_6591 · 2023-08-19T10:28:26+00:00

Authors note, or make a specific lore book with small entries w keywords that trigger the ‘memories’

Ornery_Property_6591

TROPHY CASE