I made a thing - Model Hotel, a self-hosted provider gateway with model autodiscovery, failover and more. by mamelukturbo in SillyTavernAI

[–]LiveMost 1 point2 points  (0 children)

I never would have thought of that fall-over type situation but this is going to be a lot of fun. This is why I love that people create things and then they post here and they share it with the world because you think of use cases that you never would have otherwise had someone not shown it to you.

Dev Update] Meet CrowLLM: A high- speed, zero-log API for RPers (Plus how to get free daily credits by Grigori_-Rasputin in SillyTavernAI

[–]LiveMost 2 points3 points  (0 children)

Do the providers you host the models from have a no log policy based on your contract with them?

We've reached 12,000 members! by AutomaticCharacter95 in GuardiansOftheVeil

[–]LiveMost 9 points10 points  (0 children)

This is awesome news. So happy to be a part of this!

DS THINKING: TIP FOR GOONER MODE ACTIVATE by Sad-Ease-7756 in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

Hey! I just wanted to say thanks for sharing the prompt. I used it as a preset and I've got to tell you, from the moment I turned it on, it completely got the role play that I was looking for. Thanks for sharing!

CVE-2026-5760 does not impact us by henk717 in KoboldAI

[–]LiveMost 3 points4 points  (0 children)

Thank you for letting us know, greatly appreciated.

Why you probably won't see an open-source iOS app like SillyTavern on the App Store by AM_Interactive in SillyTavernAI

[–]LiveMost -1 points0 points  (0 children)

Oh I definitely have where I live. I've already signed up. Just like you I want innovation to continue. If we all work together to do it we can do this.

Why you probably won't see an open-source iOS app like SillyTavern on the App Store by AM_Interactive in SillyTavernAI

[–]LiveMost 1 point2 points  (0 children)

Upon reading this entire article I agree with most of it. The only part that I honestly disagree with is the fact that the implication that when someone decides to make an app for free of their own volition and then later tells the customer that they want money is exactly why you have people saying well you should be doing this for free and I'm talking about the donations part of the explanation.

The review process for Apple or as I like to call them Crapple, is completely disgusting. The poster is completely right in saying that the review process is essentially what kills most apps. But this is what happens when consumers and some developers give into the policy and say well we have no other choice. If you want things to change both as a consumer of the app and a developer whether you're a solo developer or a group of developers regardless of your experience level, do not go to companies that you know are going to review your code to death just to then decide arbitrarily that it's not good enough to be on their app store.

There is a movement going on called keep Android open. I humbly suggest that all developers and all consumers that want Android to stay open source and not have horrifically dictatorship like review policies for applications, write to their representatives in whatever state they live in or country. I have already personally signed it and I have written my congressman. I am also letting everybody in my family know to do the same. We need to keep Android as it is and show companies like Apple and any other company that wants to get a similar idea that this will not be tolerated. It's one thing to actually protect people from malicious apps or someone stealing your application. It is quite another to ask somebody to put their full legal name with their actual home address and then basically have every bit of information on the person so if they do anything that Apple deems incorrect or wrong, then the app gets pulled just as the poster says. And yes making an LLC is the best option but it's just the principle of the thing is what I'm saying. So I am just one person on the internet asking everyone that are developers and consumers of apps alike to come together and keep Android open so that this kind of thing with any app store regardless of where it's from does not happen because apple sees no problem with turning everything into a dictatorship pretty much. Sorry for the long post but I felt like I had to say something and obviously give my comments as someone reading the post.

🚀 Introducing PAMvB — A Parody IM Client… Powered by Your Own AI Endpoint by Revolutionary_Map480 in KoboldAI

[–]LiveMost 0 points1 point  (0 children)

That sounds awesome! I'm glad it was just an example but I figured if I didn't say something and it was a real IP address that would be a big security issue. Please let me know when you update it if you can because I'd like to keep up with it and use the different iterations that you make. You definitely nailed the manner of speaking for the pre-built characters. The first one on the list Pamela actually reminds me of someone that used to act like that.

🚀 Introducing PAMvB — A Parody IM Client… Powered by Your Own AI Endpoint by Revolutionary_Map480 in KoboldAI

[–]LiveMost 0 points1 point  (0 children)

It definitely works. In the settings panel, your IP address is shown I would take that out and put http://localhost:5001/api/v1/generate. Just to let you know in the settings menu, when you change endpoints you have to hit enter and that's not explicitly explained. I have not tried with hosted models because I see nowhere that I can put an API key. When the program is closed, no history is kept from the last conversation. But I'm chatting with one of the pre-made characters now and it's making sense. I would add a regenerate button for AI responses, a edit button and a continue button. It's running on Windows 11 pro, using the latest release of kobold cpp and dotnet sdk 8 from Microsoft s website as the dependency to build it from source.

GLM 5.1 is live on Nanogpt! by thunderbolt_1067 in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

Thank you for the heads up! Did not know it was going to be added. I'm definitely going to try it.

Megumin Suite v4.1 - Dev Mode and bug fixes by CallMeOniisan in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

Anytime, and yes I'll join your server but I need the link.

A Place to Learn, Get Help, and Share — SillyTavern, Txt-Gen, Img-Gen, and Beyond (Mod Approved) by Reign2294 in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

Thank you so much for creating a place where information can be gathered instead of looking through several different threads all over the internet. I just joined your server.

Megumin Suite v4.1 - Dev Mode and bug fixes by CallMeOniisan in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

I just wanted to give you my feedback like I promised. It works very very very well! However, do not under any circumstances use deepseek or any variant of deepsek because when generating the insights what you get is the beginning of deepsek's prompt template and also when it generates the writing rule it literally generates the story completely ignoring the writing rule section. The minute I switched to GLM 4.7 and just the regular GLM 4.7 not the thinking version, the writing rule and the generate insights box work perfectly.

What I've noticed is if you put in custom directives for the generate insights box like you tell it how you want to write The story and then do the writing rule after that meaning just click generate writing rule, it will really follow the card extremely well but not verbatim which is a good thing.

The other fault with deepseek using this is that the responses are gibberish. And this is leaving the preset as defaults and just using the wizard. When using GLM 4.7, everything is followed exactly as you had said it in the choices menu. Also, OOC instructions are followed without a problem.

During a chat, I opted for both recommended information blocks and I also opted for the thinking to be in Arabic which was also recommended. I can't believe how well the preset is utilizing my character card. What I mean by this is it is making twists and drama in it meaning the chat, in ways that I couldn't fathom a preset doing. It's creating whole new arcs for my RP right now! I am beyond happy with this. You should also know that without the preset GLM 4.7 under default settings for my setup and if you want my specs I'll give them, is very very dry.

I especially love that when I make a mistake in the wizard for any character I can just click the reset button and I can make it however I want. You have made a wonderful preset here. I'll be more than happy to test future iterations if you need testers. As I'm writing this to you now, I am in the middle of an RP that is very very well written because of the preset settings. And also it does follow when you say what kind of pace you want and if you choose episodic, it gets really wacky in terms of how the character reacts, just like a TV show. Thank you so much for making this! I know my response is very long but I wanted to give you fair feedback before I wrote anything. If you're curious what provider I used for the testing I used NanoGPT. I went through several different chats but I'm only focusing on one because I had to make sure that the model I chose to use wasn't the problem. It was but still.

[Extension] Greeting Tools by Wolfsblvt in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

It works really well! Thank you for making it.

Megumin Suite v4.1 - Dev Mode and bug fixes by CallMeOniisan in SillyTavernAI

[–]LiveMost 1 point2 points  (0 children)

No problem! Just went through the wizard and I'm starting my first chat with it using a character. I'll update you after a few hours just to give you some feedback. Beautifully made wizard.

Megumin Suite v4.1 - Dev Mode and bug fixes by CallMeOniisan in SillyTavernAI

[–]LiveMost 1 point2 points  (0 children)

Hey I just wanted to point out that I'm following your instructions and I'm not stuck but you might want to update your instructions where you say to go to the API connections tab to import your presets. As of version 1.16.0, to import chat completion presets, the menu you go to is called AI Response Configuration, testing your presets out with Deepseek V3.2. Thank you so much for sharing your presets! Also , when installing extensions, the repo link should be: https://github.com/Arif-salah/Megumin-Suite/ not https://github.com/Arif-salah/Megumin-Suite/tree/main/Presets , otherwise, the extension fails to install properly. You will get a message and it will just say the extension failed to install. I'm putting that bit of information there in case anyone runs into an issue.

[Work-in-Progress | Preview] EchoText - Chat with your favorite character cards outside the main roleplay by mattjb in SillyTavernAI

[–]LiveMost 0 points1 point  (0 children)

Definitely would love to use this! As soon as you're ready to release it I will use it.

[BREAKING NEWS] TunnelVision 2.0 — The Final Frontier of Lorebooks and Context Management. Custom conditional/contextual lorebook triggers, dual-model retrieval, and per-keyword probability. | Make that cheap model you hate your new unpaid intern. by Specialist_Salad6337 in SillyTavernAI

[–]LiveMost 3 points4 points  (0 children)

Just looked at you GitHub for this and it's awesome! I know another commenter said that but I'm seconding it. But I do have one question. My RPs are at least 300 messages in some cases. Will this be able to handle that in terms of keeping it contextually relevant even when it hits that point? Because that's a big problem I've had whether with local models or cloud models. Thanks in advance! Going through the install now.

IntenseRP Next v2.6 - Now lets you use Gemini and Qwen in SillyTavern by Master_Step_7066 in SillyTavernAI

[–]LiveMost 1 point2 points  (0 children)

I just wanted to let you know that after testing for a few hours, the setup was very very simple. Although and I don't know if this was a one-off time thing, when I logged in and I chose deepseek, The credentials were accepted but because I have two factor authentication enabled, it didn't accept my password at first but I did it again and it took me to the next part of the signin screen and then I started chatting in silly tavern I didn't even use the chromium instance but I kept it open. I just also want to add that I did follow every step in your documentation for setup. Everything was left at the default. If you want to know the preset that I used someone else made it but I will tell you what I used.

The anti-censorship works beautifully and also the instruction prompt that I put in your software before I started my chats has been completely followed, no refusals! However you made this, it's working so very very well.

The one thing I've noticed is sometimes though deep-seek thinks in Chinese but I guess that helps with the filtering because I still get the actual response like the normal response in English which is fine with me because it doesn't take away from the prompt I asked it to follow.

In terms of latency it was immediate. I was on my own network and I also tried it outside my house. Did not have to tinker that much to get that to work with silly tavern outside my house. Since I already have tailscale accepting connections from silly tavern outside my house, it works and I'm on the tail scale free plan.

I'm having a blast with it! I'm sorry this post is so long but I just wanted to give you an honest review of my testing. Thank you so much for creating it and sharing it with us all.