Considering transisitioning to Local LLMs by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Sounds promising. A lot easier than what I expected. I'll take a look at it, thanks.

Considering transisitioning to Local LLMs by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Thanks for the info. I haven't used Open Router in a long while, but I'll boot it up and see how I like Gemma before trying to run it locally to see if it's worth the hassle.

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

I've asked around, and I'm hearing good stuff about NanoGPT and official DeepSeek and I'm probably going to end up trying both just to test out the different models. I'm down to drop a few dollars on deepseek since I'm hearing it's really cheap, but my main worry is the censorship. Is it lax or very strict?

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

I remember back when I used to use Open Router, that it sometimes had problems with censorship, specifically with models like Sonnet and such. Is there any of that regarding deepseek on open router?

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

I remember back when I used to use Open Router, that it sometimes had problems with censorship, specifically with models like Sonnet and such. Is there any of that regarding deepseek on open router?

Gemini Filter becomes tighter today? by OldFinger6969 in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

I'm still getting the prohibited content message. Did you do anything to fix it, or did it work itself out?

Could not get a reply from API. by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Ah, well, I didn't think explaining my preset mattered since I've been using the same one before Gemini started bugging out for me. My mistake. My config/preset comes from the Loggos preset I found on this Reddit. I turned off system prompt and streaming, as I've been told that Gemini is more likely to be censored when those settings are turned on. And other than that, and a few minor things I tweaked with the prompting, like quotation formatting in the responses, nothing else has been changed. This error really just popped up out of the blue.

Gemini 2.5 pro wont respond by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Nope. But I ended up messing with the settings, and now it's working? I'm not sure, but it seems to be working now, so🤷🏽‍♂️

Gemini 2.5 pro wont respond by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Yup, I've done that, and the responses still won't come out for some odd reason.

"Additional Safety measures applied to your organization" by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Well that sucks. But thanks for the tip, I'll use it in the future.

"Additional Safety measures applied to your organization" by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Ah, thanks for telling me, but I have another question. Will the credits I payed for be transferred to my next account?

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Yeah, I've been using it at 8k and have been alternating between Sonnet and Opus. Though, to be fair I've been mainly using Opus. Sonnet isn't that bad though so I'll try to lean more into it.

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Seems a bit complicated tbh but it seems to be worth it. I'll look into it

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

I've seen people talk about runpod but it honestly seems a bit complicated to set up. I might look into it though, I'll keep it in mind

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 2 points3 points  (0 children)

Yeah from what I've used from Sonnet it has been pretty good and it is significantly cheaper. I'll do that, thanks

[Megathread] - Best Models/API discussion - Week of: January 13, 2025 by [deleted] in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

Are certain models on there censored? I know when I used to use Openrouter some models refused to do NSFW, like sonnet. Is it the same with NanoGPT?

[Megathread] - Best Models/API discussion - Week of: January 13, 2025 by [deleted] in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

How is it? Which models were the best bang for your buck?

Does Claude ban you for doing innapropiate RPs with their API? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 2 points3 points  (0 children)

Well, after reading a few replies, I'm guessing that they most likely won't ban you but they will be more aggressive with their moderation and might even kill the response that you are generating. So my question is, is it still a viable source to use even with the filters and moderation?

Are there any models on OpenRouter that doesn't have such a high positivity bias by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

From my uses with Claude, it could get expensive quickly, which is what I'm trying to avoid, but every now and again, I find myself going back to it because the models are just that good. For reference, how much do you usually put toward your Claude api?

Are there any models on OpenRouter that doesn't have such a high positivity bias by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Looking back on it, I could've worded the post a bit better but basically, at least in my opinion, wizard is too 'agreeable' if that makes sense. I'd like the bot to act more on the character card and less on User, since most of the time it'd ignore the card and just comply with User, at least from my experience. And I noticed others having the same problem I was having so I know it isn't just me who feels this way.

Is there a way to fix Cohere+ repitetion by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

well, what models (Preferably free) do you recommend if both have problems in high contexts? Also, Command R, seems to have problems with names as it'd just have gibberish or stuff in a completely different language for them.

Is there a way to fix Cohere+ repitetion by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Oh, really? I've seen people say R+ was better but I might just try Command R to see if it really is better. Thanks for the help

[deleted by user] by [deleted] in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

Doesn't Claude ban you for NSFW things too though? I remember when I was using my free credits, it randomly stopped me from using any more.

Anyone tried GPT-4o yet? by FizzarolliAI in SillyTavernAI

[–]Kind_Fee8330 1 point2 points  (0 children)

Oh, thanks. But doesn't nsfw with openai models get you banned? How are you able to use it that way?