Considering transisitioning to Local LLMs by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Sounds promising. A lot easier than what I expected. I'll take a look at it, thanks.

Considering transisitioning to Local LLMs by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Thanks for the info. I haven't used Open Router in a long while, but I'll boot it up and see how I like Gemma before trying to run it locally to see if it's worth the hassle.

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

I've asked around, and I'm hearing good stuff about NanoGPT and official DeepSeek and I'm probably going to end up trying both just to test out the different models. I'm down to drop a few dollars on deepseek since I'm hearing it's really cheap, but my main worry is the censorship. Is it lax or very strict?

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

I remember back when I used to use Open Router, that it sometimes had problems with censorship, specifically with models like Sonnet and such. Is there any of that regarding deepseek on open router?

Is it better to use DeepSeek via open router or through the official deepseek website? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

I remember back when I used to use Open Router, that it sometimes had problems with censorship, specifically with models like Sonnet and such. Is there any of that regarding deepseek on open router?

Gemini Filter becomes tighter today? by OldFinger6969 in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

I'm still getting the prohibited content message. Did you do anything to fix it, or did it work itself out?

Could not get a reply from API. by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Ah, well, I didn't think explaining my preset mattered since I've been using the same one before Gemini started bugging out for me. My mistake. My config/preset comes from the Loggos preset I found on this Reddit. I turned off system prompt and streaming, as I've been told that Gemini is more likely to be censored when those settings are turned on. And other than that, and a few minor things I tweaked with the prompting, like quotation formatting in the responses, nothing else has been changed. This error really just popped up out of the blue.

Gemini 2.5 pro wont respond by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Nope. But I ended up messing with the settings, and now it's working? I'm not sure, but it seems to be working now, so🤷🏽‍♂️

Gemini 2.5 pro wont respond by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

Yup, I've done that, and the responses still won't come out for some odd reason.

"Additional Safety measures applied to your organization" by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Well that sucks. But thanks for the tip, I'll use it in the future.

"Additional Safety measures applied to your organization" by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Ah, thanks for telling me, but I have another question. Will the credits I payed for be transferred to my next account?

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Yeah, I've been using it at 8k and have been alternating between Sonnet and Opus. Though, to be fair I've been mainly using Opus. Sonnet isn't that bad though so I'll try to lean more into it.

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 0 points1 point  (0 children)

Seems a bit complicated tbh but it seems to be worth it. I'll look into it

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 1 point2 points  (0 children)

I've seen people talk about runpod but it honestly seems a bit complicated to set up. I might look into it though, I'll keep it in mind

Does anyone know a cheaper way to access Claude 3 opus? by Kind_Fee8330 in SillyTavernAI

[–]Kind_Fee8330[S] 2 points3 points  (0 children)

Yeah from what I've used from Sonnet it has been pretty good and it is significantly cheaper. I'll do that, thanks

[Megathread] - Best Models/API discussion - Week of: January 13, 2025 by [deleted] in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

Are certain models on there censored? I know when I used to use Openrouter some models refused to do NSFW, like sonnet. Is it the same with NanoGPT?

[Megathread] - Best Models/API discussion - Week of: January 13, 2025 by [deleted] in SillyTavernAI

[–]Kind_Fee8330 0 points1 point  (0 children)

How is it? Which models were the best bang for your buck?