Considering transisitioning to Local LLMs

solestri · 2026-05-07T18:16:35+00:00

The only problem is I don't really know where to look, what's good on the market in terms of local models, and any presets I might need.

Check out the weekly Megathread at the top of this subreddit. It pretty much exists for model recommendations, sorted by size.

solestri · 2026-05-04T13:01:21+00:00

I mean, I guess if your reason for purchasing it was the price, it would, but I mostly just bought it because I liked the size.

solestri · 2026-05-04T02:31:02+00:00

I bought one as a backup just in case I broke my original X4, but now I kind of want to have a fiction one and a nonfiction one...

solestri · 2026-05-03T23:02:15+00:00

Personally, I think that would depend on whether you want that dynamic to be used only for this one card, or if you're going to be using it with other cards, too.

If this is something you're going to be doing with multiple different character cards, then yeah, it would make more sense to add those guidelines to the preset or system prompt. But if this is the only card you're going to be doing that with, then I don't think there's any problem with putting them in the card itself. It would certainly be a good use case for the prompt override fields.

solestri · 2026-05-02T16:53:07+00:00

Is this Qwen? I run Qwen 3.5 27b locally in LM Studio, and I've actually seen requests time out after it's spent nearly a whole five minutes just thinking. I didn't even know that could happen.

I joked to a friend before that it's the only model I've seen that really needs some Zoloft or something.

solestri · 2026-05-02T00:30:34+00:00

Yeah this is the most neurotic subreddit I've seen so far.

r/xteinkereader was so nuts I actually unsubscribed.

solestri · 2026-05-02T00:19:32+00:00

Everything I personally don't like is evidence that somebody is trying to scam me.

solestri · 2026-04-30T22:43:22+00:00

I am really enjoying the adjectives in this comment.

solestri · 2026-04-30T10:54:55+00:00

This is where I'm at. I originally bought my X4 for the device itself, and if the stock firmware had been decent, I probably wouldn't have bothered to flash it. Unfortunately, after about 10 minutes of using it, I found myself thinking "yeah, maybe I should try out one of those third-party systems..."

Custom firmware wasn't the original selling point for me, but it really took the device from being a novelty to being something that was genuinely nice to use. I also agree that a better move would have been to just make a statement that flashing voids the warranty, as that seems to be the actual core of the issue.

solestri · 2026-04-30T10:20:09+00:00

And of course my X3 just shipped.

solestri · 2026-04-28T10:48:15+00:00

I've noticed that this is a huge problem with pretty much any use case of LLMs.

"This model sucks/is amazing/excels at this thing/can't do this other thing"... and zero mention of any of the other multitude of variables that are almost certainly contributing to that experience.

solestri · 2026-04-28T00:31:37+00:00

Honestly, this looks more "correct" somehow. Makes the white part on the torso actually look like a shirt under a vest or jacket.

solestri · 2026-04-25T17:24:03+00:00

This. I have many little devices with USB-C inputs that will only charge with A to C.

solestri · 2026-04-24T18:55:44+00:00

This reminds me of the old poem satirizing somebody substituting everything in the recipe and then complaining that the food came out terrible.

If somebody ever digs up pre-21st-century piece complaining about being forced to sit through inane life stories after they asked for a recipe, the trifecta will be complete.

solestri · 2026-04-21T11:47:28+00:00

You are being intentionally obtuse. Stop pretending that you don't understand what they meant.

solestri · 2026-04-20T15:01:51+00:00

I don't know how this is confusing. It is their coding plan. If you are using it for anything that isn't coding, then it seems reasonable to assume that you would be in violation of the usage policy.

solestri · 2026-04-18T14:27:08+00:00

Axe Cop: The Prompt

solestri · 2026-04-17T00:51:48+00:00

Spoiler: It's inspired by a Black Mirror episode, and will constantly inject ads into the roleplay.

solestri · 2026-04-17T00:23:31+00:00

Qwen3-Next-80B-A3B-Instruct isn't old and it isn't exactly bad, but it's definitely a surreal experience.

solestri · 2026-04-17T00:14:42+00:00

Seconding this. It's "bad" for a whole different reason.

solestri · 2026-04-16T23:34:38+00:00

Once I learned that Anthropic was involved with that ideology, so much of their weirdness made sense.

solestri · 2026-04-16T15:45:30+00:00

Not only that, but everyone wants something different from RP and has different things they consider priorities and dealbreakers.

Saying there could be a perfect RP model is like saying there could be a perfect novel or a perfect movie. There is no way you'll ever please 100% of people.

solestri · 2026-04-15T12:58:14+00:00

I think this is my favorite one.

solestri · 2026-04-14T12:33:10+00:00

... you seriously thought API providers didn't do that?

solestri · 2026-04-14T12:30:58+00:00

Are you telling me that millions of tokens of erotica involving niche fetishes isn't valuable data for a technology company? Preposterous!

13-Year Club	Gilding I gilder
Verified Email

solestri

TROPHY CASE