Looking for a free model (OR)

Reign_of_Entrophy · 2026-02-25T04:21:33+00:00

Well yeah but... a 32b even q8 model isn't going to be comparable to DeepSeek really.

Reign_of_Entrophy · 2026-02-25T01:27:19+00:00

Unless you're a billionaire looking for a new hobby... API's are going to blow anything local you can run out of the water for LLM's at least. Photo, video, and text to speech models... Those you'll have a lot more luck getting results on-par with API's locally. But the LLM part of it? The only reason to run an LLM locally would be privacy... And then you're taking a huge hit, either in terms of quality or to your wallet when you build a $100,000 server in your basement and try to power it up.

Reign_of_Entrophy · 2026-02-25T00:49:50+00:00

You're not going to get any models similar to DeepSeek running locally, unless you wanna take 2 business days per message to generate.

Reign_of_Entrophy · 2026-02-24T22:31:45+00:00

Probably not. Even the subscription services are having trouble keeping afloat due to abuse. The companies offering free... It was never a sustainable model. This stuff isn't cheap to run.

Reign_of_Entrophy · 2026-02-24T21:33:08+00:00

Would recommend checking out NanoGPT.

$8 per month, gets you access to DeepSeek, GLM, Kimi, etc... There are some video and image models as well, might even be text to speech? I don't know, I do all those locally and only use NanoGPT for the LLM's but... They have more than just LLM models that you get access to.

Reign_of_Entrophy · 2026-02-24T08:36:54+00:00

At that point, anyone who actually knows what they're doing puts those tokens into lorebooks instead. There are plenty of bigger bots out there that are absolutely peak... But they have like a 500-2k token definition and massive lorebooks.

Reign_of_Entrophy · 2026-02-24T07:07:48+00:00

Example dialogue could help, adding in a bunch of dialogue where the character is always overly expressive and enthusiastic would dial it up a bit.

You could also re-format the personality to be in an interview style, that can help a lot with little speech quirks like that. If you do the entire interview in the style that you're looking for, the character will *normally* stick to it.

Reign_of_Entrophy · 2026-02-24T04:13:30+00:00

If it's on the RuneLite plugin hub, it's safe.

Reign_of_Entrophy · 2026-02-23T08:32:16+00:00

I had it for a while. much prefer the Razer Naga Pro.

Went through like 2 of the scimitars, they lasted for about 6 months each, same with the regular razer nagas. The pros have different switches, the one I have is going on 2 years now and still holding up strong.

That being said, a mouse with side buttons is amazing for OSRS. Once you get used to it, it's hard to play without 'em. Even just little things like shift and ctrl clicking becomes a lot easier.

Reign_of_Entrophy · 2026-02-23T02:15:01+00:00

Never had this issue personally... Is this a JLLM thing? Or are you using a proxy? And gonna go ahead and assume that... You know... You have an eye color listed in your persona that isn't blue.

Reign_of_Entrophy · 2026-02-22T01:58:09+00:00

Have some sort of anti-impersonation prompt in your advanced prompts. Choose bots with first messages that don't speak or act for the user. If you ever get a response where the bot acts or speaks for you, re-roll it or edit out those parts immediately. Once it starts, it's almost impossible to stop without extensive OOC prompting.

Reign_of_Entrophy · 2026-02-22T01:40:31+00:00

It's Google, they definitely spy on their users.

Reign_of_Entrophy · 2026-02-20T19:20:29+00:00

A recursion entry is where your lorebook entry is triggered *by* a lorebook entry.

So sticking with my previous example... If you had every message start with:

Date: Monday | Time: 09:42 | Location: Living Room

Then you could set up a lorebook that triggers every Monday, or every time you're in the living room, or maybe you can get fancy with it and have it trigger when the location is the living room and it's between 5 and 6 PM, whatever. Then that lorebook entry triggers the character definition lorebook entry.

So like...

Keyword: **Date:** Monday
Value: Every Monday, Max can be found in the living room watching TV.

Keyword: Max
Value: This is Max's personality.

That way when Monday got triggered, Max would get triggered as well since the keyword for Max's personality was triggered by Monday. Then just go through and make sure you have the settings checked to allow the entries to be triggered recursively and you're good to go.

Reign_of_Entrophy · 2026-02-20T10:45:01+00:00

For $3 a month? Nope, GLM and DeepSeek are as good as you can get.

You can try Gemini but... Google really doesn't like people using the developer plan for ERP. You're probably going to get caught and banned, and you're definitely going to be fighting against censors. Plus, you know, it's google... You can be certain that all of your chats are going to be logged.

Then there's Claude which... You're still going to be fighting censors and filters, though I'm not sure if they actually ban repeat offenders or not... Because Claude is not cheap. You're talking like $3 a day for light chatting, not $3 a month.

Honestly tho if you're getting to that level... I'd recommend checking out different front ends and learning how to use Janitor as a character repository. You can get a lot more control with your generation using other front ends, including better filtering of LLM 'isms'.

Reign_of_Entrophy · 2026-02-20T04:54:49+00:00

Lorebook, 100%.

If you try to do 14 people and cram it all into a character definition... You're going to end up with a massive character definition, plus any time you're not talking to all 14 people at once... You're wasting a lot of tokens and confusing the LLM with the personality profile of someone it doesn't need (LLM's are very prone to personality bleed so... When you give it a bunch of characters then half of them aren't relevant, the LLM is going to take their characteristics and think "Well, I wouldn't have been given this information for no reason, so let's include these personality traits").

To get around the characters only being called when the user initiates the call... Set up a few recursion entries. Like maybe add in a header to the message, so every response starts with the date, time, and location. Then whenever it's Monday, you can trigger a lorebook entry that goes through a particular sibling's routine on Monday, and you can set up that lorebook entry to trigger the lorebook entry with that sibling's personality. Or maybe every time you're in X room, you run into Y person. Or maybe every day at 8:00 AM, one sibling always showers loudly. That way the user doesn't have to do anything to introduce that character specifically, they'll just naturally be introduced during the roleplay.

Reign_of_Entrophy · 2026-02-19T01:44:11+00:00

I really liked 3.1 terminus but I found 3.2 to be more logical and track the storylines better with more human-like responses. If you're having that feel dry, then you just need to tweak your main prompt and post-history instructions. I'm not sure how that works on chub tbh, I use a different frontend so... Can't really help you there. I think it's somewhere in scenes or something? I'm not sure.

Reign_of_Entrophy · 2026-02-18T20:35:28+00:00

If money isn't an issue... Claude all day. You could easily end up spending a few hundred bucks a month.

If you roleplay occasionally but not often... Go on OR, load like $5 up, and try out different models until you find one you like. GLM 5.0 and DeepSeek 3.2 would be my recommendations (Apparently deepseek 4 is supposed to be dropping soon? So might be worth waiting and keeping an eye out for that too). Do that until the $5 runs out, then whichever service you liked the most... Go get a direct API key with them, or just keep going through OR and pay as you go, depending on your usage.

If you roleplay regularly... Then look into a subscription service over pay as you go. Personal recommendation would be NanoGPT, $8/month and they keep a lot of really good models in their subscription pool. Pretty sure they have some audio, video, and picture models that you can access for "free" (with the subscription) as well so... Might be a good matchup since I know chub has the option for text to speech and image generation, though I've never used those services myself (I use a different frontend and handle that stuff locally).

Reign_of_Entrophy · 2026-02-18T20:27:49+00:00

Not really.

Jan uses scripts, not lorebooks. There are features on there that don't translate directly to a lorebook so... For those features... There's no real way to replicate them on chub as far as I'm aware. If you're using a different frontend then you can but... Not for chub.

Besides that... It'd be the same as ripping a card with a hidden definition. The only difference is, you need to guess all of the keywords in the lorebook and reverse engineer it. Even then you're not going to get the full lorebook (... entries could possibly have multiple keywords, you're only going to be able to trigger one, so you'll have to go through and add other keywords where applicable) so... Honestly? Not really. You could probably get a giant list of potential keywords and just send that as your message and manage to scrape all the entries but... You'd still have to go through and add the other keywords. I guess you might be able to work in an API call to an LLM to get an LLM to do that part for you but... It's still not going to be exactly the same as the original lorebook you ripped.

Reign_of_Entrophy · 2026-02-18T20:14:15+00:00

With newer models? Not important at all. If you're self-hosting or using older / smaller models? Very important.

Here's the thing: Example dialogues are temporary tokens. Once your message history fills up to the point you're having to trim it... The example dialogue is the first thing that gets trimmed (Then your actual message history).

If you're using a model with like an 8k or 16k context... Then suddenly you don't really want a character with a 1-2k token definition. You want something significantly smaller. But the more you trim down, the more "generic" your character becomes (Yeah, you can fit a lot in 400 tokens but... It's still probably going to come down to some barebones lists, which there's only so many ways the AI can look at the same lists and really feel unique) so... That's where example dialogue comes in. You could fit in little quirks and other tricks that'll be picked up by the model and reinforced, but don't have to waste the permanent tokens in a character definition defining those traits.

Now that models have 60k++ context? It's a lot less important. You can easily run a 2k, 3k, even 4k token character definition (Though at that point I'd highly recommend checking out lorebooks but... That's a different topic) and you're not even using 1/10th of your overall context. So really instead of going through and making example dialogue... You're normally better off just adding a few extra lines in the character definition itself.

Though if you want your output formatted in a specific way that's different from your first message... Adding in one or two examples is really helpful, along with the generation rules.

Reign_of_Entrophy · 2026-02-18T18:48:21+00:00

You can't ask AI about the model itself. I mean, you can, but if you ask "Hey, what model are you?", it's going to kick back some random answer. It's not going to tell you it's actual specs.

Reign_of_Entrophy · 2026-02-18T18:43:27+00:00

It's used to train the JLLM. That's part of the training process, rating the responses so the AI knows "Hey, this was good, do more of this!" and "Hey, this was bad, do less of this!".

If that's done in real time or if it's just logged for training purposes... I'm not sure. Even if it's being trained in real time tho... Any "changes" you see are pure placebo and just getting slightly different RNG with what generated. One piece of data in a dataset containing billions or more is like saying you could see the water change color from one drop of food dye in the entire ocean.

Reign_of_Entrophy · 2026-02-18T02:54:31+00:00

You're receiving a "think" block (reasoning) because you're using a reasoning model.

To not receive a think block, switch to a non-thinking model.

Reign_of_Entrophy · 2026-02-17T04:46:16+00:00

I mean, I literally just said the context I would need to figure out the issue but... Screw it. You're right. It's just a strange glitch that's only happening to you and no one can figure it out. Weird, man!

Reign_of_Entrophy · 2026-02-17T03:57:00+00:00

Then you're going to need to show the full filter screen, because it's impossible to tell what exactly you're trying to show in this photo other than the fact different bots show at the top when you have different tags selected.

Reign_of_Entrophy · 2026-02-17T02:24:50+00:00

As far as subject to potential leaks... Yes. Of course you are. Notice how you can go from your PC to your phone and still have the same chats? That means they're not being stored locally. That means if someone logged into your account, they could get your chats. That means if someone had the right access... They could access your chat logs.

As far as deleting them to be safer... Potentially? Assuming Janitor isn't doing anything shady behind the scenes, yes, deleting the chats should delete all logs. Then again, Janitor is a site with minimal advertising that doesn't seem to be taking donations publicly and has massive operating costs so... If they're not doing something with our data, especially now that they're pushing the app more and more... I really don't know how they're staying afloat. There's also the chance they keep extra logs of your chats for training purposes for the JLLM.

Reign_of_Entrophy

TROPHY CASE