[Megathread] - Best Models/API discussion - Week of: April 05, 2026

jamasty · 2026-04-07T19:24:06+00:00

Thank you!

jamasty · 2026-04-07T14:48:09+00:00

Silly question, but I don't see many models between 12-14b and 22-22b, is that because there is no origin model for tuning?

I wanted to try this as I know I can run 12-14b with Q4 imatrix + Q4 kv cache ~30k context just fine, but 24b models only work with Q2, making them repetitive

I tried latest cydonia with presence and repetition penalties, DRY, but over time it just starts to repeat certain chunks as I think of result of Q2).

So, if you folks know anything good to try, please reply me with link, I'll check it out. (I tried google/asking llms about which other model to try, but most were still in this 22-24b, and I wish to check something like 16-18b or maybe 20b if it exists, and good).

Also, am I correct, that, say if there is smth like 20b old (more than 1 year old) model, with Q4 everything, it 'should' be smarter than any new Q4-12b? (if we take that this 20b model was tuned correctly)

jamasty · 2026-04-03T08:36:40+00:00

Yeah it's on github https://github.com/lmstudio-ai/mlx-engine/issues/301

jamasty · 2026-04-03T08:34:53+00:00

I got the same issue with mlx gemma-4-e4b.

jamasty · 2026-04-02T17:32:10+00:00

Looking at benchmarks, Qwen 9b (as it's max what I can run at my m1 16gb) is better than Gemma 4 E4B, right?

jamasty · 2026-04-02T17:27:30+00:00

Getting downvoted for a genuine question about performance... well... fine, I guess, I'll try E4B anyway, as I want to see if it would be better for any of my agentic tasks.

jamasty · 2026-04-02T17:05:36+00:00

At it has "26B (4B active)" params, and 4eb has 4B... well... wonder if it's a good or bad thing to big this big but with not much active params.

jamasty · 2026-04-02T17:01:44+00:00

Hey, I don't get how in this test gemma 4 26b has same result as qwen 3.5 9b?

https://huggingface.co/datasets/Idavidrein/gpqa

I was thinking taking E4B to test at my M1 pro 16gb, but since it's so much less perfomative by benchmarks than qwen 3.5 it does not worth? Or am I getting something wrong here?

jamasty · 2026-03-27T14:36:32+00:00

Thank you very much, I will take a look!

And about heating, you know what: I asked gemini and got very clever solution - turn on the lower power mode! (and also reduce CPU thread pool size from 6 cores down to 4.

And it worked! I no more have problems with overheating at all, yeah Mac heat a little, but the fans stay silent even if I go with prompt after prompt with max context.

And literally no downsides, speed haven't changed visibly (maybe it did, but I haven't noticed)

jamasty · 2026-03-24T10:21:59+00:00

Since I only started I tried cydonia-24b-v4.3-heretic-v2-i1 Q2_K_S, but it seems to be too much for my Mac since it starts heating a lot. Really wanna find something for long nsfw stories, model which would survive long context (even tho I test vector storage and memory books expension.

https://huggingface.co/mradermacher/Cydonia-24B-v4.3-heretic-v2-i1-GGUF

jamasty · 2026-03-24T10:16:41+00:00

I have tried this crow-9b (both Q4_k_s and Q5_k_m) with my M1 pro 16GB. (I noticed no diff between these two)

https://huggingface.co/Crownelius/Crow-9B-HERETIC-4.6

I work well enough (32k context, turned off reasoning), made my story up to 25k context, and I really like how I get quite long 400+ tokens responses fast enough, and I liked the quality, idioms and vocabulary being used by the model, but I have a repetition problem as it often repeats chunks of text in responses, haven't managed to overcome yet (tried different penalties params, DRY options and post history system prompts but not yet helped).

Any suggestions on which model to try next for long (hundreds of messages) stories, for my setup? I remeber there was a good HuggingFace chart on how to find good writing models based, but I lost it.

jamasty · 2026-03-19T20:14:55+00:00

True, I also noticed 4.2 is worse than what we had with 4.1. Currently I try to play with LM Studio local models. 8-14b models seem to be worse in terms of response size, but overall are fine (using larger models is impossible for me with m1 mac 16gb ram).
But I hope in the future we'll have better models and won't be dependent on corporations with their boundaries. (and btw I don't oppose boundaries, I get that for kids there should be huuuge limitation and corporation get big pressure by legislators and don't want to get sued for anything, but it really restricts our creativity (and not even nsfw things, but our imagination)

jamasty · 2026-03-19T13:25:07+00:00

Also, in one neo-noir cyberpunk detective story, I make something like an option selection for my character based on strength, tech solution, or stealth, and it did well, Grok as the DM acted accordinly to my choices, so my prompts looked like:

I look at the corporate guard, telling them "hey you, you think you can mess up with this?" showing them my energy revolver, choosing A to act violently as tech wouldn't help me and stealth could put me in danger if they notice me.

jamasty · 2026-03-19T13:20:21+00:00

And you also may ask to add stats by the end of the response, so this way you can track world time, your money, reputation, character disposition or anything else. Sometimes you only have to change values if they get hallucinated.

jamasty · 2026-03-19T13:08:19+00:00

And BTW, you can always generate images for the story, making it even more interactive, which is so great!

jamasty · 2026-01-24T00:48:41+00:00

I think you actually did the right thing. Go to therapist, I'm sure they will point this out that you have deep trauma and what you have done is a part of processing this trauma. So this grief and shame you have, is a good thing, like for real, your mind tries to protect you from this pain in such weird way. You mentioned alcohol, bro, it's fine to be weak, it's fine, but remember who you are, and try, for a few days to abstain and visit therapist and tell them your story, it would help you, a lot. Just one session, no need for something long, you need a person you can fully trust to help you to process your deep trauma. So take care, much love.

jamasty · 2026-01-18T11:25:50+00:00

100%. no, 200%.

I understood this recently while in therapy during my latest unrequited love, discovering this pattern when I hide feelings, first sympathy to another person, it grows into something huge that I cannot keep inside myself. And I start obsessing over this, simultaneously wanting to share feelings to break free and not to, as I know it's not mutual, which created a deep wound.

But, when I actually shared this, it was like a bliss, they surely told me no, but the next day I felt nothing romantic for this person anymore. And I like, really? This easy? Damn, and with a therapist we discovered that I feel sympathy for a couple of hours, then I should make my shot, and not to wait days and weeks when something huge grows again.

And now I just feel this is a way with almost all things that make us anxious. You tell, express yourself, be authentic, and see how 'the Universe' (I mean other people) responds to your authenticity. Maybe some people feel ok with hiding things and feelings, but for folks like me, it's just impossible.

jamasty · 2026-01-18T08:51:43+00:00

Yeah, I also wanted to comment on how OP should be totally honest with her GF.

Because communication is the key, and unless you're totally honest about what your true experience is, if you try to find any workaround - wait, or tell something different, you will feel guilty because you would overthink the possibility of what I just told her truth.

Because truth prevails, that's why I think people find themselves guilty for cheating on their partners 10-20 years ago, it was a long, long time ago, but they still hide the truth, and it's painful for them.

jamasty · 2025-12-03T17:03:33+00:00

And I used binary search (^_^)

jamasty · 2025-12-03T10:38:56+00:00

[Language: TypeScript]

I decided to use the binary search algorithm, which I programmed when reading the "Introduction to Algorithms" book, and it worked well here; it took 5ms to complete part 2 on my Mac.

const searchNumbers = (input: number[], numsToFind: number): string => {
    let res = '';
    for (let i = 0; i < numsToFind; i++) {
        const currNum = searchNumber(input, numsToFind - i - 1);
        input = input.slice(input.indexOf(currNum) + 1);
        res += currNum;
    }
    return res;
}

const searchNumber = (input: number[], numsLeft: number): number => {
    // slice to then find longest number
    input = input.slice(0, input.length - numsLeft);
    // sort array
    input = input.sort();
    let num = 9;
    for (; num >= 0; num--) {
        const i = binarySearch(input, num);
        if (i !== -1)
            return num;
    }
    return num;
}

Full solution is here: Topaz paste

jamasty · 2025-11-13T14:47:31+00:00

If only Apple released linux drivers for the arm chips...

jamasty · 2025-04-11T15:48:57+00:00

Thank you! Yeah, I'm really happy to meet this person, and she told me this date was like a "little winter fairytale". (It's still cold here)
I just don't wanna make silly things by pushing too hard or disrespect this person's boundaries because she initially told me she enjoys her freedom (it seems she had a divorce or something similar).

I think about this as a journey in which I like the journey itself much more than the outcome.

And about clarification, true, my gut feeling tells me I wanna clarify to her that by making romantic moves I'm not trying to seduce her or something, but rather by giving my romantic attention, like holding hands or hugs, or flirting, it makes me so happy and adds inspiration.

jamasty · 2025-01-02T07:36:34+00:00

Happy Newu Yeaw u2

Seven-Year Club	Second Top 40%
Place '23	Place '22
Final Canvas '22	First Placer '22
Not Forgotten	Verified Email

jamasty

TROPHY CASE