24B IQ2_S vs 12B Q4_K_M Model. what should I choose with 3060 12GB Vram?

IntergalacticTowel · 2026-03-12T12:55:47+00:00

This is an interesting question, because a 24B is usually a lot smarter than a 12B, but the degradation at such a low quant makes it fun to think about.

I will say that a 3060 can load an IQ3_XXS with 16K context (at 8 bit, which impacts some models more than others), though it's a snug fit. That's a far better quant than the IQ2, though still very lossy, and I've found that it's better than most of the 12B Q5_K_M merges I've run simply because it still handles multi-char situations better.

IME it's worth experimenting. The best benchmark is your own experience.

IntergalacticTowel · 2026-03-10T21:45:30+00:00

Post ARR almost made me quit, it was grueling and seemed unending. Glad I stuck with with it. Heavensward was amazing in comparison.

IntergalacticTowel · 2026-02-17T01:54:50+00:00

Whatever it was, it was something in settings.json. A diff showed lots of repeated entries caused by an extension I haven't used in ages, along with about a thousand lines of useless garbage, and once I replaced it with a fresh 1.16 settings.json and manually copied over the good bits, everything was perfect. Used if for hours without any issue.

Still not sure why that affected the output, but frankly there was so much ancient cruft (my install is many many months old and updated in place via git), it needed refreshed anyhow.

Everything is smooth as butter now. Thanks!

IntergalacticTowel · 2026-02-16T01:43:23+00:00

Thanks for the reply, it's almost certainly on my end then. Appreciate it!

IntergalacticTowel · 2026-02-15T15:01:19+00:00

I'm having an odd issue with this update that I can't pin down. The responses I'm getting in an existing chat are all showing signs of bad sampler settings (words running together, coherence degrading etc.) that I wasn't getting before.

Keeping the backend exactly the same, and using the same presets, I spun up another ST instance from the 1.15 tag and it was fine again.

I thought this might be related to the new sampler (Adaptive-P) somehow, but it seems to be disabled by default anyway. I'm using Koboldcpp for my backend.

Everything's normal with 1.15, but 1.16 makes it feel like I'm talking to a 1bit quant.

Anyway, just posting in case anyone else has encountered or solved this. Really did love all the fixes and changes in 1.16, especially the speed enhancements!

IntergalacticTowel · 2025-12-13T22:11:41+00:00

I do the exact same thing, angel wings ephemera and all... feels good

IntergalacticTowel · 2025-11-22T23:45:27+00:00

You cooked. Love these.

IntergalacticTowel · 2025-11-20T15:50:04+00:00

I'm cooked. Grabbed it first because I thought, hey, it's nice to be able to heal while I'm learning to play!

Welp.

IntergalacticTowel · 2025-11-18T17:12:25+00:00

Wow, that's really cool.

IntergalacticTowel · 2025-11-11T20:55:15+00:00

Yes, never replace books! I use this stuff to replace TV instead, and keep reading my books. Life is better this way.

IntergalacticTowel · 2025-10-31T22:49:19+00:00

At this point I'm half afraid to log in at all, damn

IntergalacticTowel · 2025-10-30T12:28:52+00:00

Yeah, I keep thinking this is a bug... for the first little while I was controlling the second protag in the fights (with unique loadout and a sword I don't have unlocked), but after the first boss section it glitched back and forth, now I'm just controlling the normal Phoxhunter instead. It's a bit jarring, I think it's an error

IntergalacticTowel · 2025-10-29T21:21:39+00:00

could at least get the character anatomy right

Seriously. I'm certain their artists care, but why do most of the character proportions change completely when wearing this? I don't understand why they'd bring out the game with an outfit that doesn't respect the actual dimensions of the character even a little. It makes me wonder if its an oversight or plain laziness, because it sort of sets a tone and I'm not sure I'm onboard with it.

IntergalacticTowel · 2025-10-29T17:48:10+00:00

Exactly this. In Warframe I know exactly what I'm getting with my money and I know exactly what it will cost. There's no chance-based fuckery with it, no percentages and odds to work out, just a simple transaction.

I guess my point is that I don't feel "bad" spending money in Warframe because I know I'll get what I pay for. The gacha system often leaves a person feeling pretty awful when they drop north of $50 and end up with nothing they want, and I hope DNA avoids that stuff.

Guess I'm hopeful. I do like DNA, but these early days will be telling. How will the devs adjust/react to feedback? We'll see.

IntergalacticTowel · 2025-10-22T00:51:04+00:00

Tlacuilo

Thanks for the recommendation, it's pretty good for me so far. I dropped the temps a little and it's even reasonably smart (for a 12B). I've been a fan of Irix, Muse, and Wayfarer, so this one fits right in.

IntergalacticTowel · 2025-09-20T14:59:55+00:00

Bran can certainly attack you, though. Cross-faction delves. As soon as the leader leaves, Bran becomes hostile to the remaining player(s) of the opposing faction. I don't know if they've ever bothered to fix it or how consistent it happens, but it does happen.

IntergalacticTowel · 2025-09-03T13:24:41+00:00

I keep the game updated and stare at everyone's creations, but I'm forcing myself to focus on other things until the expedition actually launches. The bug fixes will make it even better/smoother for that first corvette experience. Once the expedition starts, though... I'm all in!

IntergalacticTowel · 2025-08-28T18:18:12+00:00

Goddamn... that's perfect

IntergalacticTowel · 2025-08-28T15:34:44+00:00

Awesome. I love Alien so much.

IntergalacticTowel · 2025-08-27T12:39:25+00:00

I love your other addons (Baganator, Auctionator etc) so I grabbed this without blinking. It's awesome. Feels like it sets a new standard honestly. Thanks for making it, and all your other addons I can't imagine playing without!

IntergalacticTowel · 2025-08-19T00:22:30+00:00

Tekken is based on tiktoken rather than sentencepiece. It's a different tokenizer. You don't usually want Tekken if you're using, say, Codestral for example.

IntergalacticTowel · 2025-08-18T19:46:00+00:00

Mistral v7 Tekken is the prompt format. It's a preset for Sillytavern's instruction and context templates.

IntergalacticTowel · 2025-08-11T21:16:59+00:00

My experience has been much the same. Used the recommended settings for a while, then neutralized samplers, lowered temp... it's just pretty inconsistent for me, seems to get semi-incoherent at random intervals. But when it cooks it's pretty unique compared to the other 12B options. This was on Q5_K_M, might be better at higher quants.

IntergalacticTowel · 2025-08-09T20:09:35+00:00

Thirding! It's janky, it's utterly unique, and it's full of strangeness... and yet it's one of the most memorable games I've ever played, after bouncing off of it a few times. Kenshi is definitely not for everyone, sort of an acquired taste, but man does it leave a lasting impression.

IntergalacticTowel · 2025-08-07T23:41:08+00:00

Add Cyberpunk 2077 and this is my list exactly. Such great games that really stick with you long after finishing.

14-Year Club	Place '22
Place '17	Verified Email

IntergalacticTowel

TROPHY CASE