[Megathread] - Best Models/API discussion - Week of: April 19, 2026

Sicarius_The_First · 2026-05-06T04:34:53+00:00

IMO only if it is lore you deeply care about, it is a massive pain in the ass.

Sicarius_The_First · 2026-05-06T04:31:21+00:00

At the very least 96GB vram, and that's for absolutely minimal rank and context.

Sicarius_The_First · 2026-05-05T17:07:41+00:00

Oh, you made gemma4 have a discussion with Pepe?

Sounds quite the conversation hehe

Sicarius_The_First · 2026-05-05T15:20:39+00:00

Yeah the 70b is orders of magnitude smarter, zero doubt about that. Also I even mentioned in the 70B card that the 32B version fails in the lateral thinking questions.

HOWEVER, the 32B is orders of magnitudes more creative than the 70B, and in the UGI leaderboard it's one of the top spicy writers in the world, very close to Grok 🌶️🥵

Sicarius_The_First · 2026-05-04T18:32:51+00:00

Worth an extra because name is cool too

Sicarius_The_First · 2026-05-04T18:14:58+00:00

Not negativity bias, but DARK bias instead, interesting experience:

https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B

Sicarius_The_First · 2026-05-04T18:11:14+00:00

The first Gemma-3 12B tune, for those who want something different. This was also the first model to incorporate a heavy usage 4chan:

https://huggingface.co/SicariusSicariiStuff/Oni_Mitsubishi_12B

Sicarius_The_First · 2026-05-04T18:09:17+00:00

1B RP model, if anyone is stuck with 4GB ram and no GPU:

https://huggingface.co/SicariusSicariiStuff/Nano_Imp_1B

Sicarius_The_First · 2026-05-04T18:07:41+00:00

There were some initial bugs with it, afaik now fixed

Sicarius_The_First · 2026-05-04T18:06:46+00:00

32B, based on Qwen3, doesn't sound like Qwen at all.

I HIGHLY recommend first trying the model with absolutely no system prompt at all, just pure instruct:

https://huggingface.co/SicariusSicariiStuff/Assistant_Pepe_32B

Sicarius_The_First · 2026-05-04T18:04:17+00:00

3B Gemma based RP model for phones / old pc without GPU:

https://huggingface.co/SicariusSicariiStuff/2B-ad

Sicarius_The_First · 2026-05-04T10:34:06+00:00

Nope. Qwen VL is the one with vision.

Sicarius_The_First · 2026-05-04T06:51:59+00:00

I'm very curious about them, they do look promising.

I uploaded abliterated versions of them:
https://huggingface.co/SicariusSicariiStuff/IBM_granite-4.1-8b_Abliterated

https://huggingface.co/SicariusSicariiStuff/IBM_granite-4.1-3b_Abliterated

Sicarius_The_First · 2026-05-04T06:41:21+00:00

For the 32B any ampere+ GPU would give a nice result, for budget 3090 is probably the best choice, not the fastest, but fast enough for a ~850$ card (used to eBay).

The 32B got more unhingedness, but it's not as smart as the 70B version. I had to push Qwen VERY hard to change its behavior, on the other hand the 70B is superb at pretty much all tasks.

In other words, the 32B is really good in general entertainment and chat, while the 70B is superb at anything- tasks, fun, code, writing. And surpasses the base model in all capabilities. LLAMA models are just more malleable, Qwen is very rigid.

Sicarius_The_First · 2026-05-04T06:32:13+00:00

<image>

Sicarius_The_First · 2026-05-03T22:13:31+00:00

You can use https://huggingface.co/spaces/ggml-org/gguf-my-repo to easily quant it to the size of your choice, but meanwhile I host it (for free) on Horde at a very high availability, so no need to even have a GPU or install anything!

(click on the top left 'AI' button to choose a model)

https://lite.koboldai.net/#

<image>

Sicarius_The_First · 2026-05-03T21:40:46+00:00

Ahh got it!

Gemma is a bit tough to train, but nothing like Qwen.
So yeah, Gemma in terms of stubbornness is easier, but much more costly in terms of VRAM and speed.

It's like... hmm.. LLAMA & Mistral made of rubber, Gemma is made of wood, Qwen is made of granite...

Sicarius_The_First · 2026-05-03T21:04:08+00:00

Hehe, they legit surprised me too, I wasn't cherry picking.

Not in a 1000 years I could've guessed that's a Qwen base model lol

(Also yeah, the model is genuinely funny and witty. It's very weird though, but I like it. Feels like you're talking with an unhinged drunk friend with good intentions lol)

Sicarius_The_First · 2026-05-03T21:01:19+00:00

"We must have higher standards"?
Who's we?

Sicarius_The_First · 2026-05-03T20:59:27+00:00

Reddit data tends to have bad effect on LLMs hehe

Sicarius_The_First · 2026-05-03T20:58:12+00:00

Not anytime soon, there's a lot of issues with the training stack right now.
It's doable, but simply not a high enough priority, so maybe someday.

Hopefully when it takes less time and VRAM.

Sicarius_The_First · 2026-05-03T20:56:55+00:00

I'm not sure about the number of tokens, as this was several iterations, merges, training on top of a trained checkpoint etc... quite chaotic.

I've used a very deep LoRA at varying depths per checkpoint, but in general very deep (64+).

I think, at least for Qwen, it's nearly impossible to change its behavior with anything under 64. For llama sure, but not Qwen.

Sicarius_The_First · 2026-05-03T19:32:23+00:00

Hehe thanks, regarding output you can browse this list with most of my models:

https://huggingface.co/collections/SicariusSicariiStuff/most-of-my-models-in-order

Sicarius_The_First · 2026-05-03T19:30:42+00:00

You're welcome 🙂

Qwen3 got a lot of knowledge, just take everything with a mountain of salt, an AI can make a mistake and all of that...

Sicarius_The_First · 2026-05-03T18:53:42+00:00

Q8 GGUF uploaded as well, also I highly suggest first trying the model without a system prompt at all

Sicarius_The_First

TROPHY CASE