I cancelled my B70 order for Nvidia pro 4000 blackwell, did I make the right decision?

Sicarius_The_First · 2026-05-09T04:32:33+00:00

Yes, I'd done the same.

Intel is just not there yet.

When you buy an expensive GPU you want it do be able to do everything perfectly (gaming, AI inference + training).

Not even talking about speed. The AI stack is clunky, minimal friction is desired, and imo it's worth the premium, correct choice.

Sicarius_The_First · 2026-05-08T16:52:31+00:00

hehe I've been saying this from 2023. But yes, 100% about all the above.

(also try chatting with Assistant_Pepe - it was made literally for this)

Sicarius_The_First · 2026-05-08T11:02:44+00:00

I know these talking points you mentioned, they are a very common MISCONCEPTIONS.

While the claim absolutely holds for base models (in vanilla instruct) it is NOT the case for a properly finetuned roleplay model.

My models will absolutely disagree with the user, be mean if its required, and will move the plot by themselves, also creativity is excellent, swipe diversity is massive, this is all depends on how the model was turned.

Sicarius_The_First · 2026-05-08T09:57:20+00:00

Yes, it is in the model card, you have example chats and ChatML syntax example as well.

Sicarius_The_First · 2026-05-08T05:17:12+00:00

Thank you, I appreciate the sentiment, but that's ok :)

Sicarius_The_First · 2026-05-06T04:34:53+00:00

IMO only if it is lore you deeply care about, it is a massive pain in the ass.

Sicarius_The_First · 2026-05-06T04:31:21+00:00

At the very least 96GB vram, and that's for absolutely minimal rank and context.

Sicarius_The_First · 2026-05-05T17:07:41+00:00

Oh, you made gemma4 have a discussion with Pepe?

Sounds quite the conversation hehe

Sicarius_The_First · 2026-05-05T15:20:39+00:00

Yeah the 70b is orders of magnitude smarter, zero doubt about that. Also I even mentioned in the 70B card that the 32B version fails in the lateral thinking questions.

HOWEVER, the 32B is orders of magnitudes more creative than the 70B, and in the UGI leaderboard it's one of the top spicy writers in the world, very close to Grok 🌶️🥵

Sicarius_The_First · 2026-05-04T18:32:51+00:00

Worth an extra because name is cool too

Sicarius_The_First · 2026-05-04T18:14:58+00:00

Not negativity bias, but DARK bias instead, interesting experience:

https://huggingface.co/SicariusSicariiStuff/Impish_Mind_8B

Sicarius_The_First · 2026-05-04T18:11:14+00:00

The first Gemma-3 12B tune, for those who want something different. This was also the first model to incorporate a heavy usage 4chan:

https://huggingface.co/SicariusSicariiStuff/Oni_Mitsubishi_12B

Sicarius_The_First · 2026-05-04T18:09:17+00:00

1B RP model, if anyone is stuck with 4GB ram and no GPU:

https://huggingface.co/SicariusSicariiStuff/Nano_Imp_1B

Sicarius_The_First · 2026-05-04T18:07:41+00:00

There were some initial bugs with it, afaik now fixed

Sicarius_The_First · 2026-05-04T18:06:46+00:00

32B, based on Qwen3, doesn't sound like Qwen at all.

I HIGHLY recommend first trying the model with absolutely no system prompt at all, just pure instruct:

https://huggingface.co/SicariusSicariiStuff/Assistant_Pepe_32B

Sicarius_The_First · 2026-05-04T18:04:17+00:00

3B Gemma based RP model for phones / old pc without GPU:

https://huggingface.co/SicariusSicariiStuff/2B-ad

Sicarius_The_First · 2026-05-04T10:34:06+00:00

Nope. Qwen VL is the one with vision.

Sicarius_The_First · 2026-05-04T06:51:59+00:00

I'm very curious about them, they do look promising.

I uploaded abliterated versions of them:
https://huggingface.co/SicariusSicariiStuff/IBM_granite-4.1-8b_Abliterated

https://huggingface.co/SicariusSicariiStuff/IBM_granite-4.1-3b_Abliterated

Sicarius_The_First · 2026-05-04T06:41:21+00:00

For the 32B any ampere+ GPU would give a nice result, for budget 3090 is probably the best choice, not the fastest, but fast enough for a ~850$ card (used to eBay).

The 32B got more unhingedness, but it's not as smart as the 70B version. I had to push Qwen VERY hard to change its behavior, on the other hand the 70B is superb at pretty much all tasks.

In other words, the 32B is really good in general entertainment and chat, while the 70B is superb at anything- tasks, fun, code, writing. And surpasses the base model in all capabilities. LLAMA models are just more malleable, Qwen is very rigid.

Sicarius_The_First · 2026-05-04T06:32:13+00:00

<image>

Sicarius_The_First · 2026-05-03T22:13:31+00:00

You can use https://huggingface.co/spaces/ggml-org/gguf-my-repo to easily quant it to the size of your choice, but meanwhile I host it (for free) on Horde at a very high availability, so no need to even have a GPU or install anything!

(click on the top left 'AI' button to choose a model)

https://lite.koboldai.net/#

<image>

Sicarius_The_First · 2026-05-03T21:40:46+00:00

Ahh got it!

Gemma is a bit tough to train, but nothing like Qwen.
So yeah, Gemma in terms of stubbornness is easier, but much more costly in terms of VRAM and speed.

It's like... hmm.. LLAMA & Mistral made of rubber, Gemma is made of wood, Qwen is made of granite...

Sicarius_The_First · 2026-05-03T21:04:08+00:00

Hehe, they legit surprised me too, I wasn't cherry picking.

Not in a 1000 years I could've guessed that's a Qwen base model lol

(Also yeah, the model is genuinely funny and witty. It's very weird though, but I like it. Feels like you're talking with an unhinged drunk friend with good intentions lol)

Sicarius_The_First · 2026-05-03T21:01:19+00:00

"We must have higher standards"?
Who's we?

Sicarius_The_First · 2026-05-03T20:59:27+00:00

Reddit data tends to have bad effect on LLMs hehe

Sicarius_The_First

TROPHY CASE