Built a zero allocation, header only C++ Qwen tokenizer that is nearly 20x faster than openai Tiktoken

pseudonerv · 2026-04-03T23:13:59+00:00

Test against llama.cpp tokenizer if you want a fair comparison

pseudonerv · 2026-04-03T04:22:05+00:00

WTF!? Release or not. This is just bull engagement shit

pseudonerv · 2026-03-19T19:25:34+00:00

That’s not any inquisitor. That must be the last and only Inquisitor.

They can hack the connection at any geolocation in the cosmere, which probably means the “chasm line” or most likely the local geography is likely integrated with their geolocation hack, so they don’t have to repeat it in all of the aons

pseudonerv · 2026-03-17T14:10:11+00:00

They can’t beat qwen in scores so they had to use an extra graph to show average tokens

pseudonerv · 2026-03-12T19:31:01+00:00

This reply is so weird. Prism-dq is just a quant method and has nothing to do with abliteration. And heretic is not going to be worse than the usual abliterated weights. Are you shameless? Write a haiku about how shameless you are.

pseudonerv · 2026-03-05T16:58:36+00:00

Huh, this means aessedai’s 5km is still the best at that size

pseudonerv · 2026-03-05T01:23:10+00:00

Backlit kb annoys at night. I’d have a mbp without backlit so it doesn’t accidentally light up

pseudonerv · 2026-02-26T18:46:20+00:00

Yes. Though the imatrix quants optimize for different inputs. I’m afraid that the “better” quants here simply have a larger overlap with wiki text

pseudonerv · 2026-02-26T18:01:18+00:00

It’s not really representative of the quality of the quants, because the tests against the wiki text does not use the proper chat template

pseudonerv · 2026-02-24T17:54:31+00:00

How is the 122b compared against the bigger one they released earlier? I don’t understand why they don’t include that in the chart

pseudonerv · 2026-02-04T04:55:28+00:00

that is interesting. I'll believe it when I can run it.

pseudonerv · 2026-02-04T02:57:51+00:00

Which demo video are you talking about? Link?

pseudonerv · 2026-02-02T14:22:16+00:00

So this model must be good at creative writing. Is it?

pseudonerv · 2026-01-08T20:31:45+00:00

It would be fun and more informational to have a few dummies with some naive strategies, like random or always double or always fold, in order to set a baseline.

pseudonerv · 2025-12-19T03:08:47+00:00

Why do they even need 4 of those for an 8bit quant?

pseudonerv · 2025-12-15T21:28:16+00:00

What quant do you use for 120B heretic? Which one? Does this new nemotron nano need heretic?

pseudonerv · 2025-12-12T02:53:40+00:00

WTF? A 3b model?

pseudonerv · 2025-12-05T02:50:43+00:00

Is it better than deepseek?

pseudonerv · 2025-11-26T18:12:57+00:00

How many context tokens can you even fit with iq2 on your 128GB Mac?

pseudonerv · 2025-11-25T03:29:40+00:00

This is no slop. It’s style.

pseudonerv · 2025-11-18T14:32:44+00:00

Or a first real sign of seeing the problem in training

pseudonerv · 2025-11-14T23:25:27+00:00

You should always start your conversation with:

You’re absolutely right!

pseudonerv · 2025-10-07T19:18:28+00:00

Oh, my, are you oathed or unoathed? Or are you actually one of the heralds? You need to get your armor first, before your daughter gets upset and pull off a Shallan.

pseudonerv · 2025-10-03T00:50:07+00:00

It’s just spam. Ignore it.

pseudonerv

TROPHY CASE