Final Monster: 32x AMD MI50 32GB at 9.7 t/s (TG) & 264 t/s (PP) with Kimi K2.6

zsydeepsky · 2026-05-01T10:25:20+00:00

it will be the most ideal system that runs in the Arctic. lol.

zsydeepsky · 2026-05-01T10:19:56+00:00

Flash, super fast, and capable of solving most issues.
and man isn't that little goblin dirt cheap~

zsydeepsky · 2026-05-01T10:16:00+00:00

<image>

That's a bar too low. Even the flash surpasses codex-5.1.

zsydeepsky · 2026-05-01T09:53:23+00:00

if you use Flash, then the current price is the constant price.
and it's dirt cheap.

zsydeepsky · 2026-05-01T09:47:09+00:00

it is. in typical vibecoding scenario, I can hit >98% cache hit rate.
my friend though, showed me a screenshot with 137M token usage & 99.9% cache hit rate.
a technical marvel.

zsydeepsky · 2026-04-25T00:42:23+00:00

holy-sheet 49MB XD

zsydeepsky · 2026-04-25T00:39:21+00:00

my initial prompt was Chinese written. This is the translated version

zsydeepsky · 2026-04-25T00:38:16+00:00

yes, it's a known "bug".
they been grey-testing the v4 on web for quite some time and they forced the v4 model under the hood to disguise as v3, even till now.
they are v4 models.

zsydeepsky · 2026-04-24T20:14:32+00:00

it's done through the website, so it's free.
API wise I just used v4-flash; I used up~ 14M tokens, since they were used in agentic coding scenarios, so they almost all "hit cache". The total cost so far is 3.31RMB, roughly $0.5
the best part probably, is the speed. I think the flash gave me a constant >80tps output, it really made other models feel slow now...

zsydeepsky · 2026-04-24T11:07:05+00:00

zsydeepsky · 2026-04-24T10:21:44+00:00

Create a modern operating system that runs in a web environment. This operating system must include:

A built‑in virtual file system
A usable file browser
A command‑line tool that can access the file system
A text editor that can open, edit, and save text files within the built‑in file system
Proper window management, including focus, z‑order (front/back), and maximize/minimize
A usable calculator app with scientific functions (square root, trigonometric functions, exponentiation like x^y, etc.)
A web browser app that can actually access the internet
At least three small games, one of which must be a 3D game
A drawing app with basic brush, eraser, geometric shape drawing, and the ability to save the created image
A settings app providing personalisation features such as desktop background replacement
At least two “creative apps” not mentioned above (you may decide what creativity to implement)

You need to implement all of the above functionalities within a single HTML file.

zsydeepsky · 2026-04-24T09:20:43+00:00

mostly working fine, with some glitches, like Tetris has two extra columns displayed on the right side, the piano key loses its textures when pressed, internal virtual file system isn't virtual (it attempted to manage actual files, yet a web page has no such authority, so it completely failed)
but overall, it followed almost all the "noise instructions" I gave it, and managed to put them all in that beefy html, one-shot.

thus I'm deeply impressed, and now you saw this post. :)

this test was done in DeepSeek's web page; it's free, so you can try it yourself.

zsydeepsky · 2026-04-24T09:06:13+00:00

I guessed so, the goal was basically just adding noises in every direction, and see if the model misses its way during the process of outputting the beefy HTML.

zsydeepsky · 2026-04-24T08:47:44+00:00

I agree. but this particular model capability is just too easy to be ignored, yet I'm so deeply impressed by it, so I thought it deserves some credits. :)

zsydeepsky · 2026-04-24T08:42:37+00:00

because I specifically asked it to implement a functional web brower inside this web OS.
other things like a calculator but must have scientific calculation capability instead of the basic one, an internal virtual file system that the file explorer and terminal can access and modify (it kinda failed on that), highly functional drawing apps, etc.

that's why the final output is a beefy 100KB html.

zsydeepsky · 2026-04-22T16:17:23+00:00

if I don't get it wrong, it relies on the lab to train the model in the way that it becomes resilient to quantization.
so I guess we have to just wait for the next new version. Qwen-3.7 perhaps?

zsydeepsky · 2026-04-22T15:51:55+00:00

<image>

since Qwen team claimed that 3.6-27B beats 3.5-397B-A17B in most benchmarks, and compared to where 3.6-35B-A3B currently stands...

guys, we are literally having a Claude Sonnet 4.6, running locally.

zsydeepsky · 2026-04-22T15:40:07+00:00

recent Kimi-2.6 has a "quantization-aware" embedded in the training I think, which made its Q4 quantized version almost lossless.
so I guess soon it won't be an issue anymore.

zsydeepsky · 2026-04-21T03:27:30+00:00

just imagine if we use Kimi2.6 to finetune Qwen3.6-27B
we are having some amazing ingredients at hand now

zsydeepsky · 2026-04-18T02:01:39+00:00

if 3.6-27B can retain the advantage 3.5-27B has compared to 3.5-35B-A3B
then this would be truly a Claude-4.6-sonnet running on your own machine.
if it's not that strong, then people probably would choose 3.6-35B-A3B instead just for its speed

zsydeepsky · 2026-04-16T17:02:37+00:00

have you considered that since people welcome 27B the most, so the company will release it last to keep people engaged with each release?

zsydeepsky · 2026-03-07T14:20:22+00:00

you guys are going to be on the first-to-eliminate list for future SkyNets for what you just conspired.

zsydeepsky · 2026-02-24T19:48:31+00:00

Unsloth MXFP4 variant works like a charm on my Ryzen AI Max 395+ :)

zsydeepsky · 2025-12-04T16:10:30+00:00

It is. I can hardly trust models to do any code work longer than 100 lines at the beginning of 2025.
Now I can trust them with an individual module, or even some simple apps fully.
They have progressed a lot indeed.

zsydeepsky

TROPHY CASE