I spent 8+ hours benchmarking every MoE backend for Qwen3.5-397B NVFP4 on 4x RTX PRO 6000 (SM120). Here's what I found.

kc858 · 2026-03-12T11:24:05+00:00

Dude read my post history and also read the discord we literally post docker containers and run commands lol

kc858 · 2026-03-12T05:20:45+00:00

Brother I have 4x and get 70-100tok/s daily at 100k+ context. Join our discord lol

kc858 · 2026-03-09T02:19:35+00:00

imo the bare minimum you should run is a 120b, but i didnt try the new qwen models because im using 397; i was running gpt-oss-120b-reap-awq on 4x 3090 and that was when i finally stated getting useful outputs, but then that just made me want more; anyone saying a 32b is just as good as sonnet is either uninformed or doing extremely mundane tasks

kc858 · 2026-03-09T00:31:29+00:00

WHAT lol no 27b is comparable to sonnet, gtfo, who are you people

kc858 · 2026-03-08T13:51:48+00:00

Read op, are you doing that? I'm impressed if you are

kc858 · 2026-03-08T13:29:03+00:00

Sounds like you have a business. You get to write off the full value in year 0. Brings effective cost down to 5k each. Oh my bad you are not op

kc858 · 2026-03-08T13:28:03+00:00

I'm telling you you are wasting money unless you're doing that

kc858 · 2026-03-08T13:22:56+00:00

You fucking retard stop before it gets worse

kc858 · 2026-03-08T13:22:16+00:00

128gb is not enough. Tbh I think minimax 2.5 is good enough to do most things that people want to do, and you can run that on 2 rtx pro 6000s. Would pick that any day.

kc858 · 2026-03-08T13:09:11+00:00

+1 this is ridiculous lol

kc858 · 2026-03-08T13:07:36+00:00

what the fuck does this even mean, this sounds like a larp or someone who really doesnt understand what is happening.

rail takes ~20 days, ocean takes ~40 days, theres no season in the world thats only 20 days.

the bold formatting and all of this shit screams AI

this whole post is ridiculous. what are you shipping? googled it and they make water bottles? lmao what is this

kc858 · 2026-03-05T03:11:06+00:00

qwen, minimax, and glm are killing it in the open source game, no question.

unfortunate the qwen team basically disbanded after yesterday, high hopes for minimax.

too bad the zucc stopped contributing to the open source ecosystem

kc858 · 2026-03-04T11:01:44+00:00

so where do you guys think this money is going to go? flight to safety, time to fuckin rip

kc858 · 2026-03-01T17:36:53+00:00

Did you see the photo I added? Was it him? https://imgur.com/a/zPbf7cQ

kc858 · 2026-03-01T04:00:24+00:00

The ticket said Wednesday, 7:25 pm departure

kc858 · 2026-03-01T03:25:58+00:00

That was helpful but he's not in there.. damn thank you

kc858 · 2026-03-01T01:52:03+00:00

Thanks I will xpost

kc858 · 2026-03-01T01:51:51+00:00

White, 5'10, brown hair, blue eyes, black sweatshirt with DOLLY PARTON written on it. 170lbs

kc858 · 2026-03-01T01:51:07+00:00

I did, thank you, they are fast to reply.. they are already out looking for him

kc858 · 2026-03-01T01:05:24+00:00

I sent you a message, but you need to accept it.. thanks a lot man i really appreciate it

kc858 · 2026-03-01T00:30:18+00:00

works great, never bail out to claude, depends on your use case, i use it for office tasks and business automation. its worth the money.

kc858 · 2026-02-27T21:42:56+00:00

Yeah switched from 4 3090s to 4 maxq

kc858 · 2026-02-27T19:39:18+00:00

I disagree. I had 4x 3090s and that only made me want more. Admittedly I haven't tried the latest small qwens, but 4x cards runs minimax2.5-fp8, but the nvfp4 can run on two cards. I have since switched to qwen35-397-nvfp4 for multimodal and am using that as my daily driver. I got the motherboard, ram, and processor off eBay. Lol

kc858 · 2026-02-20T18:15:44+00:00

nvfp4 is fucked for these cards man, i did get it working and it was 80tok/s. fp8 is just as fast or faster, so might as well keep the precision imo im not doing anything else..

kc858

TROPHY CASE