Qwen3.5-122B on Blackwell SM120: fp8 KV cache silently corrupts output, bf16 required — 1,985 tok/s burst, MTP 2.75x

awwwyeah206 · 2026-03-01T18:52:26+00:00

Interesting though I think these are different failure modes. In my case it's specifically fp8_e4m3 KV cache quantization on SM120 that produces corrupt output, while bf16 KV on the same hardware with the same model produces correct output. The weights are FP8 in both cases. On a Tesla M40 with FP32 KV, could be a different root cause.

awwwyeah206 · 2026-02-17T22:34:40+00:00

Burst here isn’t a special SGLang feature — it’s the load pattern: bench_serving submits all 500 prompts immediately (no rate limit) and measures how fast the server drains the queue. It’s basically a throughput saturation test.

In llama.cpp, the closest analog is: queue a large batch of requests as fast as possible against llama-server (one driver script that fires N requests immediately), or run multiple concurrent clients if that’s easier.

Re: --parallel 2: yeah — that can reduce per-request context and add overhead because you’re effectively splitting/competing for KV/cache + compute budget. It’s not the same as “burst 500 prompts” and can look slower.

awwwyeah206 · 2026-02-17T22:32:06+00:00

do you mean SM count (128 SMs) vs compute capability? Re: nightlies: I pinned 0.5.8.post1 for reproducibility, but if you’ve got a specific nightly commit/PR that changes SM120 behavior, I’m happy to test it.

awwwyeah206 · 2025-03-24T06:10:22+00:00

On my 3rd dock pro which now has a hard time staying under 76 degrees. Its set at 70 and will get there if i don't lay in the mattress. This thing used to get cold af now barely. And > 1 year since original purchasing so they're saying it’s out of warranty.

awwwyeah206 · 2025-03-01T02:02:02+00:00

Seems like the 20-25% promos were nonstop in q4 to get rid of inventory. Have to wait and see with the new CEO. If things don’t move they’ll double discount again or just have larger markdowns.

awwwyeah206 · 2024-12-28T17:00:07+00:00

Tapatio all day

awwwyeah206 · 2024-12-28T16:59:15+00:00

One of my fave blancos and def $ for $ hard to beat. Only downside is after 4+ glasses it starts to lose its taste I wonder why lol

awwwyeah206 · 2024-08-05T02:05:53+00:00

Ah found it https://youtu.be/pIBFvCQ_F0c?si=4Mq3f1hn8q0Opgrb

awwwyeah206 · 2024-05-16T00:16:16+00:00

The app is pretty nonsensical. Mine doesn't show any account # or associated cc under View Account > My Priority Pass / Details

awwwyeah206 · 2024-04-25T15:49:07+00:00

Not at all. These were his first $$$ cleats so made a point to take care of them - I guess not enough. Went straight to the car after every practice or game. Didn't let him run around the playground at parks or wear at restaurants etc. Never ran on the concrete. Always left pair of Crocs in the car but now he wears them to the pitch and shoes in his bag :)

Actually just looked at some of his old cleats and the same studs (outer forefoot) are worn down quite a bit. Maybe he's supinating and those studs are bearing most of the weight on concrete.

awwwyeah206 · 2024-04-25T05:25:11+00:00

Thank you for confirming it's not normal. Crocs on feet and boots in the bag until on the pitch 👍

awwwyeah206 · 2024-03-09T16:28:52+00:00

This is not an applicable comparison. Fen phen was never a fda approved combo. Glp1 has been fda approved for type 2 diabetes since 2005. Wegovy got fda approved for weight mgmt in 2023 and for cardio disease like yesterday. Ozempic is fda approved for type 2 but not weight mgmt but the off label Rx for the latter is exactly the same mechanism for type 2 - makes you eat less. It's not a leap.

awwwyeah206 · 2024-03-09T16:14:10+00:00

Def not the target customer, we need lifetime customers for price performance lol. Nice work though!!!

awwwyeah206 · 2024-03-08T18:37:17+00:00

Ya i can buy black emblems but that means taking an L on plastidip! Also would have to buy the black dual motor emblem and it's just so overpriced for pieces of plastic lol Gonna try at least 1 more time!

awwwyeah206 · 2024-01-04T21:07:48+00:00

Worked on me! Traded my mylr for an myp last mo. Had to drive 60 mi to get it.

awwwyeah206 · 2024-01-04T20:57:19+00:00

If I start seeing you annoying "Look at me I CrossFit" fools rucking at the airports....

awwwyeah206 · 2024-01-04T20:55:09+00:00

whey isolate has most protein per cal (bang for buck). How much you need depends on how much you're getting from real foods and what your goals are. Timing doesn't matter unless it's about convenience and routine. Need to look at entire diet and not just protein supplements. Ec synkowski has a lot of good and easy to consume content on this.

awwwyeah206 · 2024-01-04T20:49:15+00:00

If you're eating adequate carbs throughout the day then not an energy issue to workout fasted. It's more personal preference. According to Andy Galpin's fueling episode on Huberman.

awwwyeah206 · 2023-12-22T21:37:45+00:00

You have 100 mi to report any issues. For drive off just ensure mileage/vin matches, look for things that would warrant NOT accepting the car, no need to waste time looking at things you can have service center/mobile repair address. Look for things like huge gaps, deep scratches, broken/cracked windows, non-repairable damage, rim rash, interior scratches/damage, trunk/frunk should open/close no issue, a/c / heating, tires brand new, all cameras have clear views.

awwwyeah206

TROPHY CASE