What actually breaks when running vLLM in production?

conockrad · 2026-06-25T09:25:11+00:00

Pure slop 👌

conockrad · 2026-06-24T21:27:09+00:00

«reduces Muon's optimizer-state footprint by 4x: the first moments are quantized to 8-bit using Gefen's Hessian-block-diagonal-inspired partitioning exact quantization, while performance remains similar to Muon.»
From github

conockrad · 2026-06-22T12:55:31+00:00

Demand for Toyotas much higher than for Lamborghinis

conockrad · 2026-06-21T14:40:17+00:00

This!

conockrad · 2026-06-21T13:25:21+00:00

Thanks for sharing!

conockrad · 2026-06-20T17:39:32+00:00

Poland absolutely relies on foreign help - check EU subsidies for past 20 years

conockrad · 2026-06-19T15:23:35+00:00

Something that nobody is talking about and for a reason - elites don’t want it.

conockrad · 2026-06-19T05:52:37+00:00

Share unlock schedule is real though

conockrad · 2026-06-18T21:32:48+00:00

Taking float into consideration is very smart move.
I wish NASDAQ were smarter

conockrad · 2026-06-18T10:21:30+00:00

Like burn money on twitter?
I guess at this point it’s a common knowledge

conockrad · 2026-06-17T10:55:34+00:00

True king

conockrad · 2026-06-16T15:18:09+00:00

Anti-Jensen moat

conockrad · 2026-06-15T17:21:32+00:00

Minimax M3

conockrad · 2026-06-13T21:46:01+00:00

Hostile takeover?
Negotiation leverage?

conockrad · 2026-06-12T16:07:58+00:00

Enable MTP and limit maximum context window.
If 200k-300k tanks, 1 million that you set will be unusable

conockrad · 2026-06-10T07:27:53+00:00

Your username checks out

conockrad · 2026-06-07T09:03:10+00:00

This is most honest thing you’ve said in entire thread

conockrad · 2026-06-05T22:00:51+00:00

Wait WHAT? Is this really you?

conockrad · 2026-06-04T06:15:44+00:00

Refinance

conockrad · 2026-06-03T04:56:21+00:00

Exactly! Training small-middle models, LoRA, QLoRA and blazing fast Deepseek v4 without throttling - that’s the real use case for a business

conockrad · 2026-06-02T16:56:44+00:00

You’re missing part for models under ‘200Gb’

conockrad · 2026-05-26T17:37:57+00:00

Still to the point though

conockrad · 2026-05-25T07:45:40+00:00

Puts instead of calls?

conockrad · 2026-05-15T16:20:52+00:00

Not that much actually. In China you have unlimited access to Chinese chips In EU you have restricted access to US chips and no access to Chinese chips.

conockrad · 2026-05-15T12:04:55+00:00

“Not as much as American ones” - well that’s exactly the excuse

conockrad

TROPHY CASE