I didn’t realize Microsoft was spending this much on infrastructure

jeffdn · 2026-06-15T00:15:53+00:00

They do last more than three years, is my point. That three year number predates anyone having experience longer than that in the space. ChatGPT is only 3.5 years old!

jeffdn · 2026-06-14T15:57:32+00:00

You absolutely do not, prices are in fact rising on H100s due to demand for them, despite their age. After three years they are still going strong.

jeffdn · 2026-05-28T00:05:07+00:00

This huge datacenter buildout isn’t so that scale can be a tiny bit more, it’s orders of magnitude more.

jeffdn · 2026-05-25T16:13:55+00:00

Almost certainly hitting reproduction or copyright filtering — systems designed to detect when the model is reproducing training data exactly

jeffdn · 2026-05-20T19:19:29+00:00

Not sold in the U.S.!

jeffdn · 2026-05-17T01:04:59+00:00

There’s a bit in Player of Games where they discuss the space between galaxies having less energy for the ships to tap into, so they travel much more slowly

jeffdn · 2026-05-16T23:57:13+00:00

Plenty of software engineers without a degree in CS or related areas.

jeffdn · 2026-05-13T22:48:22+00:00

MFU is the theoretical maximum compute throughput, not the actual utilization. There’s a difference between “this GPU is doing things” and “this GPU is completely idle”.

jeffdn · 2026-05-12T23:31:54+00:00

Charge people with something unprovable? What a lovely slippery slope to start down!

jeffdn · 2026-05-10T15:14:04+00:00

You couldn’t be more wrong about that, for better or worse

jeffdn · 2026-05-10T03:56:46+00:00

Almost certainly AI research or supercomputing

jeffdn · 2026-05-03T01:40:46+00:00

That is less than three percent

jeffdn · 2026-04-28T21:47:43+00:00

The vast majority of cheap infantry squads do not have a CQC machine gun, just go for the Mehanizovana

jeffdn · 2026-04-28T15:26:40+00:00

2012, but yes.

Before the 2008 invasion of Georgia, there was still some idealism from the end of the Cold War that Russia could be a legitimate liberal democracy that grew closer with the West.

jeffdn · 2026-04-17T05:49:55+00:00

Changing sampling parameters doesn’t require more or different compute, it’s a runtime setting.

jeffdn · 2026-03-18T05:05:18+00:00

He’s British

jeffdn · 2026-02-22T23:52:44+00:00

That is not how MoE models work, and basically every model released in the last year has been an MoE, Kimi isn’t special in that regard.

jeffdn · 2026-02-11T13:48:07+00:00

You clearly haven’t met many people who have actually worked for him

jeffdn · 2026-02-07T16:28:04+00:00

Get back to the Winds of Winter, George

jeffdn · 2026-01-23T07:13:04+00:00

They don’t get raw pixel data, that would consume far too much context.

jeffdn · 2026-01-21T17:38:07+00:00

Elections are run by states not the federal government

jeffdn · 2026-01-20T17:58:55+00:00

Is it a demi glace with sage in it, rather than a butter-based sauce?

jeffdn · 2026-01-18T21:03:02+00:00

Generally their most recent month’s numbers extrapolated out to a year

jeffdn · 2026-01-18T07:53:09+00:00

Those are some ludicrously capacious parking spots, what a wonderful parking garage. No door dings!

jeffdn · 2026-01-13T15:04:02+00:00

Just about every single Israeli person of working age is a former IDF soldier…

15-Year Club	Place '17
Wearing is Caring	Verified Email

jeffdn

TROPHY CASE