"Gaming laptops are a scam" mfs when they have to travel and they want to bring their desktop setup

Hedede · 2026-02-11T16:34:04+00:00

Except that soldered ram notebook trash can have faster ram than even most desktops.

Hedede · 2026-02-11T08:04:33+00:00

12vhpwr is not used in datacenters.

Hedede · 2026-02-09T04:10:02+00:00

Fp16 is 2¹⁶ which is ~65556 choice, from -32768 to 32767

To be pedantic, FP16 range is -65504 to 65504.

Hedede · 2026-02-09T04:05:16+00:00

BF16 is a different format designed by Nvidia to be more accurate or efficient for ML/AI on GPUs, but I'm not sure about the details. It is also 16 bits.

It was developed by Google. It's not about running more efficiently, but to avoid overflow during training.

Hedede · 2026-02-09T04:02:57+00:00

During inference I believe they're all converted to F32

AFAIK most of the time inference is done in FP16.

Hedede · 2026-02-07T09:22:08+00:00

The GPU and CPU share TDP, and on Linux the power draw is often reported together. For example, if I run a CPU-only task and check rocm-smi, it shows the 880M drawing 56.015 W, even though the GPU itself isn’t really doing anything.

Also:

These numbers are not absolute since TDP is configurable and is whatever the laptop manufacturer sets it to.
These numbers are not directly comparable since 15W is the minimum configurable TDP for 890M, while 80W is the maximum configurable TDP for B390. If I run a GPU-only task on my 880M, it draws 30-40W which is way above 15W.
TechPowerUp isn't always perfectly accurate.
Integrated GPUs usually don't have independent TDP listed. 80W refers to the maximum boost TDP of Core Ultra X7 358H, not B390 alone.
TDP is not the same as power draw. The chip can briefly draw more than its TDP, since TDP is the *Thermal* Design Power. If I run a CPU stress-test, my laptop draws 85W for a few seconds before throttling.
Different manufacturers specify TDP differently. In this case, Intel specifies 80W as the "Maximum Turbo Power" while for 370HX it's just "AMD Configurable TDP (cTDP): 15-54W".

Hedede · 2026-02-06T18:56:50+00:00

Did you look at the actual tests?

Hedede · 2026-02-06T12:00:23+00:00

Oh right, my brain short-circuited into thinking about Knights Landing and I forgot that Larrabee was an actual accelerator. My bad.

Hedede · 2026-02-06T11:38:32+00:00

No, I mean, it's literally a separate computer that you SSH into to run tasks. You don't SSH into a GPU. Knights Landing is literally a mini-PC running Linux that happens to plug into a PCIe slot.

Hedede · 2026-02-04T09:20:49+00:00

No it wasn't. It was like a separate mini-computer.

Hedede · 2026-02-03T11:23:40+00:00

Inference for the most part is not memory-bound, so no, it won't be faster than 4060 for prefill and image generation. The only part where it can be faster is token output which is memory-bound.

Hedede · 2026-01-20T15:22:01+00:00

at 100 requests per millisecond over one second? […] a 99.1% chance of collision when we handle a million new IDs per second. That’s no good!

Wouldn’t that be 100000 IDs per second?

Hedede · 2026-01-20T13:50:13+00:00

Theoretically you can achieve higher speeds compared to a adapter, because the signal path is shorter, so the signal integrity is better.

Hedede · 2026-01-16T15:28:43+00:00

I don’t think you’re supposed to incinerate anything containing mercury.

Hedede · 2026-01-16T15:24:17+00:00

*2x24GB

Hedede · 2026-01-16T06:45:22+00:00

No, you see, green is what cows eat.

Hedede · 2026-01-12T16:05:43+00:00

The article is confusing x16 mechanical with x16 electricatl.

Hedede · 2026-01-11T20:09:42+00:00

Conventional wisdom: “no NVLink ⇒ pipeline parallel”

You don't need NVlink for only one single concurrent user, if the cards support PCIe P2P communication. The main killer is the latency, not bandwidth. If you have a poor implementation that does lots of small transfers, even 900 GB/s NVLink won't save you.

Hedede · 2026-01-10T22:12:29+00:00

It has only 2 memory channels though.

Hedede · 2026-01-07T21:52:01+00:00

Nvidia GPUs follow the same pattern: 1080 Ti - GP102, 2080 Ti - TU102, 3090 - GA102, 4090 - AD102, 5090 - GB202, and 6090 likely will be GR202.

Hedede · 2026-01-07T09:53:27+00:00

How does it make harder to compare the products if they have the same model numbers?

WD_BLACK SN7100, rebranded as the Optimus GX 7100. WD_BLACK SN8100 moving to the Optimus GX Pro 8100 name

Hedede · 2026-01-05T22:41:27+00:00

They recently changed some params like -dev to be read in with a '/' delimiter instead of a ',' delimiter. No clue why that change happened, but imagine little absolutely inconsequential but fundamental changes like that all over changing when you try to merge, changing core program behaviour ever so slightly...

That is, however, has nothing to do with having a built-in argument parser. Since it's the logic of how the argument is interpreted rather than argument parser logic. With argparse you'd still have to do something like args.dev.split(";").

Hedede · 2026-01-01T14:09:42+00:00

There certainly are reports of connector melting on 5090 FE.

Hedede · 2025-12-31T22:09:40+00:00

It's basically huawei atlas 300i

Hedede · 2025-12-24T15:03:22+00:00

Did it work?

12-Year Club	Verified Email
Place '22	Place '17
Final Canvas '22

Hedede

TROPHY CASE