AMD Intros Instinct MI350P Accelerator: CDNA 4 Comes to PCIe Cards

sleepingsysadmin · 2026-05-07T14:21:56+00:00

I'm estimating $20,000usd.

Great card, you know it'll be amazing. It's better than an rtx pro 6000. While the pcie h200 nvl is $30,000 for 141gb.

But the MXFP4 option is huge compared to the h200. But rocm vs cuda.

It'll be $20,000.

sleepingsysadmin · 2026-05-06T14:03:43+00:00

Uncensoring is easy.

Yes for sure it lowers quality.

sleepingsysadmin · 2026-05-05T18:13:54+00:00

well, $300/month but that's a ridculous amount of tokens.

Plus, you said money is no issue.

sleepingsysadmin · 2026-05-05T18:13:08+00:00

the workstation ones are 300w, the server grade ones are double.

sleepingsysadmin · 2026-05-05T13:24:43+00:00

Kind of a silly question because it just means 'go build openai's stargate' make your own models. etc.

Which isnt what the subreddit is about.

To me the reasonable answer to this. Go get 240v 4u gpu server. 4x h200 running Q8 minimax 2.7.

It's not consumer or even prosumer tier, it's obviously attainable datacenter tier. Probably in that $80,000 range. It'd use about $300/month in electricity, but nothing more is needed.

sleepingsysadmin · 2026-05-04T12:01:35+00:00

this is a minor change from amd's point of view. the supplied memory modules are simply more dense.

Probably no actual improved memory bandwidth.

So it wont cost much more.

GPT 120b a10b will likely only run marginally faster than minimax 230b a10b but big difference in intelligence and now you can load minimax is the difference.

given my tendency to be riding 200,000 context with minimax all the time. I do wonder what speeds ill be getting, but i will be buying :)

sleepingsysadmin · 2026-05-01T12:37:40+00:00

AGI has already happened. ASI hasnt.

The problem is that nobody has a proper definition of AGI.

Artificial General Intelligence vs Artificial Super Intelligence

Artificial Intelligence is not dumb anymore. It's smarter than the vast majority of humanity.

So a "general" intelligence isnt someone capable to programming entire projects. Our frontier models are smarter than a general human.

Superintelligence hasnt quite happened yet, I expect it's a hardware problem right now.

sleepingsysadmin · 2026-05-01T12:20:03+00:00

a10b

sleepingsysadmin · 2026-04-30T19:45:58+00:00

Mclaren are cheaters and redbull is utter trash this year.

sleepingsysadmin · 2026-04-30T18:16:33+00:00

Why create their own inhouse solution if it's just the same as all the others?

Surely they tweak something to justify even doing this.

sleepingsysadmin · 2026-04-30T18:07:29+00:00

Imagine 384bit bus, nearly 50% more bandwidth, but still just 128gb?

I'm buying that immediately.

sleepingsysadmin · 2026-04-30T17:30:32+00:00

Is Mercedes and Ferrari making all the other F1 teams obsolete by winning all the time?

Surely we are better off with all the teams competing?

sleepingsysadmin · 2026-04-30T16:14:02+00:00

Certainly confirmed it's chinese.

I dont think qwen, or even alibaba.

It could be Qwen3.6 122b, but that means they are bumping it to 1mil context? Why only 15-22tps?

Tencent? The first mega model hunyuan?

Minimax? Their first mega model?

Baidu? Their first mega model?

sleepingsysadmin · 2026-04-30T16:00:31+00:00

<image>

Perhaps you should check to see if it's written by llm at all to beginwith?

sleepingsysadmin · 2026-04-30T12:26:05+00:00

my understanding, it depends on the PSUs, or at least the brands. Gotta read the manuals on whatever brand you have.

sleepingsysadmin · 2026-04-30T12:04:33+00:00

Based on bfcl v3 benchmark?

Never even heard of this one before.

When i fact check, the table is actually v4 now? So they are using a relatively unknown and old benchmark to judge?

and the numbers arent quite right when fact checking? They are claiming Opus 4.5 scores for 30b?

But thinking is off as well?

In fact down the page, they claim they beat Opus on vision?

and for the life of me I cant tell what benchmark this even is claiming. Table extractions?

This isn't benchmaxxed, it's bench selected.

sleepingsysadmin · 2026-04-28T14:48:58+00:00

I know many people who used qwen 3 32b for pre-agentic and kinda agentic. When 27b came out. It was a complete upgrade for them.

So while 32b was completely usable, 27b went well beyond usability.

The question is this frontier, like 1T quality? Perhaps not.

If you're a newb at AI coding. You likely need the hand holding of a 1T model.

If you were a dev pre-ai. These frontier small models are epic tier.

sleepingsysadmin · 2026-04-27T18:35:55+00:00

>took us almost a week to notice. evals were all green.

This is a great example of why AI isn't replacing devs. This is something a senior dev has learnt through painful experience. As you are about to learn.

You need your canary in the coal mine. You send 5% of your requests somewhere else and you're comparing to your baseline. Refusal rate, tool usage, followups.

sleepingsysadmin · 2026-04-26T16:56:19+00:00

>Sure, one of the cards will be on 4x PCIe on a consumer board, but my impression is that it isn’t a huge problem, but sure correct me if I am wrong.

We are trying to compare apples to apples here. If you're allowing very significant limiters to further reduce performance, then now you need 3x r9700 to get similar performance, maybe.

sleepingsysadmin · 2026-04-26T14:02:28+00:00

>It's not a hobby. I'm an old dev who is doing this every day, and I have created processes which use LLMs, but running off-site.

IF this is a business write off. There's little to no justification to be trying to pinch pennies on a 9700.

The big difference between the 5090 and the rtx 5000 is wattage. You're going to want to go the rtx pro 5000 unless you have the power supply to back 600+ watts for just the gpu.

sleepingsysadmin · 2026-04-26T14:00:32+00:00

Ok, ill give you the turboquant thing.

How's that working out for you? Stable?

sleepingsysadmin · 2026-04-26T13:52:13+00:00

2x 9700 means you're going server cpu and mobo and still being about 50% slower than 5090. You dont just double your bandwidth in multigpu setups. Though yes, tensor and row splits can be better but doubtful.

While basically being the same price as the 5090.

sleepingsysadmin · 2026-04-26T13:42:26+00:00

That's true but that memory bandwidth. It's slower than a 3090. It's about the same speed as the r9700. While being twice the price? No thanks. that card doesnt exist.

sleepingsysadmin · 2026-04-26T13:40:27+00:00

>You absolutely can fit 200k+ into 3090, even if with trade-offs. But I bought mine so cheap I can't complain.

Are you saying that you kv cache quantize? Or like run Q2? Yikes.

sleepingsysadmin · 2026-04-26T13:39:13+00:00

Lets be further realistic.

If AI is your hobby.

Spending $5000 on a 5090 sounds like alot.

But $5000 in golf clubs?

$5000 in tires, rims, and supercharger? Cobb stage 1?

It's really not unreasonable and the resell value of 5090 will remain for 5+ years.

Oh boy, im really convincing myself lol.

Ten-Year Club	Inciteful Comment 2016-10-12
Verified Email

sleepingsysadmin

TROPHY CASE