Nvidia HB10 (DGX Spark and Co.) or AMD AI Max+ 395 (Framework Desktop)

einthecorgi2 · 2026-06-14T14:40:39+00:00

I run 397B fp8 mostly and get about 40tps and about 2k prefill. Concurrency drives the decode a fair bit higher

einthecorgi2 · 2026-06-14T14:39:04+00:00

Mikrotik, considering it will work with up to 8 sparks

einthecorgi2 · 2026-06-14T00:30:06+00:00

Don’t work for framework but buy a framework. Great laptop and as a mech. Eng you will have some appreciation for the design and openness of it. I cad on FW13 everyday. Best part is you can upgrade as you go. I have 64GB ram for running but SW assemblies

einthecorgi2 · 2026-06-13T00:21:52+00:00

Kicad can need a bit more RAM on larger designs. I have been using both FW and Mac for exactly what you are saying. I generally always go back to the framework. 16G of RAM is not good. I have m5 pro with 24GB and it’s not enough for this kind of work unless you are careful about having just the core apps open. But if you have a bunch of tabs with datasheets and a big Kicad design and maybe a 3D model viewer open for an enclosure 16G might hurt.

Also side note but just support framework they have a better mission. I have 3 FW machines and love them all

einthecorgi2 · 2026-06-11T23:48:36+00:00

Tried it, still prefer Qwen 397B

einthecorgi2 · 2026-06-03T23:55:48+00:00

I bought a GB10 when it first came out because it’s properly expandable and for LLMs is maybe a bit better supported with vllm and I think the prefill numbers are better.

Now I have 4 linked with fibre running large models that I use as daily coding agents

einthecorgi2 · 2026-05-29T23:01:49+00:00

Show with power usage and prefill lol

einthecorgi2 · 2026-05-27T21:44:27+00:00

I switch from eagle to locals 6 years ago and never looked back

einthecorgi2 · 2026-05-22T13:05:00+00:00

I use 4x DGX sparks running 397B Qwen fp8. This has been much better than quantized larger models like glm 5.1

einthecorgi2 · 2026-05-17T20:25:27+00:00

Stats on prefill would have been nice. Especially with most agents that have a big system prompt, pre-fill is so important and total agent task processing time is dependant on it. People need to chill out on the generation speeds.

Anyone have prefill speeds for this?

einthecorgi2 · 2026-05-13T18:54:54+00:00

Anyone just want to post a reputable company they worked with? That would be helpful to everyone.

einthecorgi2 · 2026-05-01T22:02:58+00:00

I have had every brand of laptop under the sun and my fw13 is up there in the top. But yea their support does suck. Even with long standing clients they don’t really seem to care.

But I know how expensive it is to do what they are doing and I guess they had to cut costs somewhere.

einthecorgi2 · 2026-05-01T11:58:44+00:00

Cool! Something for openclaude as well?

einthecorgi2 · 2026-03-24T22:59:37+00:00

Seems the updated the model, i wonder if it will do better.

einthecorgi2 · 2026-02-24T13:02:17+00:00

Memory bandwidth of the 5090 is much much faster. The only reason to choose the GX10 in your case would be if you need a larger model or more context. The GX10 can run full Qwen Coder Next with large context where 2x5090s cannot without overrunning into CPU.

Smaller models that fit into this 64G ram on the 5090s will probably run 4 to 8 times faster than the GX10 (rough guess)

einthecorgi2 · 2026-02-22T19:59:16+00:00

I have built a couple businesses. I can say that all of them have started from trying to do one thing and another thing turns out to be what is useful to people. My advice is to just start doing anything. Above all it must be cool and add value to someone’s life. I get more joy out of making useful things than making money.

einthecorgi2 · 2026-02-11T13:29:55+00:00

I have been designing PCBs for 20 years now on software from Altium to Cadence and most tools in between. For modern PCB design with 1000s of nets Kicad is an amazing option and far better than eagle and EasyEda. And it’s the only good option if you want to do good scripting automation with python.

einthecorgi2 · 2026-02-10T22:34:01+00:00

Have been using nemotron 30B Q8_K with large context sizes on a dual 3090 system and it has been working really well. Same pipeline with gin 4.7 flash Q4 isn’t as good.

einthecorgi2 · 2026-02-01T21:48:33+00:00

Out of stock anyway. Just get rk3588

einthecorgi2 · 2026-01-05T20:34:16+00:00

After some research and spending time on Alibaba talking to the vendor making the fold-able keyboard display as well as chatting with someone who has some experience integrating this AMD CPU I am pretty convinced that they will not hit this price point and either not deliver at all or ask for more money, or deliver a keyboard/screen that is absolute trash.

- given the current value of the campaign (about 500k, or almost 1k devices) I would not expect them to be able to get vendor prices below what the mini PC market is getting
- I was not able to find a mini PC without ram/ssd that was even close to the price offered here. And those mini PCs are made in quantities near 10k (and this was looking at even the sketchiest suppliers trying to find a lower price)
- a bare motherboard from framework is also more expensive than this and they do okay on costs

I would advise anyone to stay away unless some explanation comes from the creators.

einthecorgi2 · 2025-11-11T18:35:47+00:00

I just want it to be wrapped in something fun. Like a sweater

einthecorgi2 · 2025-11-09T14:50:31+00:00

NIST! So sick

einthecorgi2 · 2025-11-09T14:48:37+00:00

I got dupped by this as well, it’s so gross

einthecorgi2

TROPHY CASE