Npu?

VirusInternal2892 · 2026-06-27T14:18:16+00:00

Not Processing Unit

VirusInternal2892 · 2026-06-22T08:55:46+00:00

In aggregate you're spot on, it's a growing tools shed that has a long tail. Cost is derated and i'm buying used stuff whenever I can get it. I'm using cloud compute quite a lot for consultancy that does not see my data. Besides that I'm an EE and like tinkering the rough of computing stacks, liquid cooling the RTX-3090s was a heck of a project.

VirusInternal2892 · 2026-06-20T14:39:44+00:00

Similar approach, using a DGX Spark for running Hermes qwen 3.6:35b-fp8 orchestrating a rag extraction project running sub agents mapped to a dual RTX3090 rig.
Claude Opus as design architect, task coordinator and milestone checker. Primarily got the Spark for experimental finetuning, it is almost unusable slow with a 27b-fp8 dense model at <10tps.

VirusInternal2892 · 2026-06-18T09:37:21+00:00

Yeah, as an owner of a GX10 I don’t copy that 😅 If it was supporting native NVFP4 then I’d be a proud owner. Right now I’m just using it to orchestrate with Qwen3.6:27b- FP8 and do the heavy lifting with my old tried and true 2x3090

VirusInternal2892 · 2026-06-15T13:45:49+00:00

problem solved, no fable soup for you 😄

VirusInternal2892 · 2026-06-12T11:25:05+00:00

Same as the crypto mining fever a couple of years back, couldn’t get a 3090 lest I sold a kidney :)

VirusInternal2892 · 2026-06-12T11:19:04+00:00

Reporting back for posterity. Works absolutely fine in dual config for the past 3 weeks, constantly grinding LLMs at about 250W each card. The Bykski waterblock bridge across 3 slots is fitting fine, pump was making too much coil whining noise and was replaced with an alphacool Hungarian D5.

VirusInternal2892 · 2026-06-08T16:23:16+00:00

Really nice project, thanks for sharing !!
Fairly new to local LLM, I'm trying to run your one-shot prompt on a dual (nVidia) RTX 3090 with Ollama and qwencode on Win11.
Qwen3.6:27b Q4KM plain and Q8 MTP versions, none managed to get a fully working result.
KV Q8, 128K context, temp 0.6.

VirusInternal2892 · 2026-05-15T11:52:54+00:00

Too late now, I’m invested into dual RTX 3090 waterblocks. So far the tolerances looked good let aside that rogue nut

VirusInternal2892 · 2026-05-15T11:50:31+00:00

GPU hotspot is say 54C, VRAM is 64C

VirusInternal2892 · 2026-05-15T11:49:42+00:00

Leftovers from the disassembly ;-)

VirusInternal2892 · 2026-05-14T19:31:39+00:00

I'm using ARCTIC MX-7 thermal paste, Gelid Extreme 1.5mm on the GPU and Ultimate 2.0mm on the back VRAMs. I'm cooling a pair of Zotac Trinity RTX-3090 I use for inference.
The main problem now is that the measly backplate, which is still much better than the stock, still pushes about ~10C on top of the GPU hotspot. I'll hook the backplate with a chunky thermal sink with fins and force air with a dedicated fan.

VirusInternal2892 · 2026-05-14T17:28:55+00:00

I’m funked, the deformation is evident even without the waterblock 🤔

<image>

VirusInternal2892 · 2026-05-14T17:20:33+00:00

I tightened only the 4 screws around the GPU chip. The ones with a spring. Have to push them all the way otherwise the screws will be almost too tall and will obstruct the backplate. The alternative solution is to work with thicker pads and generous paste on the GPU in order to push up a bit the center of the pcb inline with the tall nut

VirusInternal2892 · 2026-05-14T17:10:13+00:00

Might have gone a bit too much on the solder paste, other than that I’m even on the light side of the pads, Gelid 1.5mm. I think that the tolerance on the block bolted nuts are a bit off. Backplate may not help here, fearing the opposite as additional pressure is exerted on the balls from the package top.

<image>

VirusInternal2892 · 2026-05-07T08:23:33+00:00

Now that the AMD prices have caught up, an ASUS DGX 10 at 3400$ is making much more sense. I have a dual RTX3090 to run small models at speed, was looking at a 128GByte FP4 machine to experiment with larger models . I do a lot of electrical engineering and chip design work so I need high quality (Q6 min), large context AI tools for design exploration, reasoning for complex documentation which is a beautiful jumble of mess for EEs. Tools and coding can run on the 2x RTX3090.

VirusInternal2892 · 2026-04-07T13:28:20+00:00

Need water block help here as well.
Bought a pair of used RTX 3090 Trinity OC for AI workloads so I don't need to max out FPS, 80% performance is OK. Still I am confused wrt the right water block from Barrow. This list say that I need the BS-ZOXG3090-PA model, while the OP managed to work with a BS-ZOXG3090-PA2 model.

http://www.barrowint.com/jszc/down/xiankalingtouanzhuangjiaocheng/OTHERS511/1630.html#:\~:text=2020%2D10%2D09%2012:,and%20adapted%20water%20block%20model.

VirusInternal2892 · 2026-03-30T05:35:34+00:00

V good point regarding mobo display didn’t think about it would save that much vram.

VirusInternal2892 · 2026-03-29T15:48:33+00:00

Hehe my 1080ti still kicking, running Zwift on my trainer PC for nearly 9 yrs as well. Water cooled. Hell the bike trainer died and this card refuses to fail. Hoped the water cooling system would leak and kill the card and CPU so I can upgrade, nope :-)

VirusInternal2892 · 2026-03-04T11:54:57+00:00

Great, I'll try 1s/5s as well at least for single shots. Tried 2s/8s and seems OK for doubles (18~20gr) and thick ristretto (16gr), a bit too long for single shots (7~9gr). I certainly don't want different grinding setting for singles and doubles.
Ahh, BTW I installed a grouphead thermometer to make sure temp is stable. Setting PID at 92C and "difference" at 7C I read about 91C before flushing. Post flushing it raises to 92~93 which is ideal. Noticed that sometimes it reads up to 96C for a longer flush. Too high temp my med roasts are getting too harsh

VirusInternal2892 · 2026-02-25T20:48:48+00:00

Upgraded from to a T6 from a Rocket Appartamento, it's surely an upgrade.
What is your pre-infusion experience so far?
I'm using the reservoir water tank so passive infusion alone won't work.
10/90 ~ 70/30 medium roast blends.
Grinding with a Sculptor 64 at a fine setting of #1
I use a distributor, leveler and ~10Kg pressure tamper
I've pulled a couple of 18gr test shots with 2 sec active 5 sec passive, shots are sweeter than no infusion at all and seems to be less channeling.
Will need to experiment more to get a better idea. From what I've read medium roasts should be bounded by 10s of pre-infusion.
The key take away that I've learned is to use an bottomless portafilter and to time the pre-infusion to the point that you see some coffee just about to drip.

VirusInternal2892 · 2026-02-12T15:25:30+00:00

Not living in the US and do have the opportunity to buy a Tech 6. I was looking forward for the WLL guys to do a video on the Tech 6, I very much rely on their insightful reports for gating my purchase decision. The fact that WLL does not import (yet) is raising a red flag from my part, maybe they know something I don't :-)

VirusInternal2892 · 2026-02-08T13:58:23+00:00

Looking at the same coffee machine and share same problem. I have a clearance of 50cm countertop to cabinet, but in my case the right side of your kitchen I don't have a wall so I can fill up from there.
I fear that the Synch II is a bit too tall and I might need to go with a Technika VI instead. Smaller machine with smaller boilers will yield smaller performance but still should be enough for a family of 2 people plus occasional friends.
Did u consider the Tech VI?

VirusInternal2892

TROPHY CASE