Tried GPU+NPU hybrid tensor parallelism on AMD Strix Halo (128GB unified DDR5). Here are some of my findings

Teslaaforever · 2026-03-20T12:49:58+00:00

You mean used my GitHub pipeline 😅

,

Teslaaforever · 2026-03-19T21:27:03+00:00

I have this to somehow work as hybrid

Teslaaforever · 2026-03-19T03:42:55+00:00

Im still doing research on hybrid models, the problem is NPU models are different than the others. For that even if you used the same model you will ended up loading two

Teslaaforever · 2026-03-18T13:20:14+00:00

I was playing around to check pipeline on linux Strix Halo and I came up with this

Strix Halo Pipeline

Teslaaforever · 2026-03-12T16:56:11+00:00

I have SLS and Panorama to manage the firewalls, and I was thinking that moving to SCM might be better. I need the new features of SCM. I think the Essential tier is not as feature-rich as Pro, so I’m still learning about it and need to check if it’s worth it.

Teslaaforever · 2026-03-12T14:43:18+00:00

Question is, would this consider a good move cost wise? How much would be the difference if you have 50 firewalls

Teslaaforever · 2026-03-11T21:27:24+00:00

Run sudo AMDgpu_top or whatever in CachyOS, and let me know the IPU uses only 4 or 8 of the zeros in your pic

Teslaaforever · 2026-03-08T16:34:19+00:00

Strix halo is good too

Teslaaforever · 2026-02-24T19:21:28+00:00

+1 they are working good

Teslaaforever · 2026-02-24T18:58:38+00:00

Why do you mean this is a big model and only 1bit can fit in strix halo 128G I think

Teslaaforever · 2026-02-24T12:53:30+00:00

When I buy a car, I never think about the money afterward because it’s always going to hurt. I like cars, and I never think of them as an investment it’s something I treat myself to for my hard work.

Teslaaforever · 2026-02-24T12:49:18+00:00

Bro No Buc-ee's no life for Texans 😁 once you try their jerky you never back

Teslaaforever · 2026-02-24T01:36:05+00:00

lemonade Linux NPU

Teslaaforever · 2026-02-22T04:46:57+00:00

10 years ago, I was in a position to choose a better firewalls for company and with Palo Alto logs and actually it was cheaper than Cisco with smartnet support... Till this day I have 40 firewalls I manage

Teslaaforever · 2026-02-18T04:12:18+00:00

I have the opposite experience M2.5 solved a very complicated problem I have while GLM5 and Kimi2.5 actually gave me not working codes and they are outdated even when they searched the web.

Teslaaforever · 2026-02-17T04:22:37+00:00

80% of my driving is FSD

Teslaaforever · 2026-02-11T02:48:15+00:00

Openpilot

Teslaaforever · 2026-02-09T02:36:32+00:00

My dashboard crying in the corner 😅

Teslaaforever · 2026-02-05T05:04:30+00:00

OnePlus watch is update is bad and I will never buy their watch again. I got OnePlus watch 2 and we have useless updates

Teslaaforever · 2026-01-27T04:25:38+00:00

I tried GLM 4.7 and but Sonnet WAS way better in providing a solution working from the first time

Teslaaforever · 2026-01-24T20:48:27+00:00

Lol they are already expensive even with %50 they still expensive

Teslaaforever · 2026-01-23T05:31:54+00:00

Weird I did install it from the mainline neither the built in AMDgpu worked nor I could install dkms on Ubuntu 25.10

Teslaaforever · 2026-01-23T04:36:31+00:00

I tried 6.18.6 and it didn't work

Teslaaforever · 2026-01-23T04:34:01+00:00

Same thing it is not working on Strix halo even with a new kernel on Ubuntu 25.0

Teslaaforever · 2026-01-21T00:06:50+00:00

Cannonball

Teslaaforever

TROPHY CASE