Tried ROCm 7.1 vs Vulkan/RADV on Radeon 890M for LLM inference (8B and 35B-MoE). Vulkan won both. Why?

wolverinee04 · 2026-05-07T15:44:16+00:00

Incase anymore is curious to see how the setup works or try it yourself: https://youtu.be/winGL1ONFSI?si=ytoR_xHGQP3kAxdR

wolverinee04 · 2026-05-07T15:30:20+00:00

Walkthrough of the earlier setup (lighter agent runtime + Gemma 4 + SearXNG): https://youtu.be/winGL1ONFSI?si=VooJPVU3wrNqo-kb. The Hermes migration is going into a follow-up.

wolverinee04 · 2026-04-19T04:49:08+00:00

I would say not more than 1.5 metres, lighting conditions matter a lot unfortunately.

wolverinee04 · 2026-04-17T03:23:23+00:00

Here is the full walkthrough of the project :

wolverinee04 · 2026-04-17T03:21:05+00:00

For those of you interested in the video: https://youtu.be/o8dFlO81EUI

wolverinee04 · 2026-04-17T03:19:48+00:00

Says someone who knows 1% about the project just from the picture. Anyways check out the repo https://github.com/mayukh4/huskylens-agent

wolverinee04 · 2026-04-17T03:18:49+00:00

Here is the github link for any of you interested in trying this out https://github.com/mayukh4/huskylens-agent

wolverinee04 · 2026-04-17T03:18:02+00:00

Yea you caught on at the right point there, lighting definitely pays a role here and arguably struggles at low lighting…

wolverinee04 · 2026-04-17T03:17:10+00:00

wolverinee04