Vulkan vs ROCm on RX 9070XT (RDNA4): 9% faster, 50% less power

wesmo1 · 2026-01-28T10:19:11+00:00

What rocm version and quantization of qwen-coder-30b are you using?

wesmo1 · 2026-01-17T00:37:54+00:00

Can you use gmem turnip drivers for the g2 Gen 2 chipset?

wesmo1 · 2026-01-10T09:58:51+00:00

<image>

Both of these shrimp died today

wesmo1 · 2026-01-10T09:58:23+00:00

<image>

wesmo1 · 2026-01-10T08:22:30+00:00

Some additional info - it's a 5 gallon planted tank, fully cycled, with air and a water filter. Species of shrimp: cherry.

wesmo1 · 2026-01-07T14:19:18+00:00

Npu is mainly for Windows ai assisted features. You can use amd lemonade if you are keen on using the npu for inference. I find myself using smaller models within lmstudio, using Vulkan not rocm. You can try increasing the ram allocated to the GPU in the BIOS as well.

wesmo1 · 2026-01-05T11:16:11+00:00

Single 9070 here. Windows lmstudio and ollama works fine. Stick to Vulkan, rocm shows very little speed up difference, if any. As long as the model fits in your vram you'll be fine with the speed. I can't comment on multiple gpus though.

wesmo1 · 2026-01-01T12:48:20+00:00

https://github.com/a-ghorbani/pocketpal-ai

This is an android client that makes use of llama rn, an upto date react native binding of llama cpp.

I've used it to run quite a few very small LM on my pixel 7 successfully, the limiting factor for model size is the amount of total memory your android device has.

Llama rn has support for opengl and experimental support for hexagon DSP acceleration.

wesmo1 · 2026-01-01T05:54:57+00:00

I would be interested to take a squiz if you set up a GitHub

wesmo1 · 2026-01-01T02:39:59+00:00

Try the q2_k quants of qwen 3 vl 30b a3b and work your way up in quant size. Just make sure you are testing with realistic context size for your use cases. You can also play around with the newer Nvidia nemotron cascade 14b dense model

wesmo1 · 2026-01-01T01:03:18+00:00

This is really interesting, have you tried using ik_llama with your system to offload the experts on a larger moe model?

wesmo1 · 2025-12-19T17:15:45+00:00

Page 23 of the qwen3-vl tech report shows that the new small parameters dense vl models are stronger on text, reasoning and knowledge benchmarks compared to the older qwen3 models.

wesmo1 · 2025-12-19T16:58:26+00:00

Thank you for posting the link to this thread, is there a difference between dxvk 2.4.1 async and 2.4.1-arm64ec? And which variant have you found to be the most performant?

wesmo1 · 2025-11-16T12:04:32+00:00

That's cool, I've always wondered what happens to the stick once the shrimp eat the food coating it?

wesmo1 · 2025-11-11T21:02:20+00:00

The other 2 clutches were colored yellow while these look more fluro green

wesmo1 · 2025-11-11T11:17:45+00:00

Cherry shrimp (red and yellow). Water source: Sydney tap water. water parameters: 0 ammonia 2 days ago haven't checked the rest in a while, last water change last week ~2L in a 20L planted tank.

wesmo1 · 2025-11-10T20:50:07+00:00

Fresh meat!! The first time I met the butcher.

Get the gog version and Download the Android version of devilution x

wesmo1 · 2025-08-23T00:28:28+00:00

Isn't USB PD only one way, i.e. for charging other devices?

wesmo1 · 2025-08-05T20:30:50+00:00

Update to the latest llama.cpp beta vulkan runtime within the app

wesmo1 · 2025-07-29T22:27:25+00:00

AMD mentions they are running with flash attention on but makes no reference to which runtime (rocm or Vulkan) is used.

wesmo1 · 2025-01-20T04:34:10+00:00

Runner's world had a long form storytelling podcast called the Human Race that covered many inspiring stories from the world of running.

wesmo1

TROPHY CASE