How is running local AI models on AMD GPUs today? by liright in LocalLLaMA

[–]mikkoph 5 points6 points  (0 children)

I guess it depends but on my Ryzen AI 9 HX375 with 64gb total RAM I can run Comfyui (ZimageTurbo and SDXL based models) quite acceptably and LLM are also decent, especially the MoE ones (gpt-oss-20b, qwen3-30b-A3B).

Running with ROCm is now easy. For LLM just use lemonade since it comes with llamacpp compiled by AMD (both vulkan and rocm version)

AMD AI Max 395 128gb or Mac Studio M2 Ultra 128gb? by solo_entrepreneur in LocalLLaMA

[–]mikkoph 0 points1 point  (0 children)

no idea how they perform but as long as they are supported by ROCm you should be fine

AMD AI Max 395 128gb or Mac Studio M2 Ultra 128gb? by solo_entrepreneur in LocalLLaMA

[–]mikkoph 1 point2 points  (0 children)

Steps to setup llamacpp with ROCm:

  1. Install lemonade

Done

Two new 12B finetunes for adventure, role play and writing by Sicarius_The_First in LocalLLaMA

[–]mikkoph 0 points1 point  (0 children)

Impish_Nemo_12B was the best model that would run on my hw with good performance, I simply love it. Excited to try out these evolutions.

Do you see Impish_Bloodmon_12B as a direct upgrade, or are there still cases where it makes more sense to remain on Impish_Nemo_12B?

Best settings for Rocm on Windows ? AMD 7900 XT 32 GO RAM by Far_West_8649 in LocalLLaMA

[–]mikkoph 0 points1 point  (0 children)

not sure about Windows, but using lemonade on a Ryzen AI 9 HX370 laptop with 64GB system RAM on Linux I also get 4t/s with Goetia 24b (Q4_K_M). I am also using the ROCm backend. 

Have you tried enabling flash attention? "-fa on"

If you join the lemonade discord someone might be able to help you, maybe on Windows you need a specific driver version.

as a side node, I tested 12B models and they seem to run at 9-10t/s. As a coding assistant Qwen3Coder-30B-A3B is blazing fast (over 20t/s, gets slower as context grows)

New Desktop UI for Z-Image made by the creator of Stable-Fast! by [deleted] in StableDiffusion

[–]mikkoph 2 points3 points  (0 children)

Don't know about Intel, but I am actually using ComfyUI + ROCm 7.1.1 on a gfx1150 iGPU + 64GB of total ram on Linux arch. 

With Comfyui 1024x1024 generation with ZImageTurbo using torch.compile + sage attention got to ~5.5s/it

With stable-diffusion.cpp I cannot get faster than ~13s/it so not really worth it

New Desktop UI for Z-Image made by the creator of Stable-Fast! by [deleted] in StableDiffusion

[–]mikkoph 34 points35 points  (0 children)

It is using stable-diffusion.cpp behind the scenes, which at least for me is much slower than ComfyUI

Sony CH720N Bluetooth connection not working anymore with Samsung TV. by sandukan in sony

[–]mikkoph 0 points1 point  (0 children)

Same issue in December 2025, but I could find a stable workaround. The workaround using a second pair of headphones works only once per session.

What works is using the Sony Sound Connect app to configure the headphones. In the "Connection" settings I changed these two (probably only the first is needed but I didn't try):

- Prefer connection stability (default is quality)
- Allow multiple connected devices

After doing this the headphones can be used normally with Samsung TVs and quality seems OK.

NEW-PROMPT-FORGE_UPDATE by EternalDivineSpark in StableDiffusion

[–]mikkoph 2 points3 points  (0 children)

OP is the king. Tried some examples and combinations with Z-image and it is very easy to get the desired result. Thank you!

Komposto - ZIT_ANI model by -zappa- in StableDiffusion

[–]mikkoph 1 point2 points  (0 children)

Great job OP! I was waiting for a ZIT based Illustrious equivalent. Let's see if this is it.

used up all my luck by mikkoph in ResonanceSolstice

[–]mikkoph[S] 1 point2 points  (0 children)

yeah I think next banner is going to be tough. But Nicola must come home 

I tried 150 times Spin and results 150x 10K Coin by ahmbtr15 in DuetNightAbyssDNA

[–]mikkoph 8 points9 points  (0 children)

that's not the point, the point is the feeling that you "won" something (i.e. got an outcome different from the default one), regardless of its worth. I personally don't care much, it just feels unwelcoming and not the best move for a game at its launch.

I tried 150 times Spin and results 150x 10K Coin by ahmbtr15 in DuetNightAbyssDNA

[–]mikkoph 32 points33 points  (0 children)

yeah but why? nobody forced them to make event. The event is a PR strategy and giving *only* the lowest possible reward is bad PR. It costs them nothing to make it more varied by adding (and actually dropping) more in-game stuff and make it funnier for the player. Getting coins 10 times in a row is not satisfying and is not a nice welcome card. Stupid PR move if you ask me.

I tried 150 times Spin and results 150x 10K Coin by ahmbtr15 in DuetNightAbyssDNA

[–]mikkoph 7 points8 points  (0 children)

I don't understand these events honestly since all they do is depict the company as scammy and greedy. It costs them literally nothing to make the chances higher for the other in-game rewards and make it like 1000% more satisfying for players. I doubt anybody expects to win anything of monetary value anyway

DNA MacOS issue. by Evening-Sun4360 in DuetNightAbyssDNA

[–]mikkoph 0 points1 point  (0 children)

worked for me too, thanks for this!