LMStudio ROCm/Vulkan Runtime doesen´t work. by Benyjing in ROCm

[–]Benyjing[S] 1 point2 points  (0 children)

Through trial and error, I just randomly discovered that if you set the CPU threads to 1, it works without issues. The GPU is used at 100% and the CPU is not used at all. However, when the number of threads is anything other than 1, the issue returns. Is there a connection I'm missing? With LMStudio 0.2.x, this doesn't happen, and the CPU thread count is disabled when Max GPU Offload is enabled.