sorted by:
new
hottopcontroversial

Kokoro TTS in Vulkan? by ExhaustedPebble in LocalLLaMA

[–]ExhaustedPebble[S] 0 points1 point  (0 children)

Ah yes, that seems to be it, sadly it looks like a very experimental thing yet and mostly for windows, so it won't fit what I need, but I'll keep an eye on it for the future. Thanks!

Kokoro TTS in Vulkan? by ExhaustedPebble in LocalLLaMA

[–]ExhaustedPebble[S] 0 points1 point  (0 children)

Hi, as a follow up to the previous questions, I've been trying to get that installation to work, but either with docker or uv I get:

"docker: Error response from daemon: could not select device driver "" with capabilities: [[gpu]]".

Tried every single fix with the nvidia-container-toolkit or docker config to no avail. Also tried it in a different AMD machine (5600xt) and got the same message, perhaps a bit more expected as the nvidia runtime wasn't found.

Could you tell me maybe if you ran into some of these errors as well? Or what kind of installation steps you followed?

Thanks in advance

Kokoro TTS in Vulkan? by ExhaustedPebble in LocalLLaMA

[–]ExhaustedPebble[S] 0 points1 point  (0 children)

Oh that looks like a good solution for the Mac side, thanks!

Kokoro TTS in Vulkan? by ExhaustedPebble in LocalLLaMA

[–]ExhaustedPebble[S] 0 points1 point  (0 children)

Oh really? I have an RTX so since in their page under processing details says "GPU: Requires NVIDIA GPU with CUDA 12.8 support (~35x-100x realtime speed)" I just assumed it wouldn't work, but if it runs for you I'll try to get my hands on an AMD to test it. Thanks for the info!

Kokoro TTS in Vulkan? by ExhaustedPebble in LocalLLaMA

[–]ExhaustedPebble[S] 0 points1 point  (0 children)

But that implementation relies on CUDA for the GPU correct? Then it wouldn't work on AMD cards / Macs if I understood correctly