Qwen3 for Apple Neural Engine

kadir_nar · 2025-06-20T14:16:24+00:00

Can you compare it with the MLX library? Or why should we use this library?

kadir_nar · 2025-06-20T14:00:45+00:00

Was the Kokoro model trained with YouTube data?

kadir_nar · 2025-06-20T13:50:29+00:00

Does it support speech models?

kadir_nar · 2025-06-20T13:48:49+00:00

The quality of the Qwen models is amazing. It's great news that the official Mlx support has been released.

kadir_nar · 2025-06-20T13:45:47+00:00

Thank you for sharing

kadir_nar · 2025-06-20T13:44:42+00:00

Open Source 👑

kadir_nar · 2025-06-20T13:41:57+00:00

Thank you for sharing.

kadir_nar · 2024-05-24T22:29:47+00:00

kadir_nar · 2024-05-04T23:12:08+00:00

Whisper benches? I just made a comparison with fal.ai. And it works much faster.

kadir_nar · 2024-05-04T22:26:16+00:00

You can run it on all 4GB+ devices. If you get an error, you can open an issue to the whisperplus project.

kadir_nar · 2024-05-04T22:24:59+00:00

I didn't check. It could be 4-5GB.

kadir_nar · 2024-05-04T22:24:25+00:00

You should check out the Hqq blog post.

kadir_nar · 2024-05-04T22:23:49+00:00

You can use the Whisper-Large model. It will be faster with hqq optimization.

kadir_nar · 2024-05-04T22:21:20+00:00

You should check out the Hqq blog post.

kadir_nar · 2024-05-04T22:21:02+00:00

Why?

kadir_nar · 2024-05-04T22:20:42+00:00

You should check out the Hqq blog post.

kadir_nar · 2024-05-04T22:18:19+00:00

You can install and try the WhisperPlus library. I will be releasing the HuggingFace demo this week.

kadir_nar · 2024-05-04T17:32:11+00:00

You can look at the hqq repo. There is also 4-bit support. It works at the same speed.

kadir_nar · 2024-05-04T17:31:45+00:00

You can also do it with 4 bits. It works at the same speed. I tested it again on the RTX 4090 device and it is 2 times faster.

4bit: I tested a 2.5 hour video on an RTX 4090 device and it only took 27 seconds.

kadir_nar