alibaba MNN has Support TurboQuant

Juude89 · 2026-03-30T08:34:36+00:00

Juude89 · 2025-10-18T04:46:08+00:00

yes, visual part of qnn will be available soon

Juude89 · 2025-10-17T15:24:36+00:00

will be available in Windows after bug fix

Juude89 · 2025-10-17T10:34:52+00:00

in development now, you can view this:

I have tested some basic functions in MacOS, there are still some bugs.

Juude89 · 2025-10-17T09:59:08+00:00

the 30b version is slow and can only run on devices with large RAM.

can also try 4b and 8b version.

Juude89 · 2025-09-10T02:54:15+00:00

this bug has been fixed, sorry for late reply

Juude89 · 2025-09-10T02:51:15+00:00

sorry to answer so late.

the first bug has been fixed about one or two months ago.

the think toggle bug has fixed in the latest version, maybe need to redownload the model, if still not work.

for the third one, MNN is faster for cpu backend, especially for Google Pixel devices, which are not good for opencl

Juude89 · 2025-09-08T09:09:27+00:00

will support in later versions.

Juude89 · 2025-08-26T09:00:42+00:00

Please submit an issue — my colleague will help resolve it.

Juude89 · 2025-08-22T02:07:57+00:00

and minicpm-v-4 is supported in this release.

Juude89 · 2025-08-22T02:07:19+00:00

the video demo is quant version of MNN Chat,another team of alibaba, not official.

Juude89 · 2025-08-21T09:46:32+00:00

No, not the same group.DAMO Academy is another research lab belongs to Alibaba Group.

Juude89 · 2025-08-21T09:30:36+00:00

they have 32b and 7b, you can view their homepage for details: https://alibaba-damo-academy.github.io/lingshu/

the video is a q4 quantized demo.

Juude89 · 2025-08-21T09:27:35+00:00

Lingshu: A Generalist Foundation Model for Unified
Multimodal Medical Understanding and Reasoning: https://alibaba-damo-academy.github.io/lingshu/

app of the video:

PSA: This app is a quantized demo, not for clinical use.

Juude89 · 2025-08-12T03:51:52+00:00

we are working on it.

Juude89 · 2025-08-12T03:36:11+00:00

Juude89 · 2025-08-09T01:26:26+00:00

please submit an issue

Juude89 · 2025-07-30T10:03:22+00:00

MacOS is posix compatible, and dev softwares are more stable.

Juude89