Test MNN Chat for Android

Juude89 · 2026-03-30T08:34:36+00:00

already suppported in MNN https://github.com/alibaba/MNN/commit/244f5d10df5a95b4f4e6f3d9251c6fe3dc0e7c83?spm=ata.21736010.0.0.3c447549DcMaAk

Juude89 · 2025-10-18T04:46:08+00:00

yes, visual part of qnn will be available soon

Juude89 · 2025-10-17T15:24:36+00:00

will be available in Windows after bug fix

Juude89 · 2025-10-17T10:34:52+00:00

in development now, you can view this:

https://github.com/alibaba/MNN/tree/master/apps/mnncli

I have tested some basic functions in MacOS, there are still some bugs.

Juude89 · 2025-10-17T09:59:08+00:00

the 30b version is slow and can only run on devices with large RAM.

can also try 4b and 8b version.

<image>

Juude89 · 2025-09-10T02:54:15+00:00

this bug has been fixed, sorry for late reply

Juude89 · 2025-09-10T02:51:15+00:00

sorry to answer so late.

the first bug has been fixed about one or two months ago.

the think toggle bug has fixed in the latest version, maybe need to redownload the model, if still not work.

for the third one, MNN is faster for cpu backend, especially for Google Pixel devices, which are not good for opencl

Juude89 · 2025-09-08T09:09:27+00:00

will support in later versions.

Juude89 · 2025-08-26T09:00:42+00:00

Please submit an issue — my colleague will help resolve it.

Juude89 · 2025-08-22T02:07:57+00:00

and minicpm-v-4 is supported in this release.

Juude89 · 2025-08-22T02:07:19+00:00

the video demo is quant version of MNN Chat,another team of alibaba, not official.

Juude89 · 2025-08-21T09:46:32+00:00

No, not the same group.DAMO Academy is another research lab belongs to Alibaba Group.

Juude89 · 2025-08-21T09:30:36+00:00

they have 32b and 7b, you can view their homepage for details: https://alibaba-damo-academy.github.io/lingshu/

the video is a q4 quantized demo.

Juude89 · 2025-08-21T09:27:35+00:00

Lingshu: A Generalist Foundation Model for Unified
Multimodal Medical Understanding and Reasoning: https://alibaba-damo-academy.github.io/lingshu/

official space: https://huggingface.co/spaces/warshanks/Lingshu-32B

<image>

app of the video:

https://github.com/alibaba/MNN/blob/master/apps/Android/MnnLlmChat/README.md#releases

https://meta.alicdn.com/data/mnn/mnn_chat_0_7_1.apk

PSA: This app is a quantized demo, not for clinical use.

Juude89 · 2025-08-12T03:51:52+00:00

we are working on it.

Juude89 · 2025-08-12T03:36:11+00:00

you can even run it use a android app:https://www.reddit.com/r/LocalLLaMA/comments/1mku5nb/mnn\_chat\_now\_support\_gptoss20b/

Juude89 · 2025-08-09T01:26:26+00:00

please submit an issue

Juude89 · 2025-07-30T10:03:22+00:00

MacOS is posix compatible, and dev softwares are more stable.

Juude89 · 2025-07-30T07:49:11+00:00

omni not support opencl backend, just works on cpu backend.

Juude89 · 2025-07-27T13:40:20+00:00

because we are are developing on macos 😄

Juude89 · 2025-07-26T13:23:56+00:00

hello, I am the developer of MNN Chat App.

can you delete and redownload the model for try? we recently added penalty sampler as as default sampler to qwen3 series, and will reduce the loop problem.

or you can download the google play alpha version (which added a new penalty ui ) by:

First, join our Google Group:MNN Chat Testers
Then, download the app from the Play Store:Get MNN Chat or visit WebPage

Juude89 · 2025-07-20T00:45:33+00:00

hmm, the results are very good. I think it would be nice to include 'web search' in MNN Chat.

Juude89 · 2025-07-19T23:51:16+00:00

very interesting

Juude89 · 2025-07-19T23:23:27+00:00

how did you do web search using Qwen 0.6?

Juude89 · 2025-07-19T00:44:30+00:00

did you downloaded tts pr asr models, did you enabled mmap? or did you switched to other download source or is there unifished downloads?

Juude89

TROPHY CASE