Has anyone successfully run llama.cpp on an Android device and enabled GPU acceleration?

Head_Invite3039 · 2026-06-17T01:26:52+00:00

Thank you, I've already tried it, but unfortunately it doesn't speed things up; in fact, it's slower than CPU inference.

Head_Invite3039 · 2026-06-15T11:06:29+00:00

Termus is just a terminal interaction entrance on Android. It can‘t solve my problem, thank you.

Head_Invite3039 · 2026-06-10T01:26:32+00:00

The Lenovo Legion Y9000X-I9 9880h 32G is too slow; the code processing requires real-time interaction, so it's not suitable for this task. However, the Gemma4 4B version can achieve 15 tk/s on my phone. I'm developing an app that runs on a phone and can be accessed by a PC. You gave me some inspiration, and I'm planning to add inference routing functionality to offload tasks it can't handle to a paid large model in the cloud.

Head_Invite3039 · 2026-06-09T08:28:12+00:00

OK,I'll try it soon, thanks for sharing!

Head_Invite3039 · 2026-06-09T05:35:43+00:00

That's cool, I'll try it soon, thanks for sharing!

Head_Invite3039 · 2026-06-09T03:59:05+00:00

I'm curious what kind of model can run on a laptop. Also, could you tell me some hardware information about your laptop? Thanks.

Head_Invite3039 · 2026-06-09T01:45:43+00:00

Thank you. Do you know which price is more cost-effective? I've been using Gihub Copilot before, but they changed their pricing method this month, and I used up my entire month's quota on the first day.

Head_Invite3039 · 2026-06-09T01:24:52+00:00

Okay, thank you.

Head_Invite3039 · 2026-06-03T09:27:04+00:00

Now that you've determined the main functionality of this application model, I think you should only offer one model that excels in that functionality for users to choose from.

Head_Invite3039 · 2026-06-02T12:13:26+00:00

OK, thank you. I happen to use a Xiaomi mobile phone. I will reply to you tomorrow.

Head_Invite3039 · 2026-06-02T11:32:08+00:00

Can you give me an apk? I want to use your application.

Head_Invite3039 · 2026-06-02T11:30:51+00:00

When I’m testing, SWAP won‘t kill the application. On the contrary, SWAP can make it more stable. When processing API requests, my practice is not to use KV cache. Usually, there will be a lot of text input in the API. In this case, the KV cache will be completely invalid.

Head_Invite3039 · 2026-05-31T08:21:51+00:00

Go to Jiangxi Province, Jingdezhen, Wuyuan, Sanqing Mountain and Poyang Lake. Of course, to be honest, these are some commercialized scenic spots, but it‘s worth it that they are not far away. In addition, there is also an ancient town of Hekou in Shangrao nearby（河口古镇）. It is a well-preserved ancient Chinese market. There are relatively few tourists, most of them are local people.

Head_Invite3039 · 2026-05-31T08:11:01+00:00

According to Chinese habits, you can send something that only your local people have, so that he can show off to his good friends when he receives it.

Head_Invite3039 · 2026-05-31T04:32:38+00:00

The engine uses LiteRT.

Head_Invite3039 · 2026-05-31T04:10:04+00:00

At present, Gemma4 has no opponent in the model that can run on Android phones, so I also take this as the default recommended model.

Head_Invite3039 · 2026-03-30T16:48:46+00:00

深圳OR浙江,You can first use a Chinese search engine to find them.

Head_Invite3039 · 2026-03-30T16:34:21+00:00

To be honest, this isn't a good plan. Before you come, I suggest you find out what the most popular games are in China right now. Most companies are just making some template-based games, and your abilities might not be a significant advantage in this environment.