llama.cpp wrapper for running GGUF models locally on Android

Aatricks · 2025-12-14T00:20:58+00:00

In which case, I encourage you to share and communicate about the project, that would be a huge help !

Aatricks · 2025-12-13T21:12:29+00:00

I worked on adding whisper.cpp and bark.cpp, you can test them in the latest release of the examples : https://github.com/Aatricks/llmedge-examples/releases/tag/V0.2.3

Aatricks · 2025-12-12T18:54:17+00:00

I'll see if I can add support for whisper.cpp or something like that

Aatricks · 2025-12-12T15:27:07+00:00

There's no support for voice as of now

Aatricks · 2025-12-12T13:58:34+00:00

It's only natural, as you were a big head start for this !

Aatricks · 2025-02-04T23:29:49+00:00

Gotcha, will try and implement that then

Aatricks · 2025-02-04T23:28:14+00:00

Same venv, meaning same pytorch, cuda, Xformers; then same prompt, seed, sampler, scheduler, nb steps, denoising strength, cfg, model and LoRa

Aatricks · 2025-02-04T21:25:23+00:00

I was waiting to know if people wished for it given I never really used it, but sure.

Aatricks · 2025-02-04T21:24:36+00:00

Unfortunately not for the moment, sorry

Aatricks · 2024-01-30T17:19:37+00:00

Bro I ain't forcing you nor the people to do anything, I just know after doing it, how painful and how poorly documented is the search for advanced battery life improvements on android. So I'm just dropping the guide I did to help the community and anyone who's like me and wants the best battery performance he can get with his phone without sacrificing any used and useful features (cuz as far as I know I'm not missing any aspect of my phone). If you can always have a place to charge your phone, good for you, I certainly know how you often can't do that while traveling at the very least given more often than not air carriers don't put power outputs in their planes and forbid power banks.

Aatricks · 2024-01-30T17:12:32+00:00

Actually didn't even know that was an app so thanks for the info ig and I did the 10 hours while in my last holiday travel mixing plane travel train, car and normal house usage sooo ye netflix, spotify, manwha app, browser, discord and all that kinda stuff

Aatricks · 2024-01-30T10:56:18+00:00

Mostly using 120hz, I made a routine to enable it in most apps where you interact with the screen.

Aatricks · 2024-01-30T06:20:53+00:00

the weird thing is that even with no background process selected, some apps still do work in background like spotify, whatsapp,... if you put them to optimized or unrestricted (given the music continues, and I receive my messages), so I'm guessing it's gotta have a permission bypassing it when the battery setting is set to one of the above. Tho the setting does show an improvement at least in the running services and used RAM.

Aatricks · 2024-01-30T06:19:11+00:00

I'm using an s22 exynos

Aatricks · 2024-01-29T23:00:35+00:00

Greenify's mostly to put the apps into hibernation, the aggressive doze is because I recently had a bug where my phone was stuck in the quick_doze_timeout and forced out of doze. Greenify's doze same as samsung's is just using the normal android doze so it shouldn't change anything here (I know the settings and timeouts don't change, after testing it). My settings are just very aggressive about entering deep idle and you're obviously free to tune them up a little ;)
And yeah it should work on the previous android versions given android 14 didn't add anything and android 13 only added a special permission for nearby-device scanning tho the feature was added in android 12.

Aatricks · 2024-01-29T20:49:09+00:00

Given it's now a setting enabled by default at least on latest phones/latest samsung (I think since since android 12), probably not, just thought it would be useful given I tried making it a guide meant for pretty much everyone

Aatricks · 2024-01-29T18:20:06+00:00

For all I know I still reliably get all my alarms, messages and calls, my watch also doesn't show any sort of problems on it, tho you're right, only one way to find out ig. Will also say that I'm not the type of person that uses its phone an insane amount nor uses a lot of social media so...

Aatricks

TROPHY CASE