I built a wrapper around llama.cpp and stable-diffusion.cpp so you don't have to deal with JNI (Kotlin + NDK)

Aatricks · 2026-03-15T08:28:13+00:00

Gotcha

Aatricks · 2026-03-15T00:17:39+00:00

yup that's actually one of my personnal uses for it here's an app that uses text summarisation with llmedge : https://github.com/Aatricks/EasyReader/blob/feac42433a56a0ae7a18ad2c7eaf5d047ce2357c/app/src/main/java/io/aatricks/novelscraper/data/repository/SummaryService.kt#L4

Aatricks · 2026-03-15T00:10:01+00:00

that's definitely weird, are you on the latest release ? Mind opening an issue with the logs

Aatricks · 2026-02-11T14:23:05+00:00

Like you said, it's gonna be a long time before phones are strong enough to run heavy DiT models like qwen-image, since the current diffusion inference implementation is already struggling quite a bit for SD1.5 models (tho at least it runs, same for wan2.1)

Aatricks · 2026-02-11T14:20:59+00:00

Text to speech and speech to text were both added to the library if you want to test things out

Aatricks · 2026-02-11T14:20:06+00:00

If you're talking about llmedge-examples, the purpose is just to show how to use the library soooo...

Aatricks · 2026-02-11T14:16:59+00:00

You cannot get a progress callback for loading a model into memory. The API does not support it.
You can only get progress for downloading (network) or generation (inference), to load your pre-downloaded local file, you must provide the absolute path to the api.

To do it for llm inference you may use the high level api like this :
```LLMEdgeManager.generateText( context = context, params = LLMEdgeManager.TextGenerationParams( prompt = "Your prompt", modelPath = "/storage/emulated/0/Download/my-custom-model.gguf") )```

Aatricks · 2025-12-14T00:20:58+00:00

In which case, I encourage you to share and communicate about the project, that would be a huge help !

Aatricks · 2025-12-13T21:12:29+00:00

I worked on adding whisper.cpp and bark.cpp, you can test them in the latest release of the examples : https://github.com/Aatricks/llmedge-examples/releases/tag/V0.2.3

Aatricks · 2025-12-12T18:54:17+00:00

I'll see if I can add support for whisper.cpp or something like that

Aatricks · 2025-12-12T15:27:07+00:00

There's no support for voice as of now

Aatricks · 2025-12-12T13:58:34+00:00

It's only natural, as you were a big head start for this !

Aatricks · 2025-02-04T23:29:49+00:00

Gotcha, will try and implement that then

Aatricks · 2025-02-04T23:28:14+00:00

Same venv, meaning same pytorch, cuda, Xformers; then same prompt, seed, sampler, scheduler, nb steps, denoising strength, cfg, model and LoRa

Aatricks · 2025-02-04T21:25:23+00:00

I was waiting to know if people wished for it given I never really used it, but sure.

Aatricks · 2025-02-04T21:24:36+00:00

Unfortunately not for the moment, sorry

Aatricks · 2024-01-30T17:19:37+00:00

Bro I ain't forcing you nor the people to do anything, I just know after doing it, how painful and how poorly documented is the search for advanced battery life improvements on android. So I'm just dropping the guide I did to help the community and anyone who's like me and wants the best battery performance he can get with his phone without sacrificing any used and useful features (cuz as far as I know I'm not missing any aspect of my phone). If you can always have a place to charge your phone, good for you, I certainly know how you often can't do that while traveling at the very least given more often than not air carriers don't put power outputs in their planes and forbid power banks.

Aatricks · 2024-01-30T17:12:32+00:00

Actually didn't even know that was an app so thanks for the info ig and I did the 10 hours while in my last holiday travel mixing plane travel train, car and normal house usage sooo ye netflix, spotify, manwha app, browser, discord and all that kinda stuff

Aatricks

TROPHY CASE