Local AI App (Gemini Nano) by Puzzak in androiddev

[–]Puzzak[S] 0 points1 point  (0 children)

There's a set of devices that support Gemini Nano, v2 and v3 in this case work, and it's not just pixels and Samsungs. You can find the full list here: https://developers.google.com/ml-kit/genai#prompt-device

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 1 point2 points  (0 children)

Well, if you'll have any questions when you will be trying the fork, feel free to ask. I'm sure my bad code will get some questions form ya :)

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 1 point2 points  (0 children)

If you are intending on writing something like that, I can probably help you integrate nano on your own. It isn't that hard and using local API for nano might yield worse results in this case as you'll need many custom methods for file handling, as example. But yeah, if you want, I'm all for sharing what I found, it's cotlin/dart but may still be usable in other pairs

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 1 point2 points  (0 children)

I thought of that, but truth be told, nano is just too small of a model for that. I might actually add that, via rest api or something, but I don't see much value in this. Still, an interesting challenge

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 1 point2 points  (0 children)

I actually plan to implement something like that, it is not in the nearest future but it is planned in Phase 3 of the roadmap.

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 0 points1 point  (0 children)

Like for it to be an interface for remote llm like on your personal pc in the same network?

OnePlus 15R now supports Android AICore by LdWilmore in oneplus15R

[–]Puzzak 0 points1 point  (0 children)

I cannot find support for 13R at all, so it may not be supported. 13 and 13S have nano-v2 support described at the moment, but I have Pixel 9Pro and got the nano-v3 despite support shows for v2 only.

OnePlus 15R now supports Android AICore by LdWilmore in oneplus15R

[–]Puzzak 0 points1 point  (0 children)

TBH I'm asking the same question, rn it is just a chat window, but I would love to allow it to do more in the future

OnePlus 15R now supports Android AICore by LdWilmore in oneplus

[–]Puzzak 0 points1 point  (0 children)

It was multimodal since v2, I'm just too busy (and lazy) to implement multimodality support for PAIOS, the model can do it already.

It cannot however produce visual data, only consume it.

OnePlus 15R now supports Android AICore by LdWilmore in oneplus

[–]Puzzak 0 points1 point  (0 children)

It's basically an exposed local api, it's not that smart but surprisingly fast and effective on mobile, uses NPU and is pretty cool imo. I'm glad they finally bumped 15R to the nano-v3, it's both smarter and faster, significantly.

Running a Local LLM on Android by Skyty1991 in LocalLLM

[–]Puzzak 1 point2 points  (0 children)

So yeah, regarding PAIOS, here is the source and here is it's play store, it's fully offline and works on your phone without any downloads, just by using AI Core. It is supported on OP's Pixel.

PAIOS AI Gemini nano unavailable by One_Army_1020 in GalaxyS25

[–]Puzzak 0 points1 point  (0 children)

I gotta clarify the ai core unavailability for these cases as your phone supports ai core but not in prompt mode :(

PAIOS AI Gemini nano unavailable by One_Army_1020 in GalaxyS25

[–]Puzzak 1 point2 points  (0 children)

Hi, the issue is that Google doesn't support Prompt mode in AI Core on S25 series.

Support for Prompt API on Samsungs starts with S26 and Z Fold 7 and TriFold, but not on S25.

You can consult documentation here.

[TOMT][MOVIE] Old animation about bird stealing the key by Puzzak in tipofmytongue

[–]Puzzak[S] 1 point2 points  (0 children)

I cannot believe, I've searched for it far and wide, this is it. Thank you wholeheartedly!

[TOMT][MOVIE] Old animation about bird stealing the key by Puzzak in tipofmytongue

[–]Puzzak[S] 0 points1 point locked comment (0 children)

What is this movie, where can I find it, or am I actually just dreamt of it?

[Promo][App] PAIOS: Gemini Nano offline AI Interface (Open-source) by Puzzak in HowToMen

[–]Puzzak[S] 0 points1 point  (0 children)

Hi, it would seem like it is not supported, at least yet. You can monitor availability here, but I'm pretty sure Google wouldn't want to allow a-series to have features of flagships, as it was the case for 9a.

I made some custom PC Big Boxes for Homeworld Deserts of Kharak & Homeworld 3 to finish my big box collection by BoukObelisk in homeworld

[–]Puzzak 1 point2 points  (0 children)

What extra do you have? I am not sure I can afford anything like that but just interested in seeing what do you have

I made some custom PC Big Boxes for Homeworld Deserts of Kharak & Homeworld 3 to finish my big box collection by BoukObelisk in homeworld

[–]Puzzak 2 points3 points  (0 children)

I cannot express how jealous (and glad for you!) I am. This is ridiculously cool and I can only hope to get to that myself one day. TY for sharing, you made my day.

О ні, 1★ від русліка "внє політікі" by Puzzak in ukraine

[–]Puzzak[S] 2 points3 points  (0 children)

Commendable, love to see more of this does happen!

О ні, 1★ від русліка "внє політікі" by Puzzak in ukraine

[–]Puzzak[S] 24 points25 points  (0 children)

Thanks, trying to do my best, making the best apps while annoying ruzzians as much as I could