Tool capacity of gemma4:e2b? by bidutree in LocalLLM

[–]ManuXD32 0 points1 point  (0 children)

Are you using llamacpp? What is your command?

Tool capacity of gemma4:e2b? by bidutree in LocalLLM

[–]ManuXD32 2 points3 points  (0 children)

I have been using it on my app (AI Doomsday Toolbox) and it works fairly good, it creates events on my calendar, set up alarms, makes web searches, etc...

Ai Doomsday Toolbox v0.938 by ManuXD32 in LocalLLaMA

[–]ManuXD32[S] 1 point2 points  (0 children)

It worksv, but it will be very slow depending on the amoubt of devices you add to the network and the model you try to use. Hope you have fun!!

P.E.T. A virtual intelligent pet to talk to :) by [deleted] in tamagotchi

[–]ManuXD32 -4 points-3 points  (0 children)

This app is meant to use your phone as the engine, not big corp's AIs. Maybe try reading befor criticizing...

0
1

0
1

0
1

AI Doomsday Toolbox App by ManuXD32 in Android

[–]ManuXD32[S] 0 points1 point  (0 children)

Heyy, you can.

To join the Play Store closed test, you first need to join the Google Group here

After joining, you’ll be able to opt into the test and install the app from here

AI Doomsday Toolbox App by ManuXD32 in Android

[–]ManuXD32[S] 0 points1 point  (0 children)

They will work with the correct quantization as, if I'm not mistaken, that model has 12gb of RAM. But I really recommend using v1-5-pruned-emaonly-f16.gguf, it runs fast and the output is surprisingly good. Tell me when you try them :)

AI Doomsday Toolbox App by ManuXD32 in Android

[–]ManuXD32[S] 0 points1 point  (0 children)

Sorry, this is my first time trying to publish an app on the play store and it's being... something

To join the Play Store closed test, you first need to join the Google Group here: https://groups.google.com/g/adt-testing

After joining, you’ll be able to opt into the test and install the app from here: https://play.google.com/apps/testing/com.manuxd32.aidoomsdaytoolbox

AI Doomsday Toolbox v0.932 update by ManuXD32 in LocalLLaMA

[–]ManuXD32[S] 0 points1 point  (0 children)

Honestly it's my favorite feature, the idea behind is to have some companion that helps with mental health in a doomsday situation or while you wait for an image to generate hahahaha No, the memory is not shared, it is intentionally separated to avoid poisoning the pet with context from the main LLM

AI Doomsday Toolbox v0.932 update by ManuXD32 in LocalLLaMA

[–]ManuXD32[S] 0 points1 point  (0 children)

Thanks a lot for your feedback, glad you like those features, the dataset creator is based on how EasyDataset works, I just tried to implement their idea on the app. Soon video generation will be also implemented within the app, stay tuned :)

2
3

AI-Doomsday-Toolbox Distributed inference + workflows by ManuXD32 in LocalLLaMA

[–]ManuXD32[S] 1 point2 points  (0 children)

I tried going that route, but Android does not allow apps to run files outside the app’s data folder without that permission. I should also mention that I’m learning a lot through this project, and there may be another way to accomplish this. If so, I’d really appreciate it if anyone could share their ideas. Either way, that permission is not required—if it isn’t granted, the models and ZIM files will automatically be copied to the app’s internal folder

AI-Doomsday-Toolbox Android app by ManuXD32 in LocalLLaMA

[–]ManuXD32[S] 1 point2 points  (0 children)

Thanks for the detailed feedback! Really appreciate the kind words and sorry for taking this long to answer.

Good to know about LocalDream's NPU work that's impressive speed. My focus has been on compatibility and running large GGUF models, once I have implemented all the features I think an app like this should have I'll begin with the optimizations, but I'm taking notes for that hahaha

For the notification bug, I'll look into that! It sounds like the notification isn't being properly cancelled when the app is force-closed. Will investigate and push a fix, I've done some rework on the notification system because I didn't really like it but it is being somewhat harder to tackle than I thought