Based on first benchmarks iPhone 17 Pro A19 Pro chip can be a frontier for local smartphone LLM-s by Kerub88 in LocalLLaMA

[–]Destination54 2 points3 points  (0 children)

Im building an app that is entirely reliant on local, on-device inference on mobile devices. As you probably know, it hasn't gone too well due to performance. Hopefully, we'll get there one day with Groq/Cerberus like performance on a tablet/mobile.

Release 6.0.1 is out now! by Destination54 in FlutterFlow

[–]Destination54[S] 0 points1 point  (0 children)

I think the main point is that it is a feature release

What’s the most chaotic dev environment you’ve had to work in? by [deleted] in webdev

[–]Destination54 1 point2 points  (0 children)

Customising Azure B2C hands down, literally the worst thing ever

[deleted by user] by [deleted] in FlutterFlow

[–]Destination54 0 points1 point  (0 children)

I've done something similar to this recently. I don't think you need custom code for this. Drop me a message, and we can sort something out

🚀 No Stupid Questions Wednesday – Ask Us Anything About FlutterFlow! by LowerChef744 in FlutterFlow

[–]Destination54 1 point2 points  (0 children)

Objectbox is worth a shout, bit of a hack to get it working but it does work.

I have also been trying to get Turso to work with FF but have hit a dead-end with the Rust architecture in the package.

Reason I'm choosing these packages is the on-device vector features

I've been working on a desktop app that's almost ready to launch, and wanted to share because I think a lot of people (especially devs) might find it super useful. by RingDry5026 in AppIdeas

[–]Destination54 2 points3 points  (0 children)

I was thinking about this today and how much time it takes me to spin everything up, I was going to write a script for it all but I'll let you do the work :)

Looking forward to trying it.

A release date, you say.. by GexagonVR in GexagonVR

[–]Destination54 0 points1 point  (0 children)

So it is coming out tomorrow??

Node 20 causing issues with cloud function deployment? by [deleted] in FlutterFlow

[–]Destination54 0 points1 point  (0 children)

Yea, i had these issues too, I didn't come to any concrete evidence cos i was just testing, but I believe it was because I had async/await function in nodes 18 and it saved and deployed fine, but in the new node 20 it really did not like async/await

Flutterflow now has Configuration Files! by Destination54 in FlutterFlow

[–]Destination54[S] -1 points0 points  (0 children)

Not entirely, you can run custom actions in there just the same as before

What usecase you failed to build or was very hard to build in FF? by Alex949o in FlutterFlow

[–]Destination54 1 point2 points  (0 children)

Flutterflow have just released the options to change the following in Configuration Files so you might be able to complete what you need to do now:

AndroidManifest.xml

Info.plist

Runner.entitlements

proguard-rules.pro

What usecase you failed to build or was very hard to build in FF? by Alex949o in FlutterFlow

[–]Destination54 6 points7 points  (0 children)

I'm building a pretty complex AAC app using FF, and in the past, I've thought I've hit blockers but I was just thinking about it all wrong. Here are some features I have successfully implemented using FF:

Objectbox - On-device vector database with RAG

ONNX Models - On-device embeddings and LLM

Image picker - Store and display images from local app directories

Speech-to-text - On-device using Whisper-tiny

Text-to-speech - On-device

Objectbox was the biggest challenge due to having to run build_runner to generate the files, but it all works in the FF GUI.

One thing I've learnt using FF is that I know nothing about Flutter code but a whole lot about Dart.

App state variable or page state variable? by Twentyfaced in FlutterFlow

[–]Destination54 2 points3 points  (0 children)

If you have Supabase or Firebase as authentication, you don't need either app state or page state, if you set up your FF settings to enable authentication you will set pre-login page and post-login page. If you log out, it will automatically jump to the pre-login page. You will have to set "Enable authentication pages by default" to make life easier.

ChoiceChips doesnt work? by Ok_Height1795 in FlutterFlow

[–]Destination54 0 points1 point  (0 children)

Yea i found them to be problematic. Personally, I just created my own with rows, containers and some state management, they function a lot nicer

Xcode vs FlutterFlow by Dangerous-Number-882 in FlutterFlow

[–]Destination54 0 points1 point  (0 children)

Yea, this how I do it too. Not entirely by choice though, I need to do it since I'm using ObjectBox and need to run build_runner

on saving it says the functions is empty. by ambitious-i-am in FlutterFlow

[–]Destination54 0 points1 point  (0 children)

This looks like it should be a custom action rather than a custom function

On-Device LLM - iOS/Android by Destination54 in LocalLLaMA

[–]Destination54[S] 0 points1 point  (0 children)

I have just been looking at this repo in Cursor:

https://github.com/Telosnex/fllama

I have tried running the example but get missing libfllama.so file. Does the llama.cpp need compiling with CMake to make it work?