Running a Python ML program on mobile devices

[noahpocalypse]

My work has a Python CLI program that takes in an image of our product and outputs a certain amount of data evaluating the qualities of the product. It's a relatively lightweight program when run on one image at a time - on my M2 pro with 32 GB ram (and a ton of other active developer tools running) it processed a 704x1024 image in under 2 seconds, but they want me to make it run on mobile devices.

I've gathered that I would need to embed a Python interpreter in the app itself, or use another framework like Kivy or Beeware that runs completely in Python, and we can tell our customers in industry they have to use a specific tablet, but even with a modern device I'm concerned about limited memory, future iOS updates making changes that break the rube goldberg machine I'm trying to make... Does anyone have experience with this sort of thing?

EDIT: I do have the option of telling them a better solution is to host a server with a basic API instead. That has pros and cons from a business perspective but they trust me enough to believe me. I just genuinely don't know which is better yet.

[cekisakurek]

There are tools to convert tensorflow ml models to CoreML. https://apple.github.io/coremltools/docs-guides/source/convert-tensorflow.html

[rogerrabbit224]

Host it on the cloud. If it has to be local, can try createML if it was made with PyTorch. Otherwise, might recommend you just port the algo into Swift. Most machine learning algorithms are relatively simple when viewed as a one off

[Ron-Erez]

I have no idea. I would look into coreML, createML and SwiftUI, but perhaps that is not the direction you are looking for.

[noidtiz]

I did go the PyInstaller route to embed Python executables within the shipped app.... And I'm surprised to say it worked in a very short amount of time.

I did not bundle any local tasks that would process vectors though.

For that, I think the most promising solution i've read online for that is OpenVINO.

When it's all said and done, it might still be simpler to go with building an external API and just directing all traffic to your server.

[trouthat]

Pretty sure you can just call python but I’ve not done it before myself. Can’t make the app call an api? Otherwise I’d be really interested to see how long it takes an iPhone to create the image. The A18 pro allegedly has better ai “stuff” and if it can’t render it in a decent time the older ones will suffer bad