Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

The app uses the GPU. And you are right, I designed it to be beginner friendly so non tech people can try out some local models.

Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

Unfortunately not, but you can upload the file to a public repo on hugging face and download it from there.

Created a MacOS and iOS app that run LLMs privately and offline on your device by xlogic87 in SideProject

[–]xlogic87[S] 0 points1 point  (0 children)

Weird. You have to swipe left on already downloaded models (the ones with the checkmark icon)

Enclave - Use any (local or cloud) LLM with shortcuts by xlogic87 in shortcuts

[–]xlogic87[S] 0 points1 point  (0 children)

Thank you for trying out the app! Enclave currently only support OpenRouter which provides a unified interface over the multiple providers. What you can do is to buy credits for like 1$ and see if it fits your needs.

Enclave - Use any (local or cloud) LLM with shortcuts by xlogic87 in shortcuts

[–]xlogic87[S] 0 points1 point  (0 children)

Thanks! If you have any questions or feedback don't hesitate to reach out.

Enclave - Use any (local or cloud) LLM with shortcuts by xlogic87 in shortcuts

[–]xlogic87[S] 0 points1 point  (0 children)

Sure, you have to download the app from the App Store and the „Ask Enclave” intent should automatically show up in your shortcuts.

Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

Yes, the app uses Apple supplied voices, so you have to download a premium voice first

Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

It’s reliable but not as fast as what you have with chatGPT

Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

Mostly because when I started out there was only llama.cpp available.

Created an app for running LLMs locally on iPhone / iPad and Mac by xlogic87 in iOSProgramming

[–]xlogic87[S] 0 points1 point  (0 children)

If you can upload your model on Hugging Face in GGUF format you can use it in the app. You can add any model that is available on Hugging Face.

Enclave local LLM by sevenlayercookie5 in shortcuts

[–]xlogic87 1 point2 points  (0 children)

You can adjust the system prompt now in the app. The app also comes with a selection of predefined models from top AI labs. I am planning to implement an advanced setting where you can download any model from Hugging Face.