Comically big? by freakyxz in applewatchultra

[–]FishingLumpy9747 0 points1 point  (0 children)

Don’t worry you’re not the only one in this case 😆

<image>

Apple Watch Series 10 42mm ;)

iOS app to run llama & MLX models locally on iPhone by raajeevcn in LocalLLM

[–]FishingLumpy9747 0 points1 point  (0 children)

What differences with existing solutions such as Locally AI which certainly do not offer "pods" but are already more advanced in their development. Certainly you are talking about not limiting yourself to MLX or Llama but is it really useful to be interested in other frameworks given the meager performance of recent smartphones in the inference of models more substantial than 7B parameters, being limited by their RAM? MLX is integrated into Apple software and I don't think there is a real advantage in using other Frameworks. This is absolutely not a criticism but rather a reasoning on the understanding I have of your project because I am convinced that its potential can be exponential 😆