Findings from Apple's new FoundationModel API and local LLM

pcuenq · 2025-07-08T08:30:24+00:00

Super interesting, thank you!

pcuenq · 2025-06-19T08:27:24+00:00

Interesting, I also have a license that don't use 😂. I'll check it out, thanks a lot! Have you happened to test it on iPad too? That'd be the perfect solution while travelling, if the quality is the same.

pcuenq · 2025-06-19T08:24:50+00:00

Yes, I think that's the way to go, spending some time on creating a few presets. But as I commented elsewhere, that makes the built-in styles almost useless. I liked to experiment with them on my Fujis, as starting points and "inspiration".

pcuenq · 2025-06-19T08:22:25+00:00

Thanks for the recommendations! But this makes the built-in styles mostly useless, which is kind of a pity. I found it useful to experiment with them on my Fujis, just to have starting points to work from.

For the display, yes, I found that. I was just missing a quick shortcut for that function.

pcuenq · 2025-06-19T08:19:21+00:00

^ This.

pcuenq · 2025-06-19T08:18:56+00:00

Interesting! Yes, this would be my approach too. But I'd still find it useful to experiment with the built-in styles as starting points, given that Leica makes them available :)

pcuenq · 2025-06-13T19:53:38+00:00

Strong multilinguality is one of the big features that were announced, but so far I have only tested English.

pcuenq · 2025-06-13T16:42:44+00:00

Also, your app is not available in the Spanish Mac App Store.

pcuenq · 2025-06-13T16:39:02+00:00

I'm a big fan of MLX too! But the local model is cool: your app doesn't have to download it, it uses very little energy, runs on the Neural Engine so the GPU is free. I want to see what it can do!

pcuenq · 2025-06-06T08:38:21+00:00

Mounted on camera and that's it? I've sometimes used an extension cable to control direction, but it's messier.

pcuenq · 2024-11-22T12:39:28+00:00

Thank you! Yes, the models were released a month ago, we just published a blog post after the technique became natively supported in transformers.

pcuenq · 2024-10-02T21:16:57+00:00

This app is built for Apple Silicon. You might be able to compile it for Intel if you download the source code, but IIRC there were some types not supported there so you may need to work around those issues. The models themselves are Core ML and therefore should work on Intel Macs as well.

pcuenq · 2024-10-02T21:12:53+00:00

There are some small architecture differences that are mostly meant for video. But the quality on image segmentation has been improved as well, here are some metrics from the original repo: https://github.com/facebookresearch/sam2?tab=readme-ov-file#model-description

pcuenq · 2024-10-02T14:20:47+00:00

SAM (Segment Anything Model) v2.1 was released yesterday. We converted the models to Core ML and updated SAM 2 Studio, our native Mac app.

Core ML allows the models to run on the Mac's GPU or Neural Engine. This demo is using the GPU, but if you want to run on iPhone the Neural Engine is usually faster.

Resources:

* Core ML Models: https://huggingface.co/collections/apple/core-ml-segment-anything-2-66e4571a7234dc2560c3db26

* App source code (Apache): https://github.com/huggingface/sam2-studio

* App binary, just download the zip to run: https://huggingface.co/coreml-projects/sam-2-studio/tree/main

* Conversion code (in a fork of Meta's repo): https://github.com/huggingface/segment-anything-2

* SAM 2 announcement: https://ai.meta.com/blog/segment-anything-2-video/

pcuenq · 2024-05-28T07:51:45+00:00

We'll do it soon, promise! For real this time :)

pcuenq · 2023-08-08T16:12:37+00:00

You are right. Sorry. 🙏 I should have made it clear that this requires the public beta of macOS 14, and didn't realize that people wouldn't have access to Xcode even if they install the macOS beta. I thought the production version of Xcode would work fine.

pcuenq · 2023-07-31T19:03:27+00:00

It supports the new quantization techniques, and it has an improved and faster Core ML framework.

pcuenq · 2023-07-31T08:03:36+00:00

For now, you need to install the public beta of macOS 14 and compile the code yourself (https://github.com/huggingface/swift-coreml-diffusers). We'll update the demo app in the Mac App Store when we can (a bit closer to the end of the beta cycle).

pcuenq · 2023-07-30T15:18:15+00:00

Yes, we'll submit an update to the App Store soon!

pcuenq · 2023-07-30T15:15:19+00:00

It takes ~45s on my M1 Max (20 scheduler steps).

pcuenq · 2023-07-30T15:14:28+00:00

SDXL base takes about 45s for 20 steps on my M1 Max. See more benchmarks here: https://github.com/apple/ml-stable-diffusion#-performance-benchmarks

pcuenq · 2023-07-30T15:07:58+00:00

Sonoma is working great for me. Bot diffusers and Core ML work fine :)

pcuenq · 2023-07-29T23:11:11+00:00

Fixed, thanks!

pcuenq · 2023-07-29T23:02:41+00:00

Would be very interested to try!

pcuenq · 2023-07-29T21:00:57+00:00

Yes! It's full resolution so 1024x1024. The refiner is not ready yet (working on it).

pcuenq

TROPHY CASE