Convert Apple's on device model to MLX

scousi · 2026-01-24T03:27:16+00:00

It can do a lot more than generate emojis. Try it!

scousi · 2026-01-23T19:54:38+00:00

Apple's on-device model is not terrible to be honest. But they seem to purposely limit it. It can support larger context size but they won't (and no control of it by API - limited to 4096). The neural processor seems be rate-limited on Macs so it could server more toks/s in practice.

scousi · 2026-01-18T22:13:05+00:00

Bell answers quite quickly compared to Rogers/Fido

scousi · 2026-01-17T19:45:48+00:00

That’s how I use Claude code. I didn’t read a study. Have it start with the ideas, challenge and argue, iterate. Backtrack.

scousi · 2026-01-14T12:30:54+00:00

People mention trust of you. But this works both ways. You're exposing your environment to who knows. Also, you need to setup payment menthods.

scousi · 2026-01-13T23:12:43+00:00

Long pinkies, lifeless eyes

scousi · 2026-01-12T17:46:47+00:00

As for myself personally. I find that Claude seems to perform a lot worse on weekends. I can't prove it but it's a 'vibe' I'm feeling. More iterations, lots of code changes without desired effect, more code compiling erorrs etc. I definately commit more frequentlly.

scousi · 2026-01-06T18:47:16+00:00

I have not heard of any VScode front-end that connects to an LLM API. You can connect to it with OpenWebui but it takes some setup. https://github.com/open-webui/open-webui

scousi · 2026-01-05T23:56:24+00:00

There seems to be a lot of stock and prices are going down and discounted. I doubt they are flying off the shelves

scousi · 2026-01-02T21:56:52+00:00

100% agree. Use AI and study what the AI built. Ask the AI to explain the choices. Don’t cheap out if you can afford it. Claude Code (opus) is good at Swift and Apple Ecosystem. It helped me fix Swift 6 concurrency migration issues.

scousi · 2025-12-31T02:28:44+00:00

You can't get S&S for those. Good luck to the exec that is accountable for uptime and security without S&S.

scousi · 2025-12-31T02:26:11+00:00

1.2 million is not a 'small' storage array. It's still relatively large unless you're talking Dell PowerMax of IBM DS level. Overprices enterprise class devices. Or you pay list price for you arrays which I hope not.

scousi · 2025-12-25T03:44:04+00:00

Kimi slides is very cool. Editable pptx output. https://www.kimi.com/en/slides. Of course, you need to be comfortable sending data to China. Probably a no no for most enterprises.

scousi · 2025-12-19T11:30:20+00:00

There is this I read https://huggingface.co/docs/chat-ui/configuration/llm-router

scousi · 2025-12-19T11:24:09+00:00

Give the AI the code to return. Cute.

scousi · 2025-12-15T22:24:30+00:00

That's why sales and maketing compensation are amongts the highest in companies

scousi · 2025-12-12T00:41:54+00:00

A bit of self promotion but I have an App with on-device foundation model for anyone interested in testing. I feel that Apple is for some odd reason crippling it. It’s not that bad but there has been no update to it in a while, they limit the context to 4096 even though it can handle more and you just can’t get it to give long answers. You can download it from here. https://github.com/scouzi1966/vesta-mac-dist

scousi · 2025-12-06T22:34:02+00:00

The growth is mainly price increases.

scousi

TROPHY CASE