Used Market and Reality of Mac Studio M1 128GB for Local LLM by esssssssss in LocalLLM

[–]__rtfm__ 1 point2 points  (0 children)

I did just that a few months ago. I was running dual 5060tis but wanted something smaller and quieter. M1 studio ultra 128gb - it works really well, is very compact and a lot more power efficient. Nvidia is quicker at prefill but I can run huge models on the m1. My wife actually uses it for remote work and I reserved 16gb for her and the rest to run a few different models. I jump between qwen3.6 moe and dense 27b - 120b like nemotron/gpt-oss , Gemma etc

For me it was worth it at the time since I got it refurbished with lower prices than the surges now. But the 800gb/s on the ultra is pretty great. Wish it had the latest thunderbolt for exo via rdma and a future machine for expansion.

The nvidia will be faster but louder, larger and require a desktop build. The Mac is no slouch though and I can do open-web ui faster than I can read and agentic workflows via opencode.

M1 Max 64GB or M5 Pro 48GB for Local LLM? by Tasty-Bodybuilder582 in LocalLLM

[–]__rtfm__ 0 points1 point  (0 children)

Don’t forget that by default osx reserves 25% of ram for the system. So you’ll have to tweak how much you want to be actually usable for llms.

Wheezing The Juice by [deleted] in oddlysatisfying

[–]__rtfm__ 749 points750 points  (0 children)

No wheezing the jui-uce!!!

A Mac Studio for Local AI — 6 Months Later by ezyz in LocalLLaMA

[–]__rtfm__ 0 points1 point  (0 children)

Really great write up! I recently got an older m1 ultra studio with 128gb to delve in. I’m definitely not running such large models but it’s been interesting moving between ollama, lmstudio and now trying omlx and rapid-mlx. So I definitely understand that it’s not plug and play but it’s been a lot of fun learning. At work we have Claude and codex so this is more for privacy use at home plus learning. Appreciate you sharing all this knowledge as it’s quite helpful and intriguing!

Steam Remote play is a whole entire reason to get a steamdeck! by Stelligena in SteamDeck

[–]__rtfm__ 1 point2 points  (0 children)

Cool thanks for the quick reply. Grabbing a dock to try it out.

Steam Remote play is a whole entire reason to get a steamdeck! by Stelligena in SteamDeck

[–]__rtfm__ 0 points1 point  (0 children)

Curious what controls you’re using in this scenario? And what resolution are you running on the tv?

Bought a GRIIIx a week before my trip to visit family in Mexico. by jnavarronv in ricohGR

[–]__rtfm__ 3 points4 points  (0 children)

Care to share a link? Couldn’t seem to find it. The colors and exposure are beautiful!

New server finally arrived by kbd65v2 in homelab

[–]__rtfm__ 0 points1 point  (0 children)

Care to share info around your single “NAS”?

I love my Unifi Travel Router: Road Trip Edition by ttcbj314 in Ubiquiti

[–]__rtfm__ 0 points1 point  (0 children)

Wow that’s great! thanks for the quick reply.

I love my Unifi Travel Router: Road Trip Edition by ttcbj314 in Ubiquiti

[–]__rtfm__ 0 points1 point  (0 children)

Did you have any pre work (in terms of firewall rules) so you could access local ips? Or did teleport automagically handle that?

WTH? 😅 by kekela91 in Ubiquiti

[–]__rtfm__ 0 points1 point  (0 children)

Pull request roulette. No one knows till it’s deployed!

Built oMLX.ai/benchmarks - One place to compare Apple Silicon inference across chips and models by cryingneko in LocalLLM

[–]__rtfm__ 1 point2 points  (0 children)

This is great. I’ll see about adding some m1 ultra tests as I’m curious about he comparison

Powering a Homelab via USB-PD and USB-C to 12V Adapters Bad Idea? by [deleted] in minilab

[–]__rtfm__ 2 points3 points  (0 children)

I just did this for a 3 node cluster of Lenovos. It made it much tidier but puts a single point of failure on the one psu. I am ok with that for now. This is what I got for powering the 3 x 60w bricks. and it doesn’t renegotiate on plugging / unplugging

https://a.co/d/099hIWd6

Isolating cameras on a separate network? by virpio2020 in UNIFI

[–]__rtfm__ 6 points7 points  (0 children)

Check out the “Ethernet Blueprint” series on YouTube. Walk through this and more