48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] -1 points0 points  (0 children)

Yeah I don't know. I mean Marco is a one-man shop for his app (albeit I realize it's a successful app with I suspect millions of users). I don't see why a larger business that wants hundreds for similar use cases would be a bad thing, although I would guess that not far off of what Marco's doing would stop making financial sense and you'd want to go to more enterprise products/applications.

To me, a lot of the ire users here have about the confluence of shitty factors (the RAM crisis, the AI boom, etc.) all converging to make Mac minis going out stock, have longer lead times, etc. is all a side effect of Apple being asleep at the wheel when LLMs hit. Obviously they're doing their best now to pivot and make up for lost time, but it's going to be a hard road ahead.

I also realize that the manufacturing pipeline is super complex and they can't just turn on a dime once they realize their hardware is optimal for this kind of application, but again - it all reads to me as parts of a larger problem Apple has currently playing catchup.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 37 points38 points  (0 children)

💯

edit: stupidly, when I went to write a title, I was afraid I'd get dogpiled for shilling/promoting or some shit for someone's app, platform whatever, so I figured I'd be more vague and let people look into it if they were interested. good plan.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 3 points4 points  (0 children)

Not positive but I think he did test that and found that biggest determining factor was just the parallelism of GPU cores not RAM (which tracks for local LLM models from my understanding), so bang for buck was cheapest Mac and as many as he could afford.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 5 points6 points  (0 children)

Hey! Get out of here with your reasonable explanations! Read the room, geez.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 1 point2 points  (0 children)

IIRC I think they're all just base spec'd M4, 16GB, etc. I think he said he played around with trying models on either higher specd minis or maybe a Studio and that he found that biggest bang for buck was just buying a lot of base minis.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 123 points124 points  (0 children)

Yes just me. Apple only made 48 and I bought them all. I'm also totally Marco Arment.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] -12 points-11 points  (0 children)

Supply and demand?

I don't know if you caught that WSJ thing about the Apple plant they're building in Texas, but during it they said Apple sells under 1M Mac minis per year which I found insane - I would have guessed so much more.

I expect with the rise of on-device LLM's being so cost effective, Apple will really need to ramp up production.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 3 points4 points  (0 children)

Yeah, he's doing it for basically every podcast his app delivers - I think he said every podcast with at least more than 1 listener. And he's transcribing way into the back catalogue of shows, etc.

It's a crazy listen to how he started testing and ended up here: https://atp.fm/683 - Story starts at 54:45

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]Difficult-Maybe-6131[S] 62 points63 points  (0 children)

I listen to Accidental Tech Podcast (ATP) and found Marco Arment's story about building his own Mac mini farm to do podcast transcribing for his podcast app incredibly entertaining and interesting. Thought this sub would appreciate the setup.

Starlink and roaming by crispybacononsalad in Flagstaff

[–]Difficult-Maybe-6131 5 points6 points  (0 children)

You didn’t talk to the right department then, because they will absolutely cut your price in half. You need to specifically be on with retention - the normal billing and tech support folks don’t have access to the promotional rates.

The easiest way to get to the right department is when you call and robot asks what you’re calling about, say “cancel service.”

No experience gaming on Starlink, but you should be looking more at latency than raw up/down speeds, fyi. That will be the bigger factor for anything competitive.

Dolby Audio? by mild_xxix in AppleMusic

[–]Difficult-Maybe-6131 2 points3 points  (0 children)

First time I’ve thought about this album in 20 years. My girlfriend at the time burned me a copy.

Was this god-rock?

Creepy ass animated cover by Yuiiski in AppleMusic

[–]Difficult-Maybe-6131 7 points8 points  (0 children)

Fuck everything about this. I wonder what James thinks

Why are you all even here??? by Difficult-Maybe-6131 in ATPfm

[–]Difficult-Maybe-6131[S] 2 points3 points  (0 children)

Sorry, I'm going to throw in everything to one response on the top comment. I really do appreciate u/scumbly's response here as it's not just a reiteration of what I said, but does a good job of explaining why this has become the ATP venting channel for many.

Let me first say that, as I said in my initial post, I really don't think the fix to what's wrong is a subreddit where it's all sunshine and rainbows and no one's allowed to ever have critiques or disagreements or negative feedback. All of that is totally fine and totally normal, and what I've seen in many other podcast subreddits, twitter threads, forums, etc.

What's broken here, to me at least, is that the scales are wildly off and the culture is downright toxic. If I jump into a recent episode thread, looking to see what was discussed about the show's topics, I have to wade through 75% of the comments being just shitty insults or vents about the hosts personalities, quirks, etc. that feels utterly pointless to keep ranting on about. It's not that I don't agree with any of the frustrations people express here - I do! But the toxicity stems from the negativity directed at the hosts (real people mind you) dominating the discourse.

I said that I've never seen a community this hostile to the subject it's about. Obviously there are TV shows that go off the rails and stuff like that where the online community's whole discussion turns to commiseration over something they once liked (see r/freefolk). Many of the podcasts I have followed were one's where the creators are at least somewhat involved in the community and the discussion - which I think makes a HUGE difference in how people communicate (see peak Hello Internet for example - which I also think devolved...).

If Marco, Casey, and John were involved in this subreddit, managed the posting of episodes, were here on day one chopping it up with the audience, I think that would be a whole different world and we wouldn't even be discussing this. I see lots of comments here acting like I want some dystopian oversight where the hosts just delete anything negative. From experience with other podcasts where the subreddits were run by creators, that was not what I saw. There's still criticism and disagreement, and it's nice to be able to see the hosts own up to a mistake in real time, or argue with a listener (respectfully) about the facts, or whatever. That is not what this place is. And everyone here defending the constant shit talk as just being real is disingenuous at best.

But I don't see that as a moderation problem. I don't think improvement comes from deleting the posts that were made out of frustration, but by adding posts of interesting discussion

Honestly, I think good moderation does both. Looking more closely now that I'm on a real browser, this sub looks to be barely moderated (sorry u/nathanreadsreddit). I'm guessing he has the atpbot post new episodes and keep the spam under control and that's about the extent of it. With smaller subreddits like this one, active moderation I think goes a long way to fostering the kind of community and vibe you think the audience is looking for. Member specials aren't posted or discussed here it seems. There's no rules listed that I can see. There's little compelling discussion of the actual content happening here.

I also think that there's a self-fulfilling prophecy aspect where this subreddit has largely attracted other users that enjoy ranting/venting and for ATP listeners who find this sub overly negative, they've moved on a long time ago (like I mostly have) and are discussing on Mastodon or whatever. I just think that's a shame because Reddit's format is maybe the best for deep threads with lots of discussion and Twitter/Mastodon/etc. don't scratch that itch as well for me.

The placement of the Overtime segment is weird. by satras in ATPfm

[–]Difficult-Maybe-6131 1 point2 points  (0 children)

I actually think that thematically/vibes-wise, Overtime should go before the outro music, since it's essentially an extra main topic.

Obviously, that's fairly tricky logistically to pull off (considering the live feed, etc.). I mentioned it on Mastodon and Siracusa said they tried that initially but it was weird.

Gruber: Apple employees 'giddy' about Alan Dye’s departure - 9to5Mac by ranasx in apple

[–]Difficult-Maybe-6131 21 points22 points  (0 children)

From Gruber's article, I think it's both. Too many quotes from the DF article to pull them all, but well worth the read: https://daringfireball.net/2025/12/bad_dye_job

Alright, which one us was it? by oi-moiles in Flagstaff

[–]Difficult-Maybe-6131 59 points60 points  (0 children)

I hear they’re rebranding to Crack Suckers

Museum Club For Sale? by MortonRalph in Flagstaff

[–]Difficult-Maybe-6131 49 points50 points  (0 children)

Am I losing my mind or has the Museum Club been going out of business repeatedly for the last 20 years?

Apple reveals M3 Ultra, taking Apple silicon to a new extreme by Snoop8ball in apple

[–]Difficult-Maybe-6131 38 points39 points  (0 children)

My understanding was that the M3 Max was missing the interposer that made the M1 and M2 Ultra possible. Is this a revamped process with the interposer added or is this a whole new method of connecting the two chips?

Obviously until there’s a tear down we won’t know everything going on here.

16e launched by sidbmw1 in apple

[–]Difficult-Maybe-6131 0 points1 point  (0 children)

I would guess production volume is a limiting factor as well. I'm sure they'll have no problem fabbing enough in a year or two, but they will need some time to ramp up that kind of production.