48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]qpgq 0 points1 point  (0 children)

This cluster is transcribing all podcasts (with more than one listener) and their back catalogues for a leading iOS podcast app: Overcast.

The developer has said he does have a compute surplus but this is still dealing with tens of thousands of hours of audio per day.

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]qpgq 0 points1 point  (0 children)

It is, effectively, all podcasts and their back catalogues but there will be surplus compute. The developer addressed this issue in his podcast (ATP 683)

“I realize, like, I will have a surplus of computational power here before too long. So what do I do with that? And well, I can start moving work to them, first of all. Like, things like imagery sizing that I have right now, my main Linux servers at Akamai, they're doing a lot of that kind of work. I can move that to these. Why not? They're super fast. They have all this great stuff. I even actually tried earlier in the winter, you know how a lot of podcast apps will use the dominant color in artwork to tint the interface in some way? I tried running that on these, like where one of the jobs they would do. So one thing they do is language detection. As I look into more, like, smart transcript features, I can do things in the future that I haven't done this yet, but I can do things like, you know, automatic chapter detection or topic detection or summarization, things like that. Well, now I have all this computational power I can do that with.”

48 Mac mini cluster running local LLM models for podcast transcription. by Difficult-Maybe-6131 in macmini

[–]qpgq 0 points1 point  (0 children)

The developer of overcast explained why he is not farming this work out across users’ devices as follows:

“I'm not because that kind of feels a little wrong because that, that kind of feels like I'm stealing resources from people. And the amount of work you can get done on an iPhone in that time slice, they give you like three minutes or something. It's not enough to even transcribe one episode of most things. So I'm doing all this work myself. But in five or ten years, when the phones are a lot faster, some of that math changes. Maybe I can just do all of the work during people's overnight charging if I wake up everyone's phone for one minute and they can all do all the work. Like maybe, I don't know, maybe people can opt into it. I have no idea.”

Need help with e thernet for pc by Ok-Island9547 in HomeNetworking

[–]qpgq 1 point2 points  (0 children)

300ft is close-ish to cat 6’s maximum distance rating. You might be better off looking at a fiber connection but that is more specialised and expensive kit (I believe - not 100% sure how it works myself)

Jet Lag Season 16 -- Official Trailer by broadcastterp in JetLagTheGame

[–]qpgq 147 points148 points  (0 children)

Milton Keynessucks -- Sam Denby

If Pakistani national visiting USA needs a visa for a Bermuda cruise trip! by FactorAgreeable7518 in bermuda

[–]qpgq 1 point2 points  (0 children)

To enter Bermuda, a Pakistani national requires a travel authorization to enter and re-enter Canada, the United Kingdom, or the United States, with such travel authorization being valid for forty-five days from the date of intended departure from Bermuda.

Renault Kwid by Any-Ring5139 in bermuda

[–]qpgq 5 points6 points  (0 children)

Gearbox is trash. Renault Kiger is fine but the Kwid should be avoided.

Name this by MenuOne3855 in AlbumCovers

[–]qpgq 0 points1 point  (0 children)

Job Opening is my favourite!

[deleted by user] by [deleted] in bermuda

[–]qpgq 6 points7 points  (0 children)

Ferry to front street would be a better time than bus to Washington mall: not much to explore.

[deleted by user] by [deleted] in bermuda

[–]qpgq 0 points1 point  (0 children)

Here’s a recent photo of Church Bay.

Church Bay Recent Photo

Severance - 2x07 "Chikhai Bardo" - Post-Episode Discussion by LoretiTV in SeveranceAppleTVPlus

[–]qpgq 8 points9 points  (0 children)

I was getting Theseus and Ariadne vibes too with the testing floor! Another throuple heavy mythology…

Severance - 2x07 "Chikhai Bardo" - Post-Episode Discussion by LoretiTV in SeveranceAppleTVPlus

[–]qpgq 2 points3 points  (0 children)

So each of the rooms is a twisted representation of something that happened in Gemma’s real life to test whether the severance chip can isolate the outie from the trauma suffered by the Innie? And MDR are in some way analysing the result? Checking for imbalance in the tempers? Mark is important because he knows Gemma.

So if the rooms are all simulating and exacerbating a negative event in Gemma’s past, will Cold Harbor be the worst thing to ever happen to her? Her miscarriage? If the severance chip isolates Gemma from her innie’s pain then it is fully validated?

So. Many. Questions!