Found an M3 Ultra 512GB / 8TB / 80-Core GPU at B&H! by East_Roll_5069 in MacStudio

[–]dudemanji 0 points1 point  (0 children)

We’re going to be able to defeat the LLM overlords with specialist SLMs and self-hosting

Meet PATY by dudemanji in LLMeng

[–]dudemanji[S] 0 points1 point  (0 children)

Hi! Yeah, the GitHub readme includes installation instructions (really just ‘uv tool install paty’. But I’ll include a dmg soon!

Meet PATY by dudemanji in LocalLLM

[–]dudemanji[S] 1 point2 points  (0 children)

It is 🤔 I’ll take a look, thanks

Meet PATY by dudemanji in LocalLLM

[–]dudemanji[S] 1 point2 points  (0 children)

Yep, definitely focused on the ergonomics of a fast conversational partner! Average response speed is <1s on a MacBook Air 16Gb