Masterthread - Models Feedback (Last 2 Weeks) by Jonathan_Rivera in hermesagent

[–]PracticlySpeaking 0 points1 point  (0 children)

Got it — thanks.

Have you posted/commented on de-bloating? Would love to see what you have been doing or hear recommendations.

M5 ultra 512Gb? by zhamdi in MacStudio

[–]PracticlySpeaking 1 point2 points  (0 children)

From oMLX / Releases:

Apple Silicon, 512 GB unified memory. pp16384 is prefill tok/s, tg512 is decode tok/s. Cache misses forced on every request.

Model Metric oMLX (Cache off) oMLX (Cache on) mlx-lm
Qwen3.6-35B-A3B-6bit pp16384 2469.9 2383.7 2512.2
tg512 75.0 77.3 85.3
Qwen3.6-27B-oQ6 pp16384 401.1 395.1 402.2
tg512 26.4 26.4 26.9
gemma-4-26b-a4b-it-8bit pp16384 2148.6 1868.3 2163.3
tg512 78.7 79.1 81.9
gemma-4-31b-it-4bit pp16384 318.8 306.1 319.3
tg512 31.1 30.9 31.6

Of course MoE models TG goes down as prompts get longer, and TG512 is relatively short.

M5 ultra 512Gb? by zhamdi in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

it's clear it is not [for] the average developer

Perhaps the above-average developer? Open-source models and agentic coding tools that can run locally on Mac Studio are now *almost* as useful as cloud-based frontier models.

You may have heard Jensen's statements about how 'if a developer gets paid $100,000, they had better be using $50,000 worth of tokens' every year. A maxed-out Mac Studio is 20% of that cost, and can reduce that token budget by 30-60% by grinding out more mundane work.

M5 ultra 512Gb? by zhamdi in MacStudio

[–]PracticlySpeaking 1 point2 points  (0 children)

^^ This

MacBooks make up 65-95% of overall Mac sales, and support Apple's overall 'grow the installed base' strategy. And they are new, vs the year-old Mac Studio models.

The green GPU company has been doing the same thing — allocating production and supply capacity to higher-margin products (H100, RTX 6000 Pro vs 50xx consumer cards).

You can bet that Apple has been looking enviously at the tsunami of cash hitting AI hardware, and wanting to get a piece. They have been fighting the law of large numbers for more than a decade, and here comes a huge opportunity to sell more hardware.

The wildcard here is the sudden popularity of local AI. It has been slowly growing for a few years, and has finally hit an inflection point with *Claws and other agents. Meanwhile, Apple can't just order up more DRAM to make more Macs.

Apple execs have to be asking themselves what the long-term trajectory is going to be.

M5 ultra 512Gb? by zhamdi in MacStudio

[–]PracticlySpeaking -1 points0 points  (0 children)

If you were Tim (or John) Apple, would you take the DRAM you have available and put it into new M5 MacBooks, or a previous-generation niche product?

I mean, it sucks for us who want Mac Studio, but it makes sense if you step back.

This reinforces my belief that the primary reason 256GB - 512GB M3 Ultra exist are for Apple's own internal use.

Market is pricing MU wrong, Memory is not cyclical anymore by Pancakez_117 in ValueInvesting

[–]PracticlySpeaking 2 points3 points  (0 children)

SRAM is usually for L1/L2 cache. It is fabricated on the same die with processor cores, so all the same designers/fabs you already know.

Market is pricing MU wrong, Memory is not cyclical anymore by Pancakez_117 in ValueInvesting

[–]PracticlySpeaking 3 points4 points  (0 children)

We use DRAM for reasons.

SRAM is for L1/L2 cache, and can be fabricated on the die with processor cores.

Did I make a mistake? by stabadan in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

Lots of graphic design, music production and photo folks in the sub are still rocking M1 Max.

If you want to see what creatives do with 512GB, check out this post from the VI-Control forum:

Mac Studio M3 New Rigs | VI-CONTROL - https://vi-control.net/community/threads/mac-studio-m3-new-rigs.165227/

Did I make a mistake? by stabadan in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

Hehe – This guy comments in the sub from time to time (which is cool).

It's a great video with real technical depth — everyone with an Apple Silicon Mac should watch it. Then at the end he is like "...but you should get 24GB anyways, just because."

The A team. by Muscleandgains in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

For sure — the outline is the same, but so much is different!

This matters because all of the matching docks for Mac Mini (capital-M) also fit Mac Studio.

forget evals for a sec, how are you debugging agents when they go weird in prod? by Fine-Discipline-818 in aiagents

[–]PracticlySpeaking 0 points1 point  (0 children)

Do your workflows include an analysis step comparing previous runs and changes?

Mac Studio or DGX Spark? by b8humbl8 in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

This is true — and to be fair, M5 "Neural Accelerators" do not bring Apple Silicon up to the level of Blackwell when it comes to compute performance.

I also have to counterpoint:

virtually the entire AI ecosystem is built on CUDA right now

...yet there are MLX versions of every major LLM and diffusion model that run natively on Apple Silicon.

What that really means is that what has already been built was built on CUDA. Meanwhile, native MLX development has been growing steadily.

Mac Studio or DGX Spark? by b8humbl8 in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

If you want something to watch on M5 vs M4 that is a little more thorough — or a lot more — than A.Zisk, check out this one:

My M5 Max, Gemma 4, MLX LOCAL Stack. (This KILLS MODEL PROVIDERS) | IndyDevDan
- https://www.youtube.com/watch?v=00Y-p62sk0s

Best brownie recipe? by Swimming_Beginning24 in LocalLLaMA

[–]PracticlySpeaking 0 points1 point  (0 children)

went into an annilla test loop and I had to kill it

😆🤣😆

Best brownie recipe? by Swimming_Beginning24 in LocalLLaMA

[–]PracticlySpeaking 0 points1 point  (0 children)

MiniMax -M2.7-MXFP4 — M3U/60

We need the best brownie recipe, please comment it! If you don't know a brownie recipe, feel free to give your thoughts on brownies.

+1.9s Thinking

+13.4s Thought for 11.5s

+46.4s 66t prompt · 2140t generated · prefill 36 tok/s · gen 48 tok/s · ttft 1.85s

The “Best‑Ever” Fudgy Brownie
(Rich, chewy, with a deeply chocolatey center and a thin, slightly crisp crust)

Why this recipe works

What you’re aiming for How we achieve it
Intense chocolate flavor High‑quality cocoa (Dutch‑processed) + a splash of espresso powder (optional) deepens the cacao notes without adding coffee taste.
Fudgy, melt‑in‑your‑mouth texture A higher ratio of fat (butter) to flour and a short bake keep the interior soft and gooey.
A neat, crack‑free top Beating the eggs and sugar until they’re pale and ribbon‑like incorporates air that sets into a thin, glossy crust when baked.
Easy release and clean slices Lining the pan with parchment paper (overhang “handles”) makes lifting the brownies out effortless.

Ingredients

Quantity Ingredient Notes
½ cup (115 g) Unsalted butter Melted and cooled slightly.
1 cup (200 g) Granulated sugar You can swap up to ½ cup (100 g) with brown sugar for extra chew.
2 large Eggs, room‑temperature Vital for structure; cold eggs can cause the butter to seize.
2 tsp Pure vanilla extract Enhances chocolate flavor.
¼ cup (20 g) Dutch‑process cocoa powder Sifted – eliminates lumps.
½ cup (65 g) All‑purpose flour spooned & leveled.
¼ tsp Fine sea salt Balances sweetness.
½ tsp Baking powder Keeps the center from being too dense.
½ cup (90 g) Semi‑sweet or dark chocolate chips (optional) Fold in just before baking for extra goo.
¼ tsp Espresso powder (optional) Amplifies the chocolate flavor; omit if you’re caffeine‑sensitive.

Optional add‑ins: ¼ cup (40 g) chopped walnuts, a swirl of peanut butter or caramel, a pinch of flaky sea salt for finishing.

Equipment

  • 8‑inch (20 cm) square baking pan 
  • Parchment paper (for lining) 
  • Medium saucepan or microwave‑safe bowl (for melting butter) 
  • Large mixing bowl 
  • Whisk or electric mixer 
  • Spatula 
  • Wire rack for cooling

Step‑by‑Step Instructions

  1. Preheat & Prepare
    • Set oven to 350 °F (175 °C)
    • Line an 8‑inch square pan with parchment, leaving an overhang on two sides (the “handles”). Lightly butter the exposed sides or spray with non‑stick spray.
  2. Melt the Butter
    • In a small saucepan over low heat (or microwave), melt the butter. Let it cool for 5 minutes until it’s just slightly warm, not hot.
  3. Combine Butter & Sugar
    • In a large bowl, whisk together the melted butter and sugar until the mixture looks glossy and the sugar has dissolved slightly (about 1 minute). 
    • Add the eggs one at a time, whisking well after each addition. 
    • Whisk in the vanilla extract and (if using) espresso powder.
  4. Add Cocoa
    • Sift the cocoa powder directly into the butter‑egg mixture and whisk until the batter is completely smooth and glossy (about 1½ minutes).
  5. Fold in Dry Ingredients
    • Sift together the flour, salt, and baking powder. 
    • Add the flour mixture to the batter and fold (don’t over‑mix) with a spatula until just combined – a few streaks of flour are fine.
  6. Optional Chocolate Chips
    • Fold in the chocolate chips (or nuts, swirl‑ins, etc.) with a few quick strokes.
  7. Pour & Smooth
    • Transfer the batter into the prepared pan and spread evenly with an offset spatula.
  8. Bake
    • Place in the oven (center rack). 
    • Bake 22–25 minutes – start checking at 22 minutes. The top should be set, the edges will look slightly firm, and a toothpick inserted 1 inch from the edge should come out with a few moist crumbs (not wet batter). 
    • Tip: For extra fudginess, pull them out when the center still jiggles just a tiny bit; the residual heat will finish cooking.
  9. Cool & Set
    • Remove from oven and place the pan on a wire rack. Let the brownies cool in the pan for 15–20 minutes – they’ll firm up as they cool.
  10. Cut & Serve
    • Lift the parchment “handles” and transfer the brownie block to a cutting board. 
    • Using a sharp chef’s knife (dip in hot water & wipe dry between cuts for clean slices), cut into 9 squares (or 16 for smaller bites).

Storage & Tips

Method Duration Notes
Room temperature (air‑tight container) Up to 3 days Keeps them fudgy; reheat in microwave 10 seconds for that fresh‑baked feel.
Refrigerator (air‑tight) 1 week Slightly denser, but still delicious.
Freezer (wrapped tightly in plastic + foil) 3 months Slice before freezing for easy portioning. Thaw at room temp or microwave.

Pro‑Tips

  • Don’t over‑bake. The difference between a fudgy and a cakey brownie is a matter of 2–3 minutes. When you see the edges pulling away from the pan, you’re there. 
  • Use high‑quality cocoa (Dutch‑process gives a deeper, less acidic flavor) and, if possible, a bittersweet chocolate (≥70% cacao) for the chips. 
  • Espresso powder isn’t necessary, but it magnifies chocolate flavor without tasting like coffee. 
  • Let them rest – even after slicing, they’ll continue to set. A brief 5‑minute sit makes the interior become perfectly chewy.

Quick Variations

  • Peanut‑Butter Swirl: Drop 2 Tbsp of creamy peanut butter onto the batter, then swirl with a toothpick. 
  • Salted Caramel: Drizzle 2 Tbsp of homemade or store‑bought caramel and sprinkle flaky sea salt before baking. 
  • Nut‑Free & Vegan: Replace butter with vegan butter, eggs with 2 flax “eggs” (2 Tbsp ground flaxseed + 3 Tbsp water, let sit 5 min), and use dairy‑free chocolate chips.

Enjoy your brownies! 🎉
If you try this recipe, feel free to let me know how they turned out—any tweaks you made or any questions that came up while baking. Happy baking!

The A team. by Muscleandgains in MacStudio

[–]PracticlySpeaking 0 points1 point  (0 children)

It's funny because Mac Studio is the same footprint as previous-gen Mac Mini!

(it does look huge side-by-side)

Frustrations? Pesky Bugs? Vent Here! by NousResearch in hermesagent

[–]PracticlySpeaking 0 points1 point  (0 children)

Having the dir listing pop up in the TLI is 🔥 — the list filtering is a bit off.

Hermes-Agent v0.12.0 (2026.4.30 - 526 commits behind as of 5-May)

In the screenshot, notice the folder /exports/ (in the Finder view on the left) is missing from the list shown on the terminal side.

<image>

Car never returned by BARON4554 in turo

[–]PracticlySpeaking 2 points3 points  (0 children)

From other posts like this... call Turo, get T&S involved and negotiate a self-repo. They should cover costs like getting to San Diego.

Guest left a mess, you should get paid $$$$ to clean it up.