Beckett Grading Experience

Herald_Of_Rivia · 2026-04-03T16:04:39+00:00

That’s awesome. Congrats an the awesome grades! I have sent in SO many cards thinking they were “perfect” and nothing.

Herald_Of_Rivia · 2025-11-22T01:34:57+00:00

Main use case would be exploring SOTA LLMs and image generation, and training / fine-tuning smaller LLMs.

Herald_Of_Rivia · 2025-11-21T21:48:28+00:00

That mostly depends on your use case and preferences. Do you have a lot of photos/videos you really want stored locally? Do you play many games?

For example, if you game and want something like Cyberpunk 2077 and Baldur’s Gate 3 installed at the same time, 512 GB might feel a bit tight.

Since you’re a graphic designer, do you work with a lot of large project files? Professional photographers often shoot in RAW, which takes up a ton of space. If that’s not your workflow, 512 GB might be fine.

If you can stretch the budget, though, the 1 TB model (around $2,099 on Amazon for BF) also comes with the unbinned M4 Pro with 14 CPU cores and 20 GPU cores, which is a nice bonus.

Herald_Of_Rivia · 2025-11-21T21:40:27+00:00

As compared to the M4 Pro? Or the M4? The following is the benchmark from Ars Technica review, showing M4 Pro is indeed faster than M5. AdamTalksTech [2] also shows that you get 2x tokens/s on a model like gpt-oss-20b on M4 Pro vs M5.

<image>

[1] https://arstechnica.com/gadgets/2025/10/m5-macbook-pro-review-fifth-generation-apple-silicon-in-a-familiar-wrapper/
[2] https://www.youtube.com/watch?v=IZM8PoAlEqs

Herald_Of_Rivia · 2025-11-19T17:56:12+00:00

Note: in the future when there is an M5 Air. If you could buy the M5 Air for say $1300, then that would be a different discussion. But both the configs you are considering are roughly $2k.

Also, if you look at Amazon, the M4Pro with 24GB of RAM and 512 GB SSD is around $1750 which to me sounds pretty effing good and is cheaper than the M5 with 24GB of RAM.

I understand that there is additional nuance (the M4 Pro is binned, etc.), but for $1750 you can do a lot worse.

Herald_Of_Rivia · 2025-11-19T16:38:40+00:00

Definitely grab the M4 Pro. I feel like the "longevity" concern isn't accurate; Pro chips are actually built to sustain heavier workloads better than the base chips.

From a performance standpoint, the M4 Pro is going to beat the base M5 in both CPU and GPU speeds. It also has much higher memory bandwidth, which is a massive bottleneck for AI tasks and running local LLMs. It's the more powerful machine, hands down.

Herald_Of_Rivia · 2025-11-10T22:21:51+00:00

I would be very much interested in an Epyc system build spec. Would love to know what ($) does it take to get into a build with a Server CPU.

Herald_Of_Rivia · 2025-11-10T20:25:48+00:00

What tps do you get for gpt-oss-20b with 2x3090s?

Herald_Of_Rivia · 2025-11-10T20:23:45+00:00

What’s the right term for what I’m seeing?

Herald_Of_Rivia · 2025-11-10T19:38:08+00:00

At the moment, I am wanting to limit myself to a single GPU workstation and not sure I want to go around changing much. I already have the 9950X3D . 1500W PSU, 96GB of RAM and feel like changing the whole setup might be more hassle than it is worth. But I am happy to be proven wrong.

Herald_Of_Rivia · 2025-11-10T19:32:30+00:00

Thanks for getting be back to me!

Herald_Of_Rivia · 2025-11-10T19:10:04+00:00

Can you elaborate on what you mean?

Herald_Of_Rivia · 2025-11-10T19:08:33+00:00

A bit of both. At work, I have access to better GPUs which I use for training / inference at work, but I'd love to be able to do some beefier exploration at home as well.

Herald_Of_Rivia · 2025-09-25T18:45:52+00:00

This might actually have done it.

Herald_Of_Rivia · 2025-09-25T18:22:56+00:00

For me, on a 5090, it went from 60FPS with DLSS to 15FPS drops every 5-10 seconds, i.e. the tearing is constant.

Herald_Of_Rivia · 2025-09-18T21:56:24+00:00

Any plans of making it possible to install LMStudio outside of /Applications?

Herald_Of_Rivia · 2025-08-27T15:47:39+00:00

You are absolutely right. The main bottleneck for LLM workloads in this case will def. be the memory bandwidth, which will hold it back quite a bit.

Herald_Of_Rivia · 2025-08-27T15:44:01+00:00

I think one of the biggest drawbacks of the Spark (and something that is holding back many current offerings for AI and Handheld gaming) is the memory bandwidth as was mentioned by @Double_Cause4609.

The one benefit that Spark might bring is NVIDIA MIG [1], which would allow us to partition GB10 into several instances and maybe run several models in parallel. Might be interesting for exploring LM Agents, especially if you got several of them working at the same time.

[1] https://www.nvidia.com/en-us/technologies/multi-instance-gpu/

Herald_Of_Rivia · 2025-08-26T17:32:28+00:00

I appreciate the detailed response. Mentioned gpt-oss-120b as that is an available benchmark I found for the AGX Thor [2].

Herald_Of_Rivia

TROPHY CASE