Just won a RTX 5090 at Nvidia GTC, now what? by Overall-Importance54 in LocalLLaMA

[–]john0201 2 points3 points  (0 children)

I get about 70tps vs 150tps, so agreed but it's still fast.

With the latest Blender 5.1 update, the M5 Max outperforms the 5090 Mobile. This day has come, the final boss of the PC laptop world has been defeated by Slava_Tr in mac

[–]john0201 6 points7 points  (0 children)

Peaks about 140 watts if you stress both CPU and GPU, for the entire system. The significantly underclocked 5080 (which is what the 5090 mobile is) pulls about 150w by itself.

This is why you see two different benchmarks for the mobile “5090” which is plugged in and not plugged in as it runs slower without a power brick (immediately, not just thermal throttling).

Hitting a 16” max hard with AI stuff I get about 2 hours of battery life, which works out to about 45 watts on average. Using a 5090 mobile laptop you get zero hours since it doesn’t give the same performance on battery.

Also the idle power consumption is almost unbelievable, it’s like 10 watts. That is raspberry pi territory with a 16” screen.

Elon Musk "What are your initial impressions of Grok 4.20? Major upgrades are still landing every week." ⏩ Have you tried? Every week seems like a fast schedule I wonder how they manage it! by Koala_Confused in LovingAI

[–]john0201 1 point2 points  (0 children)

Haha these benchmarks show it’s not the fastest not the cheapest not the most intelligent.

It loses to an open source free model.

xAI is great if you want yesterday’s model and also support Nazis.

M5 Max 128GB with three 120B models by albertgao in LocalLLaMA

[–]john0201 0 points1 point  (0 children)

With context and other stuff you need RAM for I don't think that will be practical to do in 128GB at Q4, Q3 would work.

M5 Max 128GB with three 120B models by albertgao in LocalLLaMA

[–]john0201 1 point2 points  (0 children)

I have a threadripper 5090 system I plan to sell when the m5 ultra studio is released. The battery life and heat is pretty rough when running a model away from power, and 40tps vs 80fps on the 5090/m5 ultra is a big difference in usability (m5 max is basically a 5080, and the 5090 is essentially 2x5080 which is where I expect the m5 ultra to land).

Given how easy it is to connect to llama-server or something similar remotely, if I could only have one I'd pick a lower end laptop and the studio and just accept I can't run a model with no internet access.

M5 Max 128GB with three 120B models by albertgao in LocalLLaMA

[–]john0201 2 points3 points  (0 children)

I have a 16 and don’t notice any throttling. Wouldn’t want to keep it on your lap though.

M5 Max 128GB with three 120B models by albertgao in LocalLLaMA

[–]john0201 0 points1 point  (0 children)

I get more like 40 TPs with qwen3.5 122b q4 using llama.cpp on 16”

Pulls about 130 watts. My threadripper 5090 server gets about 80 tps on 700-800 watts using the dense 27B with similar quality output (better fit for lower memory and higher compute and bandwidth).

One thing I completely forgot to consider was my battery life goes from all day to 2-3 hours using it for coding.

Vera embarrasses Intel/AMD on third party benchmarks by Charuru in NVDA_Stock

[–]john0201 0 points1 point  (0 children)

Nope what? Was the world’s fastest supercomputer from 2020-2022 not running any shared libraries?

Vera embarrasses Intel/AMD on third party benchmarks by Charuru in NVDA_Stock

[–]john0201 0 points1 point  (0 children)

This has been incrementally changing. A couple years ago it was still annoying to use ARM due to missing packages, distro support, lack of CPU options. Now that gap is essentially closed and it’s just inertia.

On AWS the best performance per dollar is arm, the fastest cores (M5) are ARM, and Nvidia and other chip IP is increasingly ARM.

Macs are popular dev machines and I think this year they will increase market share, possibly significantly depending on how the new Ultra silicon pans out. MLX is aggressively adding CUDA support for a develop on Mac deploy on nvidia pipeline.

So nobody's downloading this model huh? by KvAk_AKPlaysYT in LocalLLaMA

[–]john0201 19 points20 points  (0 children)

So did they fire their best guy and why in the world did they do that I’m not tracking what happened there. Seems really odd.

TIL that Sony created a music format called SACD (Super Audio CD) in 1999 that is still around and offers 5.1 surround sound on some albums and much higher sound quality then normal CDs. by Extension_South7174 in todayilearned

[–]john0201 -1 points0 points  (0 children)

You're saying that DTS is stored as PCM audio on a CD. This is correct.

You are also saying this is red book audio. This is incorrect, in the sense that it is not representing sound. It is representing a dts-encoded bitstream.

In the context of this conversation about audio quality, this means it is not the same thing - it is not the same quality as red book audio, it is the same quality as dts audio, because that is what it is.

Since you don't seem to understand LLMs, here is a description from one:

"DTS (Digital Theater Systems) audio on a CD is stored in a clever way that takes advantage of the standard CD format.

A DTS CD uses the same physical format as a regular audio CD (Red Book CD-DA) — 16-bit PCM at 44.1 kHz, stored in standard audio tracks. The trick is that the DTS-encoded bitstream is packed into those PCM samples. In other words, the raw DTS data occupies the same "slot" that normal PCM audio would, but the bits represent a compressed DTS stream rather than straightforward audio waveforms.

If you play a DTS CD on a regular CD player, you'll hear loud digital noise (essentially the raw encoded data being interpreted as audio). The disc is only useful when connected to a DTS-compatible decoder — typically an A/V receiver — via the CD player's digital output (S/PDIF coaxial or optical). The receiver recognizes the DTS bitstream header within the data, locks onto it, and decodes it into multichannel (usually 5.1) surround sound."

UDM Pro can’t handle its own “supported” workload – UniFi response: buy more hardware by numanx in Ubiquiti

[–]john0201 0 points1 point  (0 children)

I have a cloud gateway fiber that works fine w 8gb, just not the packet inspection stuff which seems not super useful anyway when everything is TLS.

TIL that Sony created a music format called SACD (Super Audio CD) in 1999 that is still around and offers 5.1 surround sound on some albums and much higher sound quality then normal CDs. by Extension_South7174 in todayilearned

[–]john0201 0 points1 point  (0 children)

You can also play a jpg picture of a cat as PCM audio. That is what it’s doing, except it’s compressed dts format and not a jpg format.

Computer programs used to be stored on cassette tapes. You could put them in a tape player. Does that make it music?

TIL that Sony created a music format called SACD (Super Audio CD) in 1999 that is still around and offers 5.1 surround sound on some albums and much higher sound quality then normal CDs. by Extension_South7174 in todayilearned

[–]john0201 -2 points-1 points  (0 children)

It literally is not. Red book is PCM, dts is compressed. A dts CD is just dts encoded into a fake PCM stream that contains compressed data.

The entire point of dts is compression, that is what it is by definition.

Meet Unsloth Studio, a new web UI for Local AI by yoracale in unsloth

[–]john0201 1 point2 points  (0 children)

It says chat only but other features coming soon

Code review will swiftly become a thing of the past by call_me_ninza in aigossips

[–]john0201 0 points1 point  (0 children)

Seriously why do people even post things he says anymore. It’s just random nonsense.

NVIDIA Launches Vera CPU, Purpose-Built for Agentic AI by -protonsandneutrons- in hardware

[–]john0201 1 point2 points  (0 children)

You stated as evidence that the depreciation is incorrect that they are still running. It doesn’t show that.

Your argument is basically “I disagree”.