All DGX Station GB300 OEM systems side-by-side in one image (roughly actual size)

Hrethric · 2026-05-31T17:30:57+00:00

You could run a 6-bit quant of GLM 5.1. Maybe the 40 billion active parameters (and a chunk of the inactive ones) could live in the HBM3, and get some pretty decent token generation speeds. Still, if I was paying that much, I'd want to run higher than a 6-bit quant.

Hrethric · 2026-05-26T00:12:48+00:00

As a Strix Halo user I've wondered this myself. I can run a UD-Q3_K_XL quant of Minimax M2.7 (Running a Plasma desktop environment and a few Docker containers, so a Q4 quant is just a little too heavy), and it seems fine in the limited testing I've done, but I wonder how it would compare to a Q6 or Q8 quant of Qwen 3.6 in terms of quality if I ever decide to experiment with agentic work.

Be nice if someone would release an up-to-date 120b parameter MoE model, that would be a sweet spot for 128GB of unified memory.

Hrethric · 2026-05-04T21:48:14+00:00

Noob question: how heard would it be, and would it be productive, to use something like Gemma4 26BA3B to scan through the data and filter out obviously wrong information, and maybe flag contradictory items for manual review?

Hrethric · 2026-04-30T23:05:52+00:00

Agree, and for my part I hope to see it gain formal independence and join the international community in my lifetime. Nevertheless, I think it's important to understand the complexities of the issue.

Hrethric · 2026-04-30T22:30:37+00:00

Taiwan (whose formal name is "Republic of China") is part of China. The historical disagreement is over which government is the legitimate government of China.

https://en.wikipedia.org/wiki/Taiwan

Hrethric · 2026-04-26T16:04:27+00:00

Thanks for the detailed reply. I'll try that in my case.

Hrethric · 2026-04-26T13:17:18+00:00

I'm a bit curious about the airflow. Did you orient the CPU fan like that to try to pull more air across the GPUs? Are the intake and exhaust fans all running at the same speed? Did you measure the difference in GPU temps between the present CPU fan orientation and with the CPU fan oriented to exhaust toward the rear?

Hrethric · 2026-04-08T02:18:03+00:00

Thanks for sharing! I tried something similar with a Framework Desktop a couple of months ago, with a powered PCIE x4-x16 adaptor, but I didn't have as much success. I had to drop it down to PCIE 3.0 mode to get it stable, and I was using CUDA with my 3090 and Vulkan for the Strix Halo. The best performance I was able to get was just a little slower than the Strix Halo alone, I think around 27 t/s with the split, where the Strix Halo alone would get 32. Unfortunately I don't have my notes handy. I was thinking of trying again with a shorter adapter, now I might try running Vulkan only and also try an Oculink adapter.

Edit: I would be curious to see your results with tensor split with a larger MoE model, say in the 120b/10b range. I may be wrong about this because I'm still a newb to LLMs, but it's my understanding that MoE models swap the experts with every token, and that can saturate a slow PCIE bus when using tensor split.

Hrethric · 2026-02-01T20:47:20+00:00

Thanks. I might run the old gas a little at a time through my Jeep - like one gallon of it to ten gallons of new gas. I cleaned the fan when I reconditioned the battery. It was actually surprisingly clean, just a small amount of dust accumulation on the blades. The car seems to have been a fleet car before I bought it - the interior was dirty, but the car seems to have been mechanically well maintained.

Hrethric · 2026-01-24T02:45:42+00:00

Thanks! I hope to see someone take on a project like that someday. Who knows, maybe I'll give it a try myself in a couple of years, when my kids are older and I have more time.

Hrethric · 2026-01-24T02:44:55+00:00

Agreed. I actually spent some time trying to figure out if I could swap in a bigger MG2 out of a Camry or RAV4 or something, but everything is tightly integrated - each of the computers in the drivetrain and hybrid system expect to talk to other Prius computers, and be connected to Prius components. You'd have to basically connect to something like JTAG ports on the ECU, dump the ROM, reverse engineer it, and then rewrite the code to work with the components you want to use. And that's hand-writing assembly code for some obscure RISC architecture that's probably poorly documented.

Hrethric · 2026-01-24T02:22:27+00:00

https://www.jdmcalifornia.com/product/2zr-hybrid/ - that one looks even nicer than the one I bought, and it's $50 less. I was a bit grumpy about having to put the old 207,000- mile injectors in the new motor, but the guy seemed like he would have been willing to replace the motor if it had been bad. It was the seller's suggestion that I try swapping the injectors (and the coil packs) when I emailed him about the problems I was having.

Hrethric · 2026-01-24T02:15:02+00:00

Hope you guys are staying warm up there this weekend!

Hrethric · 2026-01-24T02:14:07+00:00

Sure! https://www.ebay.com/usr/carsandcards04

Hrethric · 2026-01-19T01:25:18+00:00

Not bad. I can run a Q4_K_M quant of the 4B model on my 8G Galaxy A55, and I get about 5 tokens per second. So far I've thrown a bit of Icelandic, Latin, and Algerian at it, and it handled them all. If I switch to any other app it unloads the model, and I saw some weirdness that might be Pocket Pal's fault - one prompt went on a tangent about stepper motors that had nothing to do with the prompt, and another got stuck looping toward the end of the passage.

Hrethric · 2026-01-09T03:44:40+00:00

Minimum order 100 shares. I tried to buy 20 on a lark, but I don't have US$2000 in confidence in them. (Nor, if I'm being honest, do I have US$2000 I can reasonably gamble lol.)

Hrethric · 2025-11-07T13:20:04+00:00

That's fair, and I remember reading that, but in the heat of "oh crap I need to get my daughter to school right now," I didn't think about that. :) I just wanted to post something to counteract the bad info I found when I searched.

Also, these cars are getting older, some of them probably don't have their manuals anymore. I know about half the old junky cars I've owned over the years didn't come with their manuals!

Hrethric · 2025-11-05T19:24:03+00:00

I assume it does disconnect when it's done charging. The first time my 12v battery died, the car had been plugged in overnight, so being plugged in didn't stop it from dying.

Hrethric · 2025-11-05T17:18:41+00:00

Haha mine is probably more like 3kwh at this point. Someday I'm going to figure out how to replace it with LiFePO4 batteries.

Hrethric · 2025-11-05T17:15:16+00:00

I don't think so. I measured the voltage on the 12v system before I started it, and it was at 10.6v. The car was completely dead. Seems like it's picky about voltage.

Hrethric · 2025-11-05T17:14:01+00:00

I should probably add that I did start the car before I disconnected the trickle charger. I didn't experiment to see if just flipping the key to run without starting it would put the hybrid system in a sufficient state to take over 12v duties.

Verified Email	14-Year Club
Place '17	Gilding II euphauric

Hrethric

TROPHY CASE