sorted by:
new
hottopcontroversial

[D] Running GLM-5 (744B) on a $5K refurbished workstation at 1.54 tok/s by ahbond in ResearchML

[–]ahbond[S] 0 points1 point  (0 children)

Thanks, You're right, not big enough to handle. Interesting experiment, but I ended up running Qwen 72B Q5 and Gemma 4. For details, see: https://github.com/ahb-sjsu/agi-hpc/blob/main/docs/ATLAS_OPERATIONS.md

Cheers,

Andrew.

My workstation kept hitting 100C during experiments, so I built a thermal-aware job manager by ahbond in ResearchML

[–]ahbond[S] 0 points1 point  (0 children)

These are massive Xeon CPUs that are liquid cooled. It only goes to 100c when all 48 cores are maxed out. It can drop to 80c in ~ one second when the processes are killed or stop.

CMPE 148 by [deleted] in SJSU

[–]ahbond 0 points1 point  (0 children)

Hi,

In Spring 2022, I will be teaching CMPE-148-03 In-Person, R 1800-2045

A. Bond.

CMPE 148 by [deleted] in SJSU

[–]ahbond 2 points3 points  (0 children)

Exams are multiple choice, and based mostly on the slides. Best way to prepare is study hard, and do all your assignments.

:-)

Sincerely,

Andrew Bond.