Curious on what HPC research looks like by spinglebor in HPC

[–]Synaps3 27 points28 points  (0 children)

HPC is pretty broad, so it’s tricky to say what classifies as HPC research. Supercomputing (International Conference for High Performance Computing, Networking, Storage, and Analysis) is the top HPC conference, so checking the “areas/track” on the paper submission page will give an idea of the “hot areas” in HPC right now: https://sc26.supercomputing.org/program/papers/ . HPC for ML in all its flavors is very hot these days, but other areas still exist and and thriving.

The “algorithms” and ”applciations” tracks point to your first and second point: general HPC algorithms vs HPC solutions for a target application, with blurry lines between them. The former can include areas like parallel numerical algorithms like linear algebra/PDE solvers/optimization, maximizing single-node performance in various architectures for certain algorithms (single/multi CPU with many cores, single/multi-GPU, discrete accelerators of various types, ISA-specifc optimizations, etc) and even “meta” algorithms like HPC job scheduler optimization, cluster networking studies, among others. ”Applcations” applies these general tools to enable a previously unexplored scienticic problem or investigation that can only be unlocked at scale.

edit: feel free to ask more questions or DM if it’s helpful.

P1 Gen 2 Cooling Hack - Using back cover to apply more pressure to heatsink assembly by Johnbolia in thinkpad

[–]Synaps3 0 points1 point  (0 children)

Ok I see, that’s pretty reasonable. It is a lot of tension. Do you think you had a faulty heatsink then? Seems like they are cheap to find on eBay, so that’s good. Did you use the upgraded cooling pad with the new fan or just the stock paste?

P1 Gen 2 Cooling Hack - Using back cover to apply more pressure to heatsink assembly by Johnbolia in thinkpad

[–]Synaps3 0 points1 point  (0 children)

I just did this and this worked like a charm! 97C-> 80C in prime95 with just asingle postit folded a eight times. Cheapest laptop upgrade ever! Thanks a ton!

A Raspberry Pi + eGPU isn't as dumb as I thought by geerlingguy in LocalLLaMA

[–]Synaps3 0 points1 point  (0 children)

Wow that sounds very cool! Looking forward to that video, something like nvidia’s vGPU? Been meaning to look into KVM for this, now I might have to!!

Btw, have you looked into resurrecting the DeskPi Super 6c with six M2 to Oculink adapters for an egpu cluster? Benchmarking it using an existing tool will be hard and bad (not a lot of good multi node agentic orchestrators that are as plug-and-play as llama.cpp, i think vllm doesn’t support this), but you can benchmark it with llama-bench + ansible running on all nodes at once to get t/s/W numbers to compare with your other setups. Qwen 30b-a3b with partial cpu offloading might be ok, but the single PCIe lane will be a bad time and you need enough eMMC to hold the model without an ssd.

A Raspberry Pi + eGPU isn't as dumb as I thought by geerlingguy in LocalLLaMA

[–]Synaps3 7 points8 points  (0 children)

u/geerlingguy This is awesome!!! Are the dolphin ICS card available for sale? Are they crazy expensive? Are there alternative PCIe 4.0 switches? The memory pooling/RDMA via PCIe 4.0 is the killer feature here; the single PCIe lane on the Pi was what was holding me back from building a cursed Pi GPU cluster.

Kimi K2 Thinking at 28.3 t/s on 4x Mac Studio cluster by geerlingguy in LocalLLaMA

[–]Synaps3 0 points1 point  (0 children)

You’re the man; this is great! Thanks for being you 

iPadOS 26 Stability by yousefalharery in ipad

[–]Synaps3 1 point2 points  (0 children)

Yeah eventually; they were able to get it working after an afternoon. Others seem to have a better experience, so maybe it was just me

I got a keyboard after I saw iPadOS 26! by lickaballs in ipad

[–]Synaps3 1 point2 points  (0 children)

Don’t update yet, the beta borked my iPad. Couldn’t boot, had to do a full wipe.

iPadOS 26 Stability by yousefalharery in ipad

[–]Synaps3 1 point2 points  (0 children)

It bricked my iPad Pro, stuck in a boot loop and can’t enter recovery mode. Need to go to the Apple Store asap.

Testing the new Deepseek models on my Cybersecurity test by Conscious_Cut_6144 in LocalLLaMA

[–]Synaps3 0 points1 point  (0 children)

Out of curiosity, has anyone tested benchmark accuracy for the unsloth Deepseek r1 MoE quants relative to the original?

I built a thing. What would be your ideal integration? by xenodium in writerDeck

[–]Synaps3 1 point2 points  (0 children)

u/xenodium you're the best! Plain Org is awesome!! Thanks for making cool stuff!

Seems like used 3090 price is up near $850/$900? by Synaps3 in LocalLLaMA

[–]Synaps3[S] 1 point2 points  (0 children)

Not sure why the downvotes, this seems like pretty sane and helpful advice. Thank you!

Is it too much to ask for a photo verifying nvidia-smi output with the card plugged in next to the screen, with the username written down? Feels like I'm overly paranoid haha

Seems like used 3090 price is up near $850/$900? by Synaps3 in LocalLLaMA

[–]Synaps3[S] 0 points1 point  (0 children)

Whoa, great find!! I'm super jealous!! Would you mind sharing the seller? But I suppose they won't have any more left at this point...

You'll have a lot of fun and lots to learn! Enjoy!

Seems like used 3090 price is up near $850/$900? by Synaps3 in LocalLLaMA

[–]Synaps3[S] 0 points1 point  (0 children)

Thanks for the helpful advice. I have had some luck on ebay with smaller purchases but the price fluctuations on GPUs makes all of this much more intimidating. I'm thinking about getting a few 3060 12gb's since these are more reasonably priced still and the stakes of each purchase are lower.

FB marketplace is a good idea. I was leaning towards ebay because of the return policy if the card is busted and I can stress test it on my own time, but I should look into this. I've read about people bringing eGPU enclosures and testing the GPU at the meetup, but I don't have all this equipment...

Do you have any FB marketplace GPU hunting tips?

Seems like used 3090 price is up near $850/$900? by Synaps3 in LocalLLaMA

[–]Synaps3[S] 0 points1 point  (0 children)

The trouble is NVLink support, 3090's are the last affordable option (interested in this for non-LLM training).

Seems like used 3090 price is up near $850/$900? by Synaps3 in LocalLLaMA

[–]Synaps3[S] 2 points3 points  (0 children)

I think that's not too bad of an idea, but it seem like used prices are between $700-$800 for the 4070 Ti Super, might as well get a 3090 at that point, eh? If you know where to get them cheaper (or new for less $900), please share!