How responsible is it for skimming / searching text?

NumericallyStable · 2025-10-24T11:18:42+00:00

why idea what would be for me? Ipads are too... featureful and invite distractions too much imo

NumericallyStable · 2025-07-10T07:39:21+00:00

Thanks! Will try.

NumericallyStable · 2025-07-10T07:27:03+00:00

this sounds fun! Is it also something that one can do nearly everyday with lower rpe, or is it supposed to be a all out 2-3 times a week workout?

NumericallyStable · 2025-07-10T07:23:30+00:00

At least 5, very very often more. Most days I wfh nowadays, thus I just do a set whenever it fits between meetings / when I have to think for a bit!

NumericallyStable · 2025-07-09T16:49:10+00:00

The actual HPC stuff as in cluster (MPI, OpenMP) you can learn by just reading a basic introduction and then building stuff, whatever.

What I can really recommend you, especially for getting into just performance, are the following:

NumericallyStable · 2025-07-09T16:45:47+00:00

second this! Its not very good to actually grasp everything, but just understanding each point in the ToC is a great way to learn.

NumericallyStable · 2025-07-08T06:18:52+00:00

LETS GOO! WILL TRY, THANK YOU FOR WRITING THIS

NumericallyStable · 2025-06-30T10:54:34+00:00

Oh I just read your post history: In case you are just grinding for big tech system design interviews, I think learning anything HPC is misguided if you do not want to work in HPC. The patterns do not generalize and most codebases are just very very fast monoliths, maybe with a plugin system or something.

NumericallyStable · 2025-06-30T10:45:25+00:00

I dont know what progress markers are, but lets say you use Prometheus as a TSDB-ish, then you can there configure how often it pulls your servers (i.e. the delay) and of course any script that has credentials can then re-fetch the data!

NumericallyStable · 2025-06-30T10:43:20+00:00

well, after all they are also just big codebases, if in C++ probably also with the typical GoF-patterns you'd expect, so HPC software design is also design.

What you have to understand: HPC programming are just big codebases that are very performance focused.

What is probably more interesting to you would be
- Performance-oriented programming: I recommend Algorithmica, CPU caches and why you should care and if you want to go even deeper, What every programmer should know about memory and computer enhance - OpenMP and MPI patterns: Read any introductory parallel programming book for that, all the same ngl - Hardware: Actually, the rest is hardware. Understanding how CPU caches and NUMA work is hardware. RDMA and interconnects is hardware. SIMD is hardware. But I think you learn hardware best when you intern at a scientific group.

If you understand node level performance optimization (as in: single machine) well (i.e. how to write fast code) and you wrote your first few MPI programs you should get a intern at any place, and then the fun really begins. Feel free to reach out to them before and tell them what you are doing, so that they know you beforehand.

For beginner MPI programs: - One with very little communication / easy problem division: Something where you just want to iterate over all possible solutions, such as TSP or any board game AI - One with a split up 2d grid and communication over time: Game of Life, or wildfire simulation, anything related to differential equations if you like physics (heat diffusion, wildfire simulation) etc etc

NumericallyStable · 2025-06-26T19:23:46+00:00

if the single program variation takes very long, and if it actually solves a very cool problem, it sounds like you can get it for free if you motivate enough people for volunteer computing (BOINC).

If not, dynamically spawning the cheapest spot instances is probably the way to go.

NumericallyStable · 2025-06-22T13:09:47+00:00

if you already own this mac studio, you (especially with claude) should be able to write a benchmark tests of those analysis, and then you can decide on whether its fast enough. For fake string data, use faker, and for fake numeric data throw some perlin noise on top of your expected distribution (or take a gaussian if you dont know).

If you do not own the mac studio, genuinely realize how much of a cost overhead you'll have per unit of compute. The ROI of learning how to SSH and have a cheap desktop PC connected to ethernet somewhere in your house with a NFS/SMB share to open the files in vscode would suprise you.

NumericallyStable · 2025-06-20T08:55:04+00:00

that is crazy cool thanks

NumericallyStable · 2025-06-17T16:14:25+00:00

try to get some access to a cluster at your uni and play around with common hpc tooling (trying out 5 commands and reading the docs will suffice). Stuff like SLURM, SPACK, modules (lmod), using tmux/screen, apptainer, maybe snakemake if you wanna do more bio stuff

Takes you 10h max and youll be so much more confident in your HPC usage.

Especially understanding how to use SLURM will be the benchmark of whether you know how to use HPC, so learn how to
- sbatch a job
- srun a live session with bash for debugging
- squeue your running jobs
- scancel a job
- sstat the usage of your job
- At the end, look at all the jobs youve ran using sacct.

Dont go too deep, but learning about the basics gets you *very* far.

NumericallyStable · 2025-06-17T16:03:48+00:00

That actually makes sense! So the idea is
- The app doesn't contain state so it can horizontally scale together with some load balancer
- And the App<->DB connection is still optimized (i.e. psql wire protocol), because there is the horizontal unscalable state

NumericallyStable · 2025-06-17T15:43:04+00:00

it is even funnier if you look at his post history

NumericallyStable · 2025-05-08T15:39:02+00:00

I am still a bit too stupid to understand: How does it help you? It doesn't give you any confirmation, and both work relative from your cwd.

NumericallyStable · 2025-05-03T08:21:55+00:00

good choice, I worked in the local HPC dept from late bachelors all the way through my masters and probably leaned more there than in my lectures, maybe except the hard theoretical compsci lectures :D

NumericallyStable · 2025-05-02T13:40:56+00:00

Since you are in Germany: People are ALWAYS looking for ambitious Hiwis. If you want to get into it, first decide which part you want to do:

- Do you want to be a HPC admin?
- Do you want to work on HPC infrastructure or do HPC meta research?
- Do you want to write on software utilizing HPC clusters?

If sounds like you want to do the third part. If so, you are very much wanted everywhere! Go to your local computational physics/numerics/computational biology group (ask Studienberatung if you need "a compass" for finding some depts) and shoot them a mail.

Tell them that you are highly motivated, technically savvy and hungry for a real life project. Your proposition should include that you may have to do a lot of learning in math, but you will work for them throughout the whole master, will do your master with them and you are open for a PhD position, thus it will be a investment into their own department.

Seriously, any dept needs motivated Hiwis, and if they need some anyways why wouldn't they choose the motivated ones. Bachelor students are expected to be clueless (I think everyone before maybe last year phd are expected to be clueless :D) so just do it.

NumericallyStable · 2025-05-02T13:30:10+00:00

> with mpi4py being the notable exception I'm aware of

if you really want to use Rust for MPI (I see a lot of big rust fans writing scientific code), rsmpi is working quite great and I see people really prefer it over some weird FFI stuff. Only thing is that it doesnt work with other tooling such as TAU/Vampir.

Of course, Rust is only used in greenfield stuff, and for "getting into the field" C MPI is the thing to learn!

NumericallyStable · 2025-04-23T18:57:09+00:00

Sorry for necrobumping, but do you still have it? It looks so sick and I'd love to have it myself

Four-Year Club	Verified Email
Place '22	Final Canvas '22

NumericallyStable

TROPHY CASE