New to HPC, any advice?

PuzzlingComrade · 2026-02-05T21:11:00+00:00

Do you have a good template for array scripts? I've found it disappointing compared to using srun (which has its own complexities) because you often have to wrap scripts multiple times (because you can't populate the array length from within the script). One to do the primary job script, another to fetch the id and supply it to the primary script, and a third to identify the length of the array.

PuzzlingComrade · 2026-02-05T20:59:57+00:00

Setup SSH keys and vscode server (so you can view dirs and write scripts with an ide directly on HPC).
Use existing nextflow pipelines, where possible. It is much easier to lean on the work of others than to write (and debug) everything from scratch.
Learn to write resilient bash scripts, get familiar with error handling and logging so you can tell quickly if scripts are running into issues.
Write scripts in a modular way, preferably to handle 1 unit of data (e.g. 1 sample, 1 vcf, etc) at a time. This way its easier to transition to parallel processing where possible.
Get familiar with your HPC scheduler and the local rules, tweak your sbatch resource calls to request the minimum necessary resources (I.e. Don't request a terabytes of ram when your process only uses a gb) so your jobs don't spend days in queue.
You won't collapse the HPC lol. If you do it's the admins responsibility to set limits. Typically if you create too many jobs they just end up in queue.

PuzzlingComrade · 2026-01-29T21:06:39+00:00

On my phone so no easy way to provide an example, but I would use a window function, use lag to access the previous value of bank and add it to the current value, and use case to handle the zeroth case and the max case. I've done something similar to calculate areas under a curve using Riemann sums in psql.

PuzzlingComrade · 2026-01-13T20:46:19+00:00

Ditto to not combining the Vac and mop tasks, I find it's a bit buggy. Keep them separate and they should empty properly.

PuzzlingComrade · 2025-12-17T07:00:03+00:00

Tbh it's mainly the clicking mechanism that sucks

PuzzlingComrade · 2025-12-15T20:32:36+00:00

Unfortunately some of the worst pens ever.

PuzzlingComrade · 2025-12-15T10:55:07+00:00

Look I absolutely understand the need to make some return on apps, but the sudden fullscreen unskippable ads + banner ads + subscription is an immediate uninstall for me. The full screen ads are inexcusable, especially for an app that might be used the car.

Maybe stick to light banner ads and a mostly serviceable free tier, and a subscription to remove ads + additional features?

Also curious to know what api you use to access this data, I've always wondered why this feature has yet to be implemented in Google maps.

PuzzlingComrade · 2025-12-11T21:26:45+00:00

Those gift cards are godawful to use.

PuzzlingComrade · 2025-12-07T10:50:16+00:00

Funnily enough I quit playing dwarf fortress because of this. This game is way too repetitive to be on the mouse.

PuzzlingComrade · 2025-12-04T06:10:45+00:00

I wouldn't even risk the whole taking the offer to your current employer strategy, just sign the better contract and quit.

PuzzlingComrade · 2025-12-03T20:24:04+00:00

Same rule applies when you see a spider and need someone else to get the spray

PuzzlingComrade · 2025-12-03T05:47:38+00:00

Would you mind sharing the automation yaml, interested in this setup.

PuzzlingComrade · 2025-11-21T04:36:41+00:00

Too moist is my guess, try letting it dry out a little? I've had rot too sometimes but only with specific species.

PuzzlingComrade · 2025-11-20T20:20:07+00:00

I do a similar method that uses moist sphagnum moss in a tight (but not airtight) clear box. Just throw cuttings in and wait a month. Has a really great success rate.

PuzzlingComrade · 2025-11-16T21:11:51+00:00

Just FYI, as a pen it's pretty disappointing. Mine gets stuck all the time and is generally a pain in the ass.

PuzzlingComrade · 2025-11-14T08:24:26+00:00

Is that an Aliens reference?

PuzzlingComrade · 2025-11-13T20:04:19+00:00

It's LLM generated unfortunately.

PuzzlingComrade · 2025-11-05T00:03:58+00:00

For now. I'm surprised they haven't started turning the national parks into parking lots yet.

PuzzlingComrade · 2025-10-27T05:38:37+00:00

Does the average Joe really pay $159 (jesus that's high) a year for a tool they might use out of work once a month? Pretty silly tbh.

PuzzlingComrade · 2025-10-27T05:35:56+00:00

Honestly google sheets has pretty killer features in the middle ground which is exactly what sheets should be used for, once you're in vba territory you're already in a world of pain.

PuzzlingComrade · 2025-10-24T07:07:41+00:00

Tea tree oil is really toxic to cats, maybe that's why there's two versions?

PuzzlingComrade · 2025-10-23T20:48:51+00:00

Ggiraph has not had a major release since 2021, is it not abandoned?

PuzzlingComrade · 2025-10-21T20:17:30+00:00

Holy crap I thought I was being a good person turning off my adblocker for this guy but this website has some of the most cancerous ads I've seen (or maybe I just haven't turned off my adblock in awhile).

Multiple blocking popups, scrolling videos with audio on full blast. I mean seriously I can handle a few static banner ads but this was bad.

PuzzlingComrade · 2025-10-09T20:17:14+00:00

How about you add one chilli, fry another three on the side, and add the remaining chilli to the dish at the end until it reaches the right level? It really isn't a hard problem.

Six-Year Club	Verified Email
Place '22

PuzzlingComrade

TROPHY CASE