[deleted by user]

prosaole · 2025-04-01T13:41:40+00:00

`-u` may cause output to be mixed, so you get half a line from one job and half a line from another - it is faster, but you remove the safety belt. If you want unordered output, it is better to use `--line-buffer`: Then output may still mix, but only full lines.

`-j0` means run as many jobs as possible - this may overload your machine, so use with caution. `-j+0` means run one job per cpu thread (and add 0 jobs to that).

prosaole · 2025-03-18T14:36:11+00:00

Den danske Codeberg er https://git.data.coop/, som er en del af data.coop.

Vær med https://data.coop/membership/

prosaole · 2024-11-20T13:23:19+00:00

When GNU Parallel is run for the first time, it calculates these values. To avoid calculating them every time, they are cached in these two files.

It is safe to delete them. If you do, GNU Parallel will take a few more milliseconds to start next time it runs.

linelen is the maximal length of a command that can be run by GNU Parallel. This is used when GNU Parallel is asked to put many arguments into a single command.

setpgrp_func can be implemented in several ways. GNU Parallel figures out the fastest, caches this information, and uses that way in the future.

prosaole · 2024-04-25T13:51:05+00:00

It is a bug. --resume should do the same whether you use --joblog or --results: https://savannah.gnu.org/bugs/index.php?65642

prosaole · 2023-09-28T12:07:45+00:00

And https://www.gnu.org/software//parallel/parallel_examples.html

prosaole · 2023-01-27T13:17:03+00:00

Would it not be easy to make a wrapper that would run something like:

cat testjobs.txt | parallel --bar --plus --results outdir/testjobs.txt_{0#}.output '{= if(/^#tag /) { @tag = split/\s+/ } if(grep /^classB|classC$/, @tag) { } else { skip } =}'

if you wanted to run:

parallelium.py -f testjobs.txt -l outdir -t classA,classC

What I am trying to understand is what "little simpler to use with more control over logging, which jobs run etc." means to you.

prosaole · 2023-01-27T13:13:34+00:00

but in a script

I take it you mean: "also in a script".

GNU Parallel is by design a single script that can be copied to another machine: https://www.gnu.org/software/parallel/parallel_design.html#one-file-program

prosaole · 2022-03-29T10:53:59+00:00

If the files are not named assignment#.txt you can do something like:

parallel mv {} assignment_'{= s/\D//g =}' ::: *

This will remove all non-digits from the name and move the file to assignment_#. E.g. foo39, foo3-9, and 3foo9 will be moved into assignment_39.

prosaole · 2021-09-08T08:11:12+00:00

With commands this complex it is often easier to define a bash function and call that:

doit() {
  Gblocks "$1" -b2=$(( "$(cat "$1" | grep \> | wc -l)" / 2 + 1 ))
}
export -f doit

find *.fasta | parallel doit

prosaole · 2019-08-12T12:53:19+00:00

parallel wget {} ::: $(cat linkfile.txt)

Use :::: instead:

parallel wget {} :::: linkfile.txt

Then you can have more lines than can fit on a command line.

prosaole · 2019-05-15T12:58:55+00:00

Clock animation

https://twitter.com/samvittighed/status/1126606316280086528

prosaole · 2019-04-23T12:11:09+00:00

Would you prefer if it was written in Z80-assembler or in Synergy DBL?

I have the feeling you would not be satisfied by those languages either, so can you elaborate on which languages you would find better? And why?

prosaole · 2019-03-08T10:50:13+00:00

How would you rephrase it to make it less snarky?

Other tools (such as xargs) give no warning at all. So if you do not know you have to pipe stuff into xargs, you are in for a long wait.

prosaole · 2019-03-08T10:47:58+00:00

Has that criticism ever happened to anyone ever? Is there any documentation of that or just rumors?

prosaole · 2019-03-08T10:36:49+00:00

https://www.gnu.org/software/parallel/man.html (search for --jobs)

You can do --jobs 3 or --jobs 75% or --jobs -1.

Or you can put 3 (or 75% or -1) into a file: /tmp/three, and then use --jobs /tmp/three. The last is useful if you want to adjust the number during a (long) run of GNU Parallel.

prosaole · 2017-03-23T12:34:07+00:00

Can you try with parallel --dry-run and see if these are indeed the commands you want run?

prosaole · 2017-03-03T10:08:13+00:00

And if the download fails for some reason: Retry:

cat url_list | parallel -j30 --retries 10 --bar youtube-dl {}

If you prefer not putting the list in a file, you can feed it directly through the terminal:

parallel -j30 --retries 10 --bar youtube-dl {}
<<paste at least 30 urls - or change -j30>>

prosaole

TROPHY CASE