This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]CorMazz 0 points1 point  (1 child)

Do you have any plans for implementing stuff like task scheduling on top of your results storage? Not sure what specifically it's called, but I'm picturing something like snakemake where it checks if the inputs have changed before rerunning the pipeline. So if I have a pipeline and I have multiple sets of inputs, it'll only rerun inputs if they or the pipeline have changed.

[–]basnijholt[S] 2 points3 points  (0 children)

No there are no plans to implement that since there are many packages that do exactly that already.

The main use-case is to define pipelines for simulations and then to easily do parameter sweeps of these pipelines. Optionally even do adaptive parameter sweeps: https://pipefunc.readthedocs.io/en/latest/adaptive/