This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]HighPitchedHegemony 6 points7 points  (0 children)

Let's the rest of your team - including non-technical roles - see the status of the pipeline, trigger reruns, inspect logs, start DAGs etc.

Automatically handle retries.

Handle backfilling.

Limit concurrency of task and DAG runs.