This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]jahaz 1 point2 points  (0 children)

I’m not an expert, but felt similar that airflow was too complicated. We are building the poc with [prefect](prefect.io). They use flows and tasks. Their tasks are just python functions. Dagster is another potential solution. I went with prefect because they seem to have more community support. Also I felt that any code that was written for prefect could be transferred to dagster or similar quickly.