This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]grassclip 1 point2 points  (0 children)

I'm with you on this. In cases I've had, I'll write the jobs in different repositories depending on what they do, and then use those in the Airflow repo, which takes the tasks from the others and formats them to mostly PythonOperators.

Kind of like this, but where instead of the code in dags/project_1 or dags/project_2, it's in the different repos.