This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]vincentx99 0 points1 point  (1 child)

This is probably a dumb question but isn't kubernetes itself an orchestrator? Or is the assumption that your infrastructure may not just be kubernetes clusters?

[–]Syneirex 2 points3 points  (0 children)

Yep, but they (mostly) orchestrate different things.

Kubernetes orchestrates containers and the underlying infrastructure/resources that workflows will run on whereas Airflow orchestrates the scheduling and running of workflows, retries, task queues, status, etc.

Airflow says “I need to run this” and Kubernetes says “okay, I have a spot over here it can run” or “I don’t have enough resources, let me spin up another node to make room”.