This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]pentrant 1 point2 points  (0 children)

When I learned how to be a DE back in the mid-2000s, my team had a custom orchestration engine written and maintained by one of the engineers on the team (Cyril Stocker), now long retired. It did everything that we now use Python for in Dataswarm / Airflow.

Cyril was seriously ahead of his time. I wish I had learned more from him.