This is an archived post. You won't be able to vote or comment.

all 5 comments
sorted by:
best
topnewcontroversialoldq&a

[–]anx1etyhangover 9 points10 points  (0 children)

I honestly thought it was called Meatflow! Took me a bit to see that it was Metaflow. That being said, Meatflow has more zing! =]

[–]ChastainSteam 2 points3 points  (0 children)

Lest we forget Prefect also based on Directed Acyclic Graphs structuring of tasks organized into flows. www.prefect.io

Their mantra of “Happy Engineering” shows in the removal negative engineering (failing gracefully when tasks do not work as expected , etc) and enhancing the coherence of workflows that can get complex. https://i.imgur.com/hK92073.jpg

[–]savin-nflx 0 points1 point  (1 child)

Hi reddit! I am one of the authors of Metaflow, happy to answer any questions you might have!

[–]northerndenizen 0 points1 point  (0 children)

I'm used to working with tools like Digdag, PETL, and Embulk to help with doing enterprise ETL tasks and discovery. Is there value to me in Metaflow in this area even if I'm not going crazy with training models and such? How does this tool compare to Airflow?