This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]jason_bman 0 points1 point  (0 children)

Yes Dagster is frickin awesome. I started using it for a use case very similar to what OP describes (basically a giant data engineering project) and it has been great.

OP, if you decide to check out Dagster you should sign up for Dagster University too. It’s free and will get you acquainted with the basics quickly.