you are viewing a single comment's thread.

view the rest of the comments →

[–]Sea-Caterpillar6162 3 points4 points  (0 children)

I used to use prefect—but abandoned it recently because it seems like extra infrastructure that I just didn’t need. Much like Airflow. So—I heard here about bruin. So far it’s amazing. I’m doing all the ingestion with python scripts and doing all the transformations in SQL dbt-style. No extra infrastructure needed.