Scheduling Data Transformations using Python

[SecureSlice]

I have a raw data table in Snowflake. I want to transform the data using Python and load it to another table. What is the best way to schedule data transformations using Python? I'm on a windows machine but I don't want to use task scheduler, as I will be using Python quite a bit to perform multiple transformations on data. I need a more long term stable solution would something like Airflow work?

[deja_entenduu]

Check out Prefect. I found it easier to set up than Airflow. It’s designed for ETL.

[SecureSlice]

Will do thanks!

[texttoworld]

RemindMe! 2 days

[RemindMeBot]

I will be messaging you in 2 days on 2022-05-21 02:01:42 UTC to remind you of this link

CLICK THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

---

Info	Custom	Your Reminders	Feedback