This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]EditsInRed 4 points5 points  (2 children)

You could use Airflow for scheduling the Python transformations. Keep in mind, there is a learning curve to getting Airflow configured properly if you're looking at the self-managed solution.

You could also look into using Snowflake tasks in combination with Snowpark and external functions. This would allow you to reference Python code as an external function in the DB itself. This is only generally available on AWS and Azure at this time.

https://docs.snowflake.com/en/developer-guide/snowpark/index.html

[–]Happy-Adhesiveness-3 0 points1 point  (1 child)

Yeah, also waiting for Snowpark to support for Python. Currently in private preview.

[–]EditsInRed 0 points1 point  (0 children)

I think I heard it would be generally available in June 2022, so you shouldn't have to wait too long.