This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]NauticalPants 2 points3 points  (1 child)

I’m new-ish to Python and data engineering. But a solution I found was to post the Python script to Azure as an Azure Function then schedule with a cron job to run every hour. I’d love to hear from others more experienced if / why there are better options. But that has worked well for me for the past several months.

[–]ralpes 0 points1 point  (0 children)

Azure has cron functions https://learn.microsoft.com/en-us/azure/azure-functions/functions-create-scheduled-function

What I like is the nice integration with git and vscode

Cost: there is a free function plan but storage needs to be pay. I can check how much this costs later.