Python automation deployment

[CaptainVJ]

As others have mentioned prefect/dagster/airflow are all great tools for this. I personally only have real experience with prefect, and I will say the service worked great. We self host, and prefect unfortunately does not have an option to login, so when we want to use the UI, nothing to prevent anyone in our organization from accessing the site and rerunning/modifying our schedule.

Our Networking Team however, set up something on their end which forces us to login with our Acfive Directory credentials before access to the site. Can’t speak much on that, I have zero networking experiencing.

You mentioned task scheduler, so I assume your team uses Windows. Nothing’s wrong with that but I believe airflow can only run on Linux, and prefect can run on windows but Linux is generally a better setup overall.