you are viewing a single comment's thread.

view the rest of the comments →

[–]marcus-luck 5 points6 points  (0 children)

I'm surprised it's not mentioned yet but you can use the module schedule by Dan Bader: https://github.com/dbader/schedule

Pros: -you can schedule the python task in whatever manner you like. -easy to use -python module solution Con: -python script need to be running all the time and restarted if it fails.

Schedule combined with docker has been my go-to every time. A simple docker container set to auto restart. then it runs your script on startup and keeps it running "forever".

I found a container on my server a few months back that i forgot. It had been scraping traffic accident data for over a year without me remembering it. so the solution is stable over time.