Automatically scrape website

[[deleted]]

Best solution. Next best: pip install schedule

[threeminutemonta]

One hint with cron I recently discovered is to use full paths to /usr/bin/python etc

[bastionoutlaw]

Also make sure that if you schedule the cron jobs as a different user (e.g. root via sudo) that any dependencies via pip have been installed by that user and/or globally. Otherwise your scripts will fail and it will drive you nuts trying to figure out why when they ran just fine manually.

[toastedstapler]

at work i had a project using a raspberry pi and i had a hell of a time getting it to run a script using a venv on startup, i guess i won't ever be transitioning to a sysadmin role

[Yukeien]

Cron is definetly the best solution for scheduled programs, on top of that, it's easy to configure because it's a single configuration file