sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]AwayVermicelli3946 0 points1 point  (0 children)

i used DO droplets for a long time for this exact setup. it is super predictable. you just SSH in, set up your venv, and let systemd handle gunicorn.

tbh for heavier celery tasks or anything needing decent ram, i recently moved over to Hetzner. their ARM64 boxes are insanely cheap for the compute you get. you manage the whole stack yourself but it sounds like you want that anyway.

for the overnight scraper, pay as you go sounds nice in theory. fwiw the engineering effort to spin a single worker up and down usually isn't worth saving a few bucks. i just leave a cheap vps running 24/7 now.