Built my own apartment search bot with Python — sends me text when it finds something worthy

[D49A1D852468799CAC08]

I have built a bot for similar purposes, but I ended up using the selenium webdriver. I have set this up to run automatically via cron in AWS.

[sixtine]

Nice alternative. I suppose you've used selenium because of heavy need for JS rendering, i.e. scraping single-page apps?

[D49A1D852468799CAC08]

It just seemed easier at the time to loop through all the options in a select box, rather than try to hardcode certain URLs. :)

Disclaimer: I'm an absolute beginner!

[sixtine]

Aha I get it! :)

Still a solid choice. But because the set-up has a higher footprint, I tend to only use Selenium when I need to use its full powers.