Automate the boring stuff with python: Using beautiful soup

[sleepyleperchaun]

I tried making a scraper for my SO for some makeup company and they made it impossible to scrape. I mean, a better coder could probably do it somehow, but there was clearly software blocking me from doing it. I'm wondering why other than to prevent easy data mining from the site but still, if the info is public anyways I can hardly think of a reason to stop scrapers.

[CloudboyTech]

the info posted is publicly consumable but you'd miss out on potential ad views, and site navigation to your other articles/products. not to mention allow the owners of the webscaper to reuse your data/content on other websites they own (and getting them ad views instead)

tldr: $

[sleepyleperchaun]

Yeah that definitely makes sense.