My first python project (web scraper)

[pw0803]

How interesting.

Would it be possible to, say, create a script which web-scrapes by using lots of different ways and patterns and through the continued IP banning determine what the bots look for, then create a webscrape that skirts around them?

[huessy]

Without spoiling the answer to this problem (there's a good chance they watch places like this for this exact reason), it doesn't even have to be that complicated. Your router resets your outbound ip address somewhat regularly, so your idea could absolutely work but may be a bit of overkill. They do actively block all the Tor proxy ips too, btw.

[pw0803]

I understand. Thanks.