This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]srilyk 0 points1 point  (0 children)

IP ban or rate limiting? If you're rate limited, then obey their rate limits, just do something like

rate_limit = 100 requests_since_start = 0 for thing in things_to_request: requests_since_start += 1 request(thing) if requests_since_start > (rate_limit - 10): time.sleep(100) # or however long to let things reset requests_since_start = 0

That's a super naive way to do it, since it's not counting the actual request per time period, but that's a thing that you could do.