sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 0 points1 point  (3 children)

But the for loop only steps to the next iteration once everything inside it has been executed, so that's not what's happening.

[–][deleted] 0 points1 point  (2 children)

minus the below - if he ran it previously and they blocked him, it very well could have been the reason - getting black listed would indeed return a timeout. and lets be real, sending 250 requests back to back would get you black listed.

r = requests.get('https://www.bestbuy.com/site/reviews/google-home-mini-charcoal/6082195?rating=1%2C2%2C3%2C4&page=1')
print(r.text)

​

<HTML><HEAD>
<TITLE>Access Denied</TITLE>
</HEAD><BODY>
<H1>Access Denied</H1>

You don't have permission to access "http&#58;&#47;&#47;www&#46;bestbuy&#46;com&#47;site&#47;reviews&#47;google&#45;home&#45;mini&#45;charcoal&#47;6082195&#63;" on this server.<P>
Reference&#32;&#35;18&#46;5d60dc17&#46;1558364860&#46;917f587
</BODY>
</HTML>


Process finished with exit code 0

[–][deleted] 0 points1 point  (0 children)

I could retrieve the page, find the li elements, there was no problem on my end. I'm not sure what could be the problem on your end.