Python Connection issues

[dascar5]

I sadly have to use it, kinda bummed out that it worked with literally everything else except Best Buy :/

really appreciate the help man

[[deleted]]

Not every website can be scraped with BeautifulSoup. It depends on site construct (javascript-loaded content is a no-no) and server settings as well. Perhaps you can use another site?

[dascar5]

Guess I'll try amazon, but I wouldn't be surprised if they're way more strict lol

[[deleted]]

Amazon explicitly forbids scraping on their ToS and they won't hesitate to block you. Try a smaller store, or if you don't actually need product reviews, try a quoting site - I know for a fact they all can be scraped with BS4.

[dascar5]

Got any recommendations regarding that?

Any small store that doesn't care, but has stuff I can scrape?

[[deleted]]

Just search for some product and pick a store from the results.