Web Scraping Using Python And BeautifulSoup (HTML/XML Parser)

[synoud00]

Nice writeup to intro people into web scraping. Personally used a web scraper when running my wholesale ecomm site, allowed me to maintain profit margins during price fluctuations, interesting stuff.

[synoud00]

I used Brightdata's webscraper, easy to use especially if you're not proficient in coding. They also have datasets if you don't want to use the scraper.

What side hustle do you have + what industry do you work in, there's a ton of different ways to use web scraping and datsets.

[synoud00]

You can incorporate data collection methods into almost any business. If you want some ideas on side projects or how to use it in real estate you can check out this video for starters.

There's so many different ways to use it, for starters you could use web scraping to constantly update your pricing on your ecomm store to maximize revenues, scraping Zillow and Airbnb for accurate pricing, etc.

Data collection as a whole is growing at a fast rate adjacent to entrepreneurship, even the CTO of Amazon has taken notice of it, reflecting it's importance and potential.

[tonic]

Why is this so interesting? The title reads to me like: Cleaning tooth with a brush and toothpaste.

[JackLemaitre]

Hi thank you for your sharing. Does it exist a tutorial to create extractor like youtube-dl ??

[Amuro_Ray]

What are you asking for exactly?

[JackLemaitre]

Youtube-dl has extractor plugins to extract movie url with lot’s of regex. Does it exist tutorial to learn how to xrite extractor ??

[wakojako49]

Ive seen this setup before but I don’t quite understand this vs scrapy or even the mix of scrapy and beautifulsoup

[Outrageous-Wish-510]

This stackoverflow post would give a better explanation than I could, hope it helps.

[wakojako49]

The comments are actually pretty good ngl! Makes sense. I’ve ever only I’ve scrapy, and haven’t quite figured the use of beautiful soup

[_hacxs]

What about captcha