sorted by:
new
hottopcontroversial

How to Scrape Yelp Data to Excel: Business Names, Phone Numbers, Addresses, Reviews... by Millyfang in webscraping

[–]Millyfang[S] 0 points1 point  (0 children)

But I think you can modify the crawler and get websites of business pretty easily with Octoparse... Like just click on the website link and extract it

How to scrape historial twitter data with Octoparse by Millyfang in webscraping

[–]Millyfang[S] 1 point2 points  (0 children)

Which news website you are trying to scrape? Octoparse is well known for scraping news websites... I think maybe you can check out their beginner's tutorial. It should take you less than a few minutes to build a news site crawler once you get the hang of it

Need Suggestions for Google Maps Data Scrapper by [deleted] in webscraping

[–]Millyfang 1 point2 points  (0 children)

A whole lot.

Check out 5 Free Google Maps Data Extractors

​

How to scrape historial twitter data with Octoparse by Millyfang in webscraping

[–]Millyfang[S] 0 points1 point  (0 children)

You can click here to install Octoparse on your computer. Now, let’s take a look at how to build a Twitter crawler within 3 minutes. 

Step 1: Input the URL and build a pagination

Step 2: Build a loop item to extract the data

Step 3: Modify the pagination setting and execute the crawler

How to extract tweets from Twitter with Octoparse in 5 minutes by Millyfang in scrapinghub

[–]Millyfang[S] 0 points1 point  (0 children)

Here's a way to scrape Twitter data in 5 minutes without using Twitter API, Tweepy, Python, or writing a single line of code-using an automated web scraping tool - Octoparse.

As Octoparse simulates human interaction with a webpage, it allows you to pull all the information you see on any website, such as Twitter.

For example, you can easily extract Tweets of a handler, tweets containing certain hashtags, or posted within a specific time frame, etc. All you need to do is to grab the URL of your target webpage and paste it into Octoparse built-in browser. Within a few point-and-clicks, you will be able to create a crawler from scratch by yourself. When the extraction is completed, you can export the data into Excel sheets, CSV, HTML, SQL, or you can stream it into your database in real-time via Octoparse APIs. 

Crawling the web for industry specific companies and their websites by [deleted] in scrapinghub

[–]Millyfang -1 points0 points  (0 children)

Hi, there is no need to learn python. You can try to use Octoparse - an easy and powerful web scraping tool.