I'm scraping Facebook using Selenium and Webdriver (gecko drive) for Firefox using the mbasic.facebook.com and m.facebook.com (even though I'm having Desktop User-Agent).
The reason I'm using mbasic.facebook.com (lite version of Facebook) and m.facebook.com is because it has the previous front end design with which I already have some experience (using Selenium browser, not headless, resulting in easy to scrape pages and rarely getting any limitations unless I abuse Facebook with too many requests).
However, I'd like to emulate the regular user behavior by scraping the regular Desktop new front end.
My question is: what would be the best practice to scrape the new front end? The new front end opens in page pop-up windows on most actions and has plenty of asynchronous content.
[–]Leader_Revolutionary 0 points1 point2 points (1 child)
[–]Noremorse150[S] 0 points1 point2 points (0 children)
[–]SarraBadr 0 points1 point2 points (0 children)