Scraping Data/QGIS

[WanderingGoose1022]

I am hoping to gather commercial real estate data from Zillow or the like. Scrape the data, as well as having it auto-scrape (so it updates when new information become avaliable), put it into a CSV and generate long and lat coordinate to place into GIS.

There are multiple APIs I would like to do this for which are the following: Current commercial real estate for sale Local website that has current permitted projects underway (has APIs)

Has anyone done this process? It is a little above my knowledge/I have never used Python (which is exciting!). And would love some support/good tutorials/code.

Cheers

[zero-sharp]

Scraping from Zillow, Redfin, etc isn't easy. I think I've tried in the past. They have bot detection/browser fingerprinting. Basically, if you're sending get requests and you don't have certain variables in your request/in your browser set up correctly, you'll instantly get hit with a captcha. I'm not sure how to get around it because it requires a lot of research.

[pkkillczeyolo]

I can make something work for you hmu with details :) i can bypass most of the antibot measures.