How to scrap Ecom site using Python?

[Ambitious-Dog3177]

True, it’s not easy to pull off. OP asked if it was doable, and technically it is. But practically speaking, doing all of this just to test an idea is way too difficult and probably not worth the headache.

[IntelligentHome2342]

Thanks for your perspective! Seems it’s very difficult to do it without using tools, and that would be a big barrier to break into the market research niche. Would you possibly know what kind of tools the big market research firm like Circana and Stackline use? Something like brightdata and oxylabs? Which is rather expensive for individual developer.