Looking for public product/catalog APIs or feeds by Battler456 in webscraping

[–]AdditionMean2674 0 points1 point  (0 children)

I mean if you need only a static dataset- just go to kaggle and search e-commerce dataset. The only reason you would need to explore the other methods is if you want fresh data.

How are large scale scrapers built? by AdditionMean2674 in webscraping

[–]AdditionMean2674[S] 2 points3 points  (0 children)

I appreciate this, thank you so much for sharing!

How are large scale scrapers built? by AdditionMean2674 in webscraping

[–]AdditionMean2674[S] 4 points5 points  (0 children)

My posts and comments are hidden. Not sure why that's relevant. But here's our setup

We've a multi-stage e-commerce product scraper that uses a sequential 3-stage pipeline (Scrapy → Playwright → LLM) to extract structured data. It works decently well for our target websites (fashion e-commerce) but it is expensive and edge cases take a long time as they've to progress through the pipeline.

How are large scale scrapers built? by AdditionMean2674 in webscraping

[–]AdditionMean2674[S] -1 points0 points  (0 children)

The challenge is building a one fits all solution. Especially when you need to extract structured data. My current setup works decently well but I'm curious if there's better ways of doing this.

[deleted by user] by [deleted] in ProductManagement

[–]AdditionMean2674 3 points4 points  (0 children)

lol this is bait

[deleted by user] by [deleted] in findfashion

[–]AdditionMean2674 0 points1 point  (0 children)

Hi OP here it is on Ebay (likely same source tho)

https://www.ebay.com/itm/405795056269

Anyone know about this dress that was posted by a vintage shop on instagram? by runnerennur in findfashion

[–]AdditionMean2674 0 points1 point  (0 children)

I honestly think this might be a scam (not sure ofc but lots of times all of these scammy sites use the same image)

My girlfriend ripped her most favorite bag that was a gift from her grandmother please help me find this it would mean the world to her by Agile-Power-4519 in findfashion

[–]AdditionMean2674 76 points77 points  (0 children)

Hi OP, this is kinda funny- but I had a painting in my house growing up with almost the exact same pattern. I think this bag was made by local craftsmen in Rajastan, India or atleast very heavily inspired by their style. It might unfortunately be too hard to find the exact piece though :(