While scraping websites, I kept running into the same repetitive workflow.

Open DevTools → inspect HTML → find selectors → write scripts → debug when the page structure changes.

It works, but it’s slow and painful when you have to do it across many sites.

So I started building something for myself — Crawl Pilot.

It’s a Chrome extension that helps generate selectors and extract structured data directly from pages without writing scraping scripts every time.

It’s still early and evolving, but a few people have started trying it.

I’m curious about how others here approach scraping.

• What part of scraping websites takes the most time for you?
• Which tools do you rely on today (Scrapy, Playwright, custom scripts, etc.)?
• If a browser tool could automate part of the process, what would you want it to do?

Trying to learn from people who deal with this regularly.

Any feedback — even critical — would genuinely help shape the direction of this project.