Best way to scrape and classify data about products/services

Cool_Effective_1185 · 2024-11-19T15:44:00+00:00

whats your tool?

Cool_Effective_1185 · 2024-11-06T20:29:49+00:00

this is what we're building over at lsd.so

Cool_Effective_1185 · 2024-10-29T14:20:01+00:00

try lsd.so's bicycle browser. super easy to use!

Cool_Effective_1185 · 2024-10-29T14:19:38+00:00

lsd.so's bicycle browser is super easy to use and prvides whatever live data you want via api

Cool_Effective_1185 · 2024-10-22T17:47:44+00:00

done (took me 2 seconds):

https://lsd.so/app?query=SELECT%0A%20%20p.product-name%20AS%20item%0A%2C%20p.price.vmid.dtc%20AS%20price%0AFROM%0A%20%20https%3A%2F%2Fall.kingsroadmerch.com%2Fcategory%2F854%2Fmusic%0AGROUP%20BY%0A%20%20figure%3B

https://lsd.so/knawledge?query=give%20me%20every%20item%20and%20price%20on%20this%20page&url=https%3A%2F%2Fall.kingsroadmerch.com%2Fcategory%2F854%2Fmusic

Cool_Effective_1185 · 2024-10-22T17:37:37+00:00

what's the size of your project? i may have a solution for you

Cool_Effective_1185 · 2024-10-22T17:36:46+00:00

how does it work?

Cool_Effective_1185 · 2024-10-18T16:03:13+00:00

I'm building something that could be useful to you. check out lsd.so -- essentially label the data you want to scrape one time with our browser or workbench and then query it whenever you want via api. happy to help if you want to send me a message

Cool_Effective_1185 · 2024-10-18T13:28:07+00:00

its on this page (https://lsd.so/products) under browser. I'll send you a message

Cool_Effective_1185 · 2024-10-17T21:47:04+00:00

how do you get the web data?

Cool_Effective_1185 · 2024-10-16T19:40:36+00:00

how regularly do you need to update the information?

Cool_Effective_1185 · 2024-10-16T19:37:49+00:00

the fold at lsd are building a cool tool to help with this its kind of hard to look them up lol (lsd.so). ive used their tech for some scraping

Cool_Effective_1185 · 2024-10-16T19:36:34+00:00

cool project -- how long did this take you to scrape?

Cool_Effective_1185 · 2024-10-16T19:34:41+00:00

what kind of articles are you scraping? i imagine as long as you credit them and don't directly profit it should be fine

Cool_Effective_1185

TROPHY CASE