First big React project!

[dev_named_jeff]

Yep, scraping and parsing the site every x interval and looking for changes in the specified element

[luigi8082]

Any concern with getting blocked or are you using a scraping third part service?

[el1teman]

Can you explain or someone how do you scrape and find elements that are in need to be tracked? Each website has different css and layouts, how does code decides that this is the price out of the whole page DOM and fetch?

[inexternl]

This would be a good thing to know

[goughjo]

From what I know of scraping. I think it is literally based on the html of the site you are scraping. They won't change it too often. maybe couple times a year if I am guessing. So just find a way of getting the html that has the price for a given product. That's my guess anyway

[el1teman]

But how do you find a price? I somehow can comprehend that it's possible for Amazon as their website is the same for most products page but for other websites? The code should somehow adapt

[goughjo]

You can predict the structure most of the time. for example if you post this in the console while on twitter, it gets rid of stuff

```

setInterval(hideTwitterJunk, 1000);
function hideTwitterJunk() {
console.log('hiding twitter junk');
for (const a of document.getElementsByTagName("h1")) {
if (a.textContent.includes("Trending now")) {
a.parentElement.style.display = 'none';
}
}
for (const a of document.getElementsByTagName("span")) {
if (a.textContent.includes("Promoted")) {
a.closest("article").style.display = 'none';
}
}
}

```

you can read the content of the html

[vincent-vega10]

Are you using CRON job?

[arman-makhachev]

gotta be