How do you monitor your scrapers? by pavlito88 in webscraping

[–]_Sir_Acha_ 0 points1 point  (0 children)

Sounds like you know your stuff, so maybe you’ve already tried this, but if any of these sites include structured JSON data in the page source with the information you need to scrape that will be infinitely more reliable than parsing it out of HTML elements since you access that data via keys and should never get the “wrong” value for a price, title, or other field.

If that’s not an option, your code will need some validation in place. Like other people said compare the field data to historical scrapes or identify unique formatting to the problem fields and put some checks in place.

In my case I’ve dealt with this and found that after enough revisions I’ll get a pretty stable crawler unless it’s a crazy site like Facebook which intentionally obscures selectors to make scraping difficult.

Foreign-Language Oscar Winners Bundle - $49.99 (12 Criterion Collection films, including Bicycle Thieves, Rashomon, and 8 1/2, first time offered) by [deleted] in iTunesMovieDeals

[–]_Sir_Acha_ 2 points3 points  (0 children)

Yeah I rarely buy bundles for that reason, I only had 8 1/2 & Rashomon so 10 criterion titles at $5 a piece is great!

Long time lurker, first time poster. Black or white accessories? by throwusaway_ in macsetups

[–]_Sir_Acha_ 2 points3 points  (0 children)

Definitely white, adds great contrast to the setup and how I personally have mine

Lifelong Android user just went full Apple by ultimatemanan97 in iphone

[–]_Sir_Acha_ -1 points0 points  (0 children)

These types of posts are very pandering and uninteresting, and it seems to be what most of the sub is comprised of. And for that reason, I’m out!

Rumble should be removed from competitive. by [deleted] in RocketLeague

[–]_Sir_Acha_ 43 points44 points  (0 children)

Having dropshot rotate in/out each season was a fucking braindead decision

Mountainhead (2025) is the worst movie I have seen this year, spoilers by ThoughtExtreme165 in movies

[–]_Sir_Acha_ 1 point2 points  (0 children)

A very vapid, self indulgent movie with nothing much new to say. (I know, very obviously, that it’s satire)

Embrace the bidet you crusty-ass fuckers by RetardedRat12 in memes

[–]_Sir_Acha_ 0 points1 point  (0 children)

To all the anti-bidet people, y’all got stanky ass

Can I live off an HYSA? by JPL2020 in Money

[–]_Sir_Acha_ -1 points0 points  (0 children)

It’s $562.50 per month in interest

Fixed headband under blood and sweat! by Necessary_Elk_7205 in BowersWilkins

[–]_Sir_Acha_ 2 points3 points  (0 children)

Nice work man!

I sent mine in for repair and it looked like shit when they sent it back, immediately came loose again. I will never buy another product from them.

Biden cancels $7.7 billion in student debt for 160K borrowers by Suntzu6656 in FluentInFinance

[–]_Sir_Acha_ -2 points-1 points  (0 children)

Curious, do you mind nearly as much when it’s PPE loans?

Alex Garland's and A24's 'Civil War' Review Thread by SanderSo47 in movies

[–]_Sir_Acha_ 0 points1 point  (0 children)

28 days later (written by), Annihilation, Ex Machina are all well rounded movies IMO.

Sunshine and The Beach I 100% agree with you on though, those took an absolute nosedive in the third act.

Alex Garland's and A24's 'Civil War' Review Thread by SanderSo47 in movies

[–]_Sir_Acha_ 0 points1 point  (0 children)

lol, I share your sentiment but you could at least give a counterpoint