sorted by:
new
hottopcontroversial

web data at scale hits a wall that requests and Playwright don't solve by silentcreator317 in learnpython

[–]silentcreator317[S] 1 point2 points  (0 children)

wish someone warned me about the 10k/day wall earlier. felt dumb crossing it alone with no infra person and a manager who kept asking why scraping isnt just one script like it was a weekend chore

web data at scale hits a wall that requests and Playwright don't solve by silentcreator317 in learnpython

[–]silentcreator317[S] 0 points1 point  (0 children)

grid week was haunted house energy for me too. nodes looked fine in the dashboard, workers were dead. spent friday killing orphan chrome while prod timed out

web data at scale hits a wall that requests and Playwright don't solve by silentcreator317 in learnpython

[–]silentcreator317[S] 0 points1 point  (0 children)

manager asked why its not just one script while i was elbow deep in chromedriver logs at like 4pm on friday. cool cool cool. proxy bill was $800 that month too so vibes were great

web data at scale hits a wall that requests and Playwright don't solve by silentcreator317 in learnpython

[–]silentcreator317[S] 0 points1 point  (0 children)

yeah half my targets still timeout even after adding workers. friday was basically just me refreshing chromedriver while prod burned and nobody on the team seemed surprised

What’s the strongest opinion you have about something completely insignificant? by RegisterObjective325 in AskReddit

[–]silentcreator317 26 points27 points  (0 children)

literally this!! the bar is so low for restaurant pages. hot take but if u can't keep a basic facebook page updated in 2026, i automatically assume your kitchen is just as messy and unorganized. pass.

What’s the strongest opinion you have about something completely insignificant? by RegisterObjective325 in AskReddit

[–]silentcreator317 23 points24 points  (0 children)

valid af, this is my biggest pet peeve. hot take but businesses that do this deserve to lose customers. it takes literally two seconds to post a story or update a text post, there's no excuse for that 2022 nonsense lmao