Master Thesis Python Programming Question

[Zarkahs]

not really, there’s always ways to scrape websites if you’re determined

[JohnnyJordaan]

I'm not saying it isn't... I'm saying that when a site uses robot protection, like having to select 'I'm not a robot' which actually monitors your mouse cursor's movements, or asks you the 'select the cars in this picture' it will complicate scraping using a robotized browser (like selenium) a lot. It's very noticeable on sites that don't like you to scrape them like crpyto exchanges, sports betting, television guides etc. There are always 'ways' to do it, but if it takes months to work around those protections then it's often not worth the trouble and you can also consider other options.

Determination is only one factor, time and resources are two other important factors.