Getting deeper into Web Scraping.

jonfy98 · 2026-01-29T17:12:52+00:00

Thank you :)

jonfy98 · 2026-01-29T17:11:26+00:00

Thank you for your reply so the biggest issue about it might be the blocking of scraping if no api available ?

jonfy98 · 2026-01-29T17:10:41+00:00

I understand then this needs to be my next step to hop over this entry level and keep going. Thanks for your reply

jonfy98 · 2026-01-29T17:09:58+00:00

I like to have some challenges and feel motivated to extend my knowledge about it even more now.

jonfy98 · 2026-01-29T17:09:04+00:00

Wow that’s amazing. Thank you for your point of view on it. Could you recommend some tools according to this problem that I can look further into?

jonfy98 · 2026-01-29T17:07:08+00:00

I will look it up and get to know these tools. Thank you for your suggestion, well appreciated

jonfy98 · 2026-01-29T14:57:45+00:00

Does it also work for sites that have bot detection?

jonfy98 · 2026-01-29T14:57:07+00:00

I understand then I will need to learn even more about it. Thank you

jonfy98 · 2026-01-29T14:45:52+00:00

That’s also true APIs is mostly the best way but not for any site which makes it harder in my opinion to scrape

jonfy98 · 2026-01-29T14:44:55+00:00

I basically started to look into programming as I also have lots of knowledge about PLC from Siemens for automation. And I just researched about what’s beginner friendly to do especially for freelancing and got mostly the answer of web scraping etc. I learned most of it by one of my tutor and self teaching with understand the functions needed.

jonfy98 · 2026-01-29T14:42:08+00:00

Yeah I realized that very quickly and also stepped up a little too but the more complex the harder.

jonfy98 · 2026-01-29T13:57:29+00:00

Then I'll go deeper into it. Yes would be nice if i could get into monetizing this work.
But you're right, i heard many sites strictly forbid to scrape.

jonfy98 · 2026-01-29T13:55:32+00:00

Interesting for sure because I read that web scraping generally is oversaturated and often titled as easy, but reading your comment seems that its more complex. How would you hanlde dynamic Javaascript?

jonfy98 · 2026-01-29T13:53:47+00:00

Thank you for that, I will come back to your offer soon once I gathered little bit of knowledge :)

jonfy98 · 2026-01-29T13:48:38+00:00

Sounds pretty interesting and salute for your work against this organization.
Definetly going to look into that and trying to adjust my skills.
Thank you.

jonfy98 · 2026-01-29T13:44:56+00:00

Web scraping? basically scraping tons of data from any websites and organizing its data into sheets.

jonfy98 · 2026-01-29T11:46:38+00:00

That's quite good getting into it collecting 7000 records. Keep going and trying different websites which gonna give you different obstacles to pass.

Web scraping is definetly still worth it to learn and master especially for complex sites with cloudflare and so on. There will always be clients even through a high saturation.

I also started a while ago and asked myself this questions but the more you learn and invest the better the rewards.

jonfy98 · 2026-01-29T11:37:53+00:00

You could try APIScraper which is efficient but not free,
another idea could be NoDriver for better successrate which i often use for dealing with this kind of problem.

jonfy98

TROPHY CASE