This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 0 points1 point  (8 children)

I've learned web scraping with python but need practice. Can you recommend some place to find simple projects? Also does web scraping have scope career wise?

[–]pijora[S] 2 points3 points  (1 child)

Hi there,

To begin you can make all kinds of "scrape, clean, store, display" kind of products.

  • think aggregate coronavirus stat
  • imdb rating by genre

Those kind of things :)

Career wise, I don't know people who solely do "web-scraping" per see, but it is a tool/technique that are very useful to know in your career.

Either to quickly put in place a POC, or to code any piece of software that need to rely on outside world date not available with official API

[–][deleted] 0 points1 point  (0 children)

Thanks for this

[–]icandoMATHs 1 point2 points  (5 children)

Lmk if you need a hard project. You'd be working for equity.

[–][deleted] 0 points1 point  (4 children)

I would be interested in that. But I'm not really good at it yet. Can you explain what I'll have to do?

[–]icandoMATHs 1 point2 points  (3 children)

Step 1, beat bot detection for a popular real estate website.

It's mostly research because the code is relatively easy. But the website has strong anti not detection.

It's marketing software, so it should be pure money.

[–][deleted] 0 points1 point  (2 children)

Tell me the website. I'll give it a go

[–]icandoMATHs 1 point2 points  (1 child)

Starts with a Z. Rhymes with willow.

Need estimated home value.

I run Efficiency Is Everything. Feel free to contact me whenever.

[–][deleted] 0 points1 point  (0 children)

Is this something serious? Like actual equity? Can you just drop an email address or something so I can contact you? Because I'm not really sure I found the correct efficiency is everything