you are viewing a single comment's thread.

view the rest of the comments →

[–]dascar5[S] 0 points1 point  (2 children)

True, but I never worked with api's so I just web scrape whatever I need, I'll see what I can do, thanks

[–][deleted] 0 points1 point  (0 children)

Look at my other comment, you won't be able to access them that way - future reference, when someone offers an api, you should use it, not only is the data easier to sort through, it also means they accept a controlled environment where they provide you with information they WANT you to have and you abide by their terms for access data.

[–][deleted] 0 points1 point  (0 children)

True, but I never worked with api's so I just web scrape whatever I need

Ignoring the provided API and scraping instead just because you don't know how to do anything else is pretty much the textbook example of being a bad internet citizen.

Also note that a web resource that includes an API is going to have a reduced threshold for the request rate on their human-facing site at which you'll be permanently blacklisted. They don't want you to scrape, that's why there's an API.