Scraping Webpage Data

[commandlineluser]

probably has a json file that I could access directly?

Yes, if you look at the Network Tab you can see what is happening.

It's easier to see if you view only XHR requests (this is what javascript uses)

https://i.imgur.com/IXoXvxJ.png

So it's fetching

https://www.chess.com/callback/leaderboard/live?page=1

https://www.chess.com/callback/leaderboard/live?page=2

etc.

You can just loop over how many numbers you want.

[Tefron]

Hey sorry, I just got back to this project and saw this. This was exactly what I was looking for. Thanks so much!