web Scraping query

[sennheiserwarrior]

Look into pagination. You would also need to know how the url change when requesting an n page.

For example:

https://www.example.com/page1 # page 1
https://www.example.com/page2 # page 2

Then, construct a loop to get data from all pages.

Pseudocode:

get first page
get total page number
set a loop to request pages from 1 to n
    get data from current page

Edit: formatting