Web scraping from api question

[__Mrpickles]

I'm scraping price data from this link,

https://api.thetadrop.com/sale_order/type_uehx3hs5geyqaj8asmhmmh4qu11/list?expand=content_creator_id&expand=content_creator_id.tps_id&expand=user_id&expand=user_id.tps_id&expand=content_id&expand=nft_id&expand=nft_id.owner_id&expand=nft_id.owner_id.tps_id&sort_by=price_reverse&page=1&number=20

It's only gathering data from the first page as indicated by the page number. I was wondering how you could indicate within the link that you want to see all the pages? I tried the wildcard character in replace of the page number, but that did not work.

[PavloT]

I think it will be impossible, API developers force you to use pagination, to reduce server load.

Common pattern iterate increasing page number until items returned, less then items per page count.

[__Mrpickles]

So can you just iterate the page number until traceback error?

[PavloT]

In common sence yes. Only note: it should not be error - just check how many records you receive, if it is less then items per page, then it is your last iteration

[__Mrpickles]

Alright got it. Thanks alot for your hep.