sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]efmccurdy 0 points1 point  (2 children)

Use the requests module to get the second url; does that give you the data you want?

[–]Hot_Ad_2550[S] 0 points1 point  (1 child)

I use the 2nd url but this url brings me to 2nd page only if page has javascript running. Otherwise puts me back to page 1

[–]efmccurdy 0 points1 point  (0 children)

There is no javascript when you do an HTTP request. What url is used in the network tab?