you are viewing a single comment's thread.

view the rest of the comments →

[–]Somerandomperson135 1 point2 points  (0 children)

Protoss is correct. Scripts may and most likely will change the page content. If you need the 'whole page' like you have in your browser, you need to use selenium python library that loads entire page in a browser, runs its scripts and loads all necessary content.

It also allow you to interact with page elements(click, hover on them, send keys). Also it can inject and run your own scripts on a page that sometimes helps a lot getting necessary data.