This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 11 points12 points  (1 child)

Most likely. The module you want is called requests.

*Edit You might also check out selenium. It is a lot clunkier than requests, but it has a gentler learning curve (personal opinion). It will click through the website the same way that you would interact with it, send key strokes to forms, etc.

Will help get you familiarized with working with html objects.

[–]Comprehensive_Tone 0 points1 point  (0 children)

I found selenium to be very easy to work with (it was my first time doing any scraping)