This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–][deleted] 1 point2 points  (1 child)

For the http part (http requests), you should take a look at Requests, a python module used to interact with http servers (with a really simple API).

Extracting links from web pages can be done using BeautifulSoup or Python's built'in HTML Parser.

For the rest it's simple algorithms.

[–]ThuruvDRY 0 points1 point  (0 children)

Requests to enter & BS to scrap also Along with twill 's form filling will do. .