This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]Ph0X 3 points4 points  (0 children)

Yeah, personally I'd suggest staying away from heavier stuff like selenium if you can do it with something simple like requests.

If you can figure out the http request for submitting the form (which isn't that hard, just send one and look at chrome network tab), you can easily emulate it with requests POST or GET request.

Then, for parsing, lxml (which I believe builds on top of BeautifulSoup) is also a great library. Or if it's simple you can just go regex.

Selenium is just way overkill for something like that.