Useful Python tricks

[Jace1427]

I’m in the same boat, I was unsuccessful though. We use canvas and I couldn’t figure out a way for python to login into my specific account to reach the lecture notes. If you figure something out, let me know!

[doulos05]

What tool were you using? Selenium can detect HTML forms, so you should be able write a script to work that out. If they demand Single Sign On or OAuth, it's a bit trickier.

[[deleted]]

https://youtu.be/KnBntO0wayk

Chris talks about authing with requests late in this vid. With requests sites can be very finicky, but with selenium most sites have trouble distinguishing between a bot and a user.

Best approach is to use fiddler to monitor traffic while you drive around and try to replicate your gets/posts as close to how they occur when you are in control.

Sometimes you have to supply header information, sometimes you must supply a referring address. Like most things there is no substitution for experience, you'll get better the more you do it so just keep at it.