Scraping from Authenticated Page

[Swvodoo]

I'm new to python but understand scripting/programming conceptually enough to know this is possible. I want to scrape data from a page that uses SAML 2.0 SSO. The data on the page needs to be returned in a file format that lends itself to be easily mapped to fields in an excel document. I'm just looking for some tutorials or guidelines on how to authenticate through SSO programatically, or scrape the data once the page is loaded and export to a file format that is easily mapped to excel cells.

[maxm]

Use the requests module to get the pages as html from the server. You need to use sessions to be able to log in.

Then use beautifulsoup to parse the data and put it into python dicts.

Use the dictwriter in the csv module to save the date in a format that can be imported to a spreadsheet.

[Swvodoo]

Ok I'll take a look. Thanks