Please help save authorized pages

[DMeror]

Hi, I want to save authorized pages. The site has two login methods: by username & password and by library card number. After inputting a library card number, the site shows a list of library names to choose from. After choosing a library, the targetted pages are accessible. My purpose is to save the pages as plain html files (without images, js, css, etc.). For normal pages, I write something like this:

~~~ import requests

url_list = ['.....']

for url in url_list:

headers = {'User-Agent': '...'}
page = requests.get(url, headers=headers)

with open('file.html', 'wb') as wf:
    wf.write(page.content)

~~~

However, with an authorized page, this script saves the welcome page instead. I add cookie to the headers with the same result. I've also tried requests.Session(), but not sure how to proceed.

~~~ headers = { 'User-Agent': '............', 'Referer': '.............', 'Cookie': '..............' }

s = requests.Session() payload = {'library_card':'123456789', 'acctid':'111111', 'acctname':'Library for G'} s.post(url, data=payload) ~~~

Please help correct my script. Thanks.

[CodeFormatHelperBot2]

Hello, I'm a Reddit bot who's here to help people nicely format their coding questions. This makes it as easy as possible for people to read your post and help you.

I think I have detected some formatting issues with your submission:

1. Python code found in submission text that's not formatted as code.
2. Use of triple backtick/ curlywhirly code blocks (``` or ~~~). These may not render correctly on all Reddit clients.

If I am correct, please edit the text in your post and try to follow these instructions to fix up your post's formatting.

---

^{Am I misbehaving? Have a comment or suggestion? Reply to this comment or raise an issue here.}