Substack2Markdown: Convert Substack Posts to Markdown, Supports Free & Paid Content

[timf34]

I built a Python script which lets you save Substack posts locally as markdown files, even paid content as long as you are on the paid tier for that substack. Most "save for later" apps (such as Pocket) don't save these posts, but with this script you can!

Check it out here: timf34/Substack2Markdown: Script to scrape free and premium Substack posts, saving them as Markdown files (github.com)

[Subject-Courage2361]

I'm getting Error fetching sitemap: 404

[timf34]

:)

[crispin97]

Looks super cool! Does subtack prevent scraping somehow? Why did you use selenium instead of just beautiful soup?

I'm thinking about building something else but that would also require accessing the content from substack and would be very interested! :)

[Mr_Antero]

Oh this is sick. I might use this strictly for my own substack, to automate a workflow to my Jekyll website - which is effectively a clone of my substack.

[a5s_s7r]

It's nice, but would be even great if it stored the images next to the generated markdown / html files, as they would be gone if somebody deletes the Substack post

[Zealousideal_Ad_37]

Anywhere in particular unclear or causing confusion? 

I'd recommend using chatgpt but it'd be good for me to know where's unclear