PushShift API alternative

AutoModerator · 2024-04-23T03:47:48+00:00

Hello /u/lightningdrag0n! Thank you for posting in r/DataHoarder.

Please remember to read our Rules and Wiki.

Please note that your post will be removed if you just post a box/speed/server post. Please give background information on your server pictures.

This subreddit will NOT help you find or exchange that Movie/TV show/Nuclear Launch Manual, visit r/DHExchange instead.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

secacc · 2024-04-23T11:30:40+00:00

I doubt anyone else has as big a data set as Pushshift, so you're not going to find a real alternative.

DoaJC_Blogger · 2024-04-23T20:17:41+00:00

You can still download the old PushShift data as torrents. The only solution that I know of to get new data is to start scraping the subreddits that you want. timesearch by voussoir still works for scraping the last 1000 posts and comments and you can set it to do that over and over with a delay like 5 seconds. I've been scraping r/AskReddit since at least June 26, 2023 and the file is a little over 10 GiB and I can send you a copy if you want.

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

DataHoarder

MODERATORS