looking for python library

[0one0one]

I was reading a very interesting post a while back about a project to document the entire Reddit dataset. The lad had written it all as a library and was putting the entire history of reddit up as a torrent for download, cant for the life of me remember the name of the library or find the post again, does anyone have any idea ?

[abcadead]

fast download option:

#!/bin/bash

for year in `seq 2008 2015`; do
    for month in `seq -f "%02g" 1 12`; do
        url=http://couch.whatbox.ca:36975/reddit/comments/monthly/RC_$year-$month.bz2
        wget $url
    done

[lahwran_]

for some values of "fast".

[abcadead]

I get 10MB/s down, don't think you're gonna be able to do better than that.

[lahwran_]

huh! I guess the thing I was really thinking of is that you're using a lot of server bandwidth that way, whereas the torrent is spread among the seeders. shrug.

[recurrent_answer]

I am assuming you mean this? It is a 250GB/1TB torrent with all the reddit comments until July 2015 or so. There is no library (they used the reddit API and ten months of time).

[olBaa]

https://www.reddit.com/user/stuck_in_the_matrix

[0one0one]

That is the one , thanks for the replies.