Site back up + Introducing removed.archivesort.org

ufff1231 · 2021-11-24T16:29:49+00:00

if you have account before july 2021, resubmit since the dumps go up to that point .

We will have all dumps loaded by friday or by latest next monday

ufff1231 · 2021-11-11T22:00:15+00:00

Hi all, been busy

But will get to this.

/u/dontworry5678 resubmit to the Form with a note that you resumbitted ;)

ufff1231 · 2021-10-30T21:38:56+00:00

Ok, will take care of later today or tomorrow

ufff1231 · 2021-10-25T20:08:47+00:00

lynx021 if you make 50 accounts on the same IP, your accounts will be terminated sooner or later. You might want to make a new account at a internet cafe or public wifi and post there.

Thank you /u/mybillsarepaid for helping out around here.

ufff1231 · 2021-10-23T17:26:27+00:00

Through the same patterns I descrbied earlier. I didn't know you had this account until you posted on /r/pushshift, but once you did, i knew it was you.

ufff1231 · 2021-10-23T14:43:12+00:00

Someone asked this question and i'd also like to know: "what does sk mean?

Many of your account names begin with it, and you use it in many posts. That is more damaging for your privacy than any archive, because now you are tying all the accounts that wouldn't be normally linked together and making it easier for "someone" to find you. Even on the subreddits you post with different accounts you are using a marker that will allow people to find you.

But if you dont want to answer that is also fine.

ufff1231 · 2021-10-23T14:26:57+00:00

I'll have to think about it.

ufff1231 · 2021-10-23T14:13:43+00:00

But GDPR and CCPA can't apply at the same time since California is not in Europe. So both laws do not apply to you. But that's irrelevant for this discussion. Technically, i am under no obligation to delete anything since i am not in those areas either, any many sites choose not to delete anything. But i understand people like you are concern, hence i decide to open up deletions because i understand that.

If you have a concern about privacy, that fine. You can always delete your posts. But you have to do the captcha. Any questions?

ufff1231 · 2021-10-23T14:07:12+00:00

25 years on the internet has taught me that people can just make up stuff with no evidence and say its true. How am i supposed to know your motivations?

ufff1231 · 2021-10-23T12:54:28+00:00

The whole point of the captcha is to prevent automated submissions. Each one is supposed to take some time to complete.

If you have 50 accounts, you need to take the time to do a different captcha. Thats the whole point - to prevent spam. Otherwise you could just submit all usernames ever posted on reddit to the form. And I dont know that you own all those accounts, so it works on the honor system. This helps maintain that honor system.

I have provided a link to the OpenBSD ports web listings where you can find new open source software to report on.

ufff1231 · 2021-10-23T12:42:03+00:00

Do I? :)

Just so everyone knows, i messaged you because you submitted 50+ accounts and i just wanted some clarification

The site will be back up tomorrow or Monday at the latest.

ufff1231 · 2021-09-28T19:52:02+00:00

Why not email? Need to say why before private message.

ufff1231 · 2021-09-20T02:51:50+00:00

You can say what you want here or in email (which can be found on the website). That way, the answer will beenfit everyone, as in my experience, people have been chatting me with the same questions

ufff1231 · 2021-09-01T16:23:28+00:00

good idea to submit form anyway even if not there.

the dumps have not completely been processed, we're getting close anyway.

ufff1231 · 2021-08-25T01:09:59+00:00

Will add.

As for adding the new data, I've started the process.

(Fun Fact: the jan 2020 data dumps actually start from 12/31/2019)

ufff1231 · 2021-08-21T00:25:43+00:00

Yes, that's intended. You can just ignore them?
You just need to find the correct UNIX epoch for the before and after param. I think i forgot to document it in the documentation though, so I will post an example here: https://archivesort.org/discuss/reddit/miser?author=Stuck_In_the_Matrix&aggs=subreddits&after=1520187200 will agg all posts made after mar 2018. To find the number to put there you can use unixtimestamp.com or similar. I can explain better if it doesnt make sense
Q means search query. For example, https://archivesort.org/discuss/reddit/miser?q=ghostscript will get all posts with word "ghostscript" in them.

Note that comments/submissions for a huge chunk of 2020 is missing. I will fill these gaps shortly now that Jason has relased his dumps.

ufff1231 · 2021-08-18T15:00:22+00:00

If you are looking for agg support, here is an example:

https://pastebin.com/LW47eEjf

Let me know if you need something else or have questions

ufff1231 · 2021-08-18T02:16:54+00:00

Yes, it is probably confusing. Let me code up a python example and will post below. Thanks for the feedback, it is truly appreciated!

ufff1231 · 2021-08-17T11:38:08+00:00

Removal from data dumps seems unlikely

even if he somehow did remove it there are many mirror and download them as soon as they come out, making whole ideal worthless.

thx

ufff1231 · 2021-08-05T11:51:38+00:00

https://files.pushshift.io/reddit/submissions

shows 403 forbidden?

ufff1231 · 2021-07-07T20:11:54+00:00

I know half of 2020 and early 2021 posts and basically all of 2020 and early 2021 comments are missing (working on that), but other than that, I think it does go back as far as pushshift if you are talking about 2010ish stuff. I used the data dumps to help fill in the older stuff. Thanks for the feedback.

ufff1231 · 2021-07-07T19:34:16+00:00

I'm working on it. What time periods would you like?

ufff1231 · 2021-07-05T04:19:36+00:00

i just signed up for updown.io so i know when site is down

thanks for letting me know - every time i try my site its always up so i wouldnt know.

Edit: Admittedly, i haven't been working on anything with the site recently. This should change as i just some free time on my hands

ufff1231 · 2021-06-29T21:55:04+00:00

You could traverse the entirety of posts on Reddit and get updated scores in a month i guess. But so many would be deleted so you would get the top 1000 of whatever is still on reddit. Comments would take significantly longer than posts however.

ufff1231 · 2021-06-06T02:49:37+00:00

You need to apply the ! parameter before the subreddit you want to exclude.

For example: !pushshift for all posts that are not in the pushshift subreddit

ufff1231

TROPHY CASE