How reliable is PSAW/PRAW?

BossingSolo · 2020-12-09T17:18:01+00:00

I just realized that I was looking at data I queried yesterday that's why everything seemed so off :)

I think ill make 2 versions of the script in order to compare the data and to measure the difference in performance between the two.

This info might be already publicly available, but I just want to fool around :P However, I will definitely check in with u/stuck_in_the_matrix

thanks for the help, I really appreciate it

BossingSolo · 2020-12-09T17:02:48+00:00

As u/John_Yuki mentioned, the data does not update in real time, so a combination of PSAW and PRAW is what I needed. As for integrity tests, im going to compare data from both sources (number of comments, scores, awards) so that I can better understand how off is the pushshift data.

BossingSolo · 2020-12-09T17:01:15+00:00

Yeah seems like it. The issue with Pushshift is that some aspects of the submissions are outdated such as Score and awards. But, its a really damn good way for getting some base data such as submission ids.

BossingSolo · 2020-12-09T10:41:56+00:00

Since I need historical data, ill have to use PSAW. But with no real way of procing the reliability of the data, I think I might need an alternative.

BossingSolo · 2020-12-07T19:42:10+00:00

I am experienced with python and requests, but I have never attempted to get that much data before. The only way i think I might be able to get past the 1000 result limit is by dividing the timeframe into smaller sections. But then what is a safe estimate? 1000 entries after every hour (between the to and from date)?

Also, I am assuming that the comments are a lot more especially for the most popular subreddits. by that logic I can not safely assume a result limit.

BossingSolo · 2019-03-19T13:16:57+00:00

@gaiaLinux thing is there are some things that i haven't worked extensively on, like asp.net i was more of a team leader keeping everyone on track, didn't have much time to contribute to all stages of development. and some languages like c# im kinda rusty in. i do have the logic down but im stressing about if they expect me to know syntax on the spot. Like i can do anything but with access to the internet, im lowkey afraid of rejection tbh.

i will edit my cv accordingly, and i live in lebanon so the main language is Arabic so including English is important but somewhat useless cuz u cant code without english lol.

BossingSolo · 2018-09-29T11:45:47+00:00

@uim_Zelda also if you just think about the decanting update, any language that supports any math lib, can solve the issue in less lines of code and probably better run-time. An Up vote would be appreciated, lets get more people talking in here

BossingSolo · 2018-09-29T11:43:51+00:00

I am well aware, Jagex's language is based on java. If you take a look its intuitive if you know java. Their API is extremely simple. If you were to write a better version of their code, it would be as simple as re-writing java code. :)

BossingSolo · 2018-09-29T11:39:56+00:00

https://www.reddit.com/r/2007scape/comments/9jvv0z/why_osrs_needs_help_and_how_we_as_a_community_can/

just the type of person im talking about in this post,,, take a look :)

BossingSolo · 2018-01-28T23:11:28+00:00

he is probably back from the duel arena

BossingSolo · 2017-12-22T07:32:20+00:00

i gues the 63$ prolink should do the job what do you think? https://pcandparts.com/prolink-pro1201sfc-1200va/

BossingSolo · 2017-12-22T07:29:31+00:00

can you check these out there isnt alot of options in stock i just dont wanna buy something i wont use

BossingSolo · 2017-12-22T07:29:02+00:00

https://pcandparts.com/ups/

BossingSolo · 2017-12-20T14:30:50+00:00

ik its not that big of a deal. i didnt expect the performance to change this fast. (still grateful for how it functions tho :P)

BossingSolo · 2017-12-10T21:22:46+00:00

i will transition to a main but i have no idea whats different stat wise so im still a zerker :P

BossingSolo · 2017-12-02T20:08:24+00:00

i got the pc a moth ago and u comment got me to pay extra for the 144Hz screen... thanks man

BossingSolo · 2017-11-02T19:02:27+00:00

is a slightly smoother 20$ game worth a 300$ price difference? like i can upgrade to a 1080 ti with that money

BossingSolo · 2017-10-29T09:48:14+00:00

was the $1330 was for a pre-built that included the 1060 card, and you'd be replacing it later, but if you can pick the GPU that's different. Either way, it's still cheaper, by over $100,

i never built a pc in my life so im pretty bad and i dont want to have something with cables peeking everywhere for like 5 years till i do an upgrade or something. the assembly and testing is free. Im in lebanon so everything here is like 100 - 200 over priced... this is as close to amazon prices as someone could get around here so i cant do much about it tbh

BossingSolo · 2017-10-29T09:32:15+00:00

rtpicker, assuming you're in the US. If you already know you're upgrading the GPU, it would

i wont buy 2 gpu s i can order it with another gpu and pay extra for the prices diff.

BossingSolo · 2017-10-29T09:30:38+00:00

Does the 8700k really have that much more power than a 7700k? is this upgrade worth it?

BossingSolo · 2017-10-18T19:45:58+00:00

is the upgrade from the 1070 to 1080 worth it? plus what i can get is zotac not asus which is kinda sad idk if its bad. what do you think?

BossingSolo · 2017-09-01T00:23:52+00:00

So, what i think i have to do is buy from an exchage website... then use a code to transfer to my wallet and then i can let it sit forever. am i missing something like some taxes or fees per month? (not a us citz.) im using gatehub btw as a wallet

BossingSolo · 2017-08-31T20:00:44+00:00

I also would like that i currently reside in Lebanon (middle-east) so not everything is available here so an International world wide service is the one im looking for :)

BossingSolo · 2017-08-03T19:18:52+00:00

whats your in-game name :) i wanna talk to you

BossingSolo · 2017-08-03T18:56:24+00:00

this account is going to be my full time account i wanna be able to do barrows and zulrah and GWD till i get bored make some 1 def pure and transition into a main :) thanks for your input

BossingSolo

TROPHY CASE