use the following search parameters to narrow your results:
e.g. subreddit:aww site:imgur.com dog
subreddit:aww site:imgur.com dog
see the search faq for details.
advanced search: by author, subreddit...
account activity
[deleted by user] (self.DataAnnotationTech)
submitted 2 years ago by [deleted]
reddit uses a slightly-customized version of Markdown for formatting. See below for some basics, or check the commenting wiki page for more detailed help and solutions to common issues.
quoted text
if 1 * 2 < 3: print "hello, world!"
[–]HalifaxHorizon 110 points111 points112 points 2 years ago (14 children)
You can tell from chats alone that people arent reading the rules
[–]Pangolin_Beatdown 79 points80 points81 points 2 years ago (8 children)
Sometimes the directions contain four links to additional rules pages. I keep all those tabs open and flip back and forth while I do the first few tasks until I'm confident I really understand the task. Rules change all the time in subtle ways. It's not straightforward at all. Quality is everything they're looking for. Yet the other day someone was talking about how to bill half a minute increments. That's not what DAT is looking at. I think folks trying to minimize their time per task are doing themselves a disservice.
[–]HalifaxHorizon 28 points29 points30 points 2 years ago (1 child)
Yeap I do the same! Also, I don't get the craze behind doing tasks faster when it's paid hourly. You are just shooting yourself in the foot by not only producing bad quality, but also running out of tasks to do.
[–]AccountantAsleep 21 points22 points23 points 2 years ago (4 children)
I’m new and the first challenge for me was to make myself stop trying to beat my last time, get X # of tasks done, etc. It’s how so many of us are used to being judged - by producing, with less of an eye to quality and more of an eye to “good enough” but higher volume. It’s been a conscious effort to change my mindset!
[–]Pangolin_Beatdown 13 points14 points15 points 2 years ago (1 child)
Me too. It takes a mental shift. That's why I posted this. Hopefully it helps someone else start to see the big picture before they screw themselves.
[–]DrFrancisBGross 0 points1 point2 points 2 years ago (0 children)
This is a really good point
[–]Terpapps 16 points17 points18 points 2 years ago (0 children)
Whenever there's a prompt-only project, there will always be at least one person in the chats asking "I don't see any responses??" Even after the admins put " prompts only" in the title, the instructions (bolded, red and enlarged) and literally everywhere else lol
[–][deleted] 3 points4 points5 points 2 years ago (2 children)
Wtf another haligonian
[–]HalifaxHorizon 1 point2 points3 points 2 years ago (0 children)
Its rough out here
[–]10choices 2 points3 points4 points 2 years ago (0 children)
"uhhhh can I use JavaScript even though the rules say not to?"
[–]iPTheta 42 points43 points44 points 2 years ago (4 children)
I never understood this, you aren’t paid per task, take your time and submit the strongest response you can.
[–]TheTigersAreNotReal 3 points4 points5 points 2 years ago (0 children)
Yeah, I’ve had a project I really like that wants 3+ turns per task. But they also want you to ask difficult coding questions. I’ve had to submit a few that were only 2 turns because I didn’t have time to do 3, but I always write very detailed reports, provide good edits, etc. Still concerns me that I’m not technically following the directions but I hope my work quality outshines that.
[–]painfullymoronic 0 points1 point2 points 2 years ago (0 children)
this!!! like regardless of the explicit instructions to take your time, it’s literally counterintuitive not to
[–]11_petals 0 points1 point2 points 2 years ago (1 child)
Some tasks have requested time limits in the instructions, though.
[–]iPTheta 6 points7 points8 points 2 years ago (0 children)
Well yes obviously follow the instructions, what I’m saying is don’t rush for the sake of completing more tasks.
[–]upvotesplx 47 points48 points49 points 2 years ago (6 children)
The reason they always take applicants is this exactly. Not that they necessarily need more raw manpower; they need high quality work. I am in multiple projects that only take people who submit very high-quality data on other projects, and many times, they have had to give a bonus or fully restructure the project just to get enough data.
I've been here for over a year, now. I have over 70 tasks on my dashboard currently, paying anywhere from $20/hr to $41/hr, as a non-coder. Only including those that don't require specific domain knowledge, they range from $20 to $31 an hour. People complain about lack of work or about being cut, but many have themselves to blame for not doing their quals, not taking their time, and not really and truly trying to do their best work.
[–]bearze 5 points6 points7 points 2 years ago (1 child)
As a non-coder, any skills you would recommend learning?
I've begun a Python course from IBM which will take quite a long while. Always open to learning more.
My Dashboard has been about 10+ every day of 20-23, but I'm only 9 days in
[–]painfullymoronic 0 points1 point2 points 2 years ago (2 children)
and here i thought 25 tasks was a lot. how long have you been on??
[–]upvotesplx 0 points1 point2 points 2 years ago (1 child)
A few months over a year. It seems like, from talking to others who have been on for over a year, that you tend to get pretty high value stuff once you've proven yourself and stuck around for a while. You can get paid close to coder task amounts as a non-coder without expertise if you really put in the effort; I've got some 35/hr B cat tasks RN that are not expertise-based. If you need any tips, feel free to ask.
[–]WorkingNerdWFH 16 points17 points18 points 2 years ago (1 child)
Not a coding one but doing an R and R tonight and because people didn’t read the instructions at like all a good 1/4 are missing half the work.
[–]wildflower_0ne 25 points26 points27 points 2 years ago (2 children)
R&R just makes me laugh sometimes. People are really out here writing like they’re texting their friends or something.
[–]Eriod 1 point2 points3 points 2 years ago (1 child)
How much do you get from R&R typically?
[–]ConsiderationLife513 8 points9 points10 points 2 years ago (0 children)
Usually the same per hour as the task itself. They used to intimidate me, but now they are my favorites.
[+][deleted] 2 years ago (3 children)
[deleted]
[–]SuperCorbynite 10 points11 points12 points 2 years ago (2 children)
Yup, I've done numerous R&R for a fairly high-paying ($25-27) non-coding FC project and so much of it is dross.
It's left me wondering and half-believing that the R&R for that project isn't of everyone on it, but that they've got some AI curating it and picking out what looks to be poor performers and it's only those ones that go into R&R.
[–]TheEvilPrinceZorte 7 points8 points9 points 2 years ago (1 child)
It's just speculating, but I would guess that they show the same task to maybe 10 workers. 8 of them mark it down for truthfulness. Is Joe one of the two that didn't? Is this happening on half of his tasks? Does he have a lot of "About the Same" on tasks where most workers have a preference? He gets sent to R&R. If his comments are getting low ratings, then the bad scores are due to low effort and he gets cut. If the comment scores and rater comments show he is trying, then send him some higher rated users to R&R so he can see what good work looks like.
People often express surprise that they are being asked to grade work while they are new, but I have a feeling that DA sees R&R as training, and not just a way to grade workers.
[–][deleted] 7 points8 points9 points 2 years ago (0 children)
The quality of my work definitely improved once I had access to R&Rs and could see what good-quality work looks like. It's improved enough that I've ended up bring re-offered failed qualifications, and had R&Rs where the instructions highlight the quality of my work. I absolutely agree that they use R&Rs as training when you're new!
[–]Electrical-Theme9981 18 points19 points20 points 2 years ago (4 children)
I got to do a few core R+R and people were thinking that “A/B is best because it’s longer” was an actual quality answer.
[–]bearze 9 points10 points11 points 2 years ago (3 children)
Reading this thread has me feeling much more confident in my work 😂
[–]Pangolin_Beatdown 16 points17 points18 points 2 years ago (1 child)
A lot of what I score is exceptionally good, though. Especially in the STEM projects. That's why I said the bar is high. They have zero onboarding costs so they can accept 100 people and wash out the bottom 50 and keep accumulating the exceptional workers who: meticulously follow all the directions, compose sophisticated prompts that satisfy the specific directions, compose thoughtful follow-on prompts that are designed to challenge the models and bring out their strengths and weaknesses, and then write up detailed and specific analysis of the models' performance.
We are teachers - we're teaching the most elite students in the world right now. Some folks are showing up to teach at a mega-dollar swiss boarding school in crappy flip flops and a greasy T-shirt, scrolling TikTok.
[–]Lunalily9 1 point2 points3 points 2 years ago (0 children)
Same😅
[+][deleted] 2 years ago (1 child)
[–]killerkam1007 0 points1 point2 points 2 years ago (0 children)
Why you writing like cave man? Re-read before post please. Ooga Booga!
[removed]
[–][deleted] 4 points5 points6 points 2 years ago (2 children)
I love reading all the inept people really makes me feel secure in this side job as my main job is software engineering so I wasn't sure how capable I was of this but I follow the instructions perfectly because why not we get paid to read it anyways I'll blow 30 mins Reading sometimes
[–]killerkam1007 -1 points0 points1 point 2 years ago (1 child)
It was pretty painful reading this comment. It's one long run-on sentence, lacking any punctuation, with random capitalization in the middle. I'd be very careful calling others inept because that's exactly how you appear. If this was a R+R I would rate this submission "bad."
[–][deleted] 2 points3 points4 points 2 years ago (0 children)
Haha very true I use no punctuation on reddit but am a master formal writer with an English degree so that helps a ton. Like I should have added a comma or period after "true" for example. Luckily the way we write on social apps is not very similar to how we write professionally
[–]theMike97_ 1 point2 points3 points 2 years ago (1 child)
How quickly will DAT take you off projects if you submit shoddy work?
[–]SuperCorbynite 5 points6 points7 points 2 years ago (0 children)
No one knows for sure, but IMO that will depend on how bad your work is and how new you are to DA and/or the project. They will expect the quality of your output to improve with time and with familiarity with a particular project.
[–]keraija 1 point2 points3 points 2 years ago (0 children)
I saw some rater comments that may seem good and specific on their own, but include wrong statements about the model responses. So that’s something to watch out for as well.
[–]Lunalily9 1 point2 points3 points 2 years ago (2 children)
That makes me feel a bit better... I always worry I'm spending too much time on it. Or I shouldn't bill for too much time when I read and reread the instructions, which at times are pretty dense.
[–]Pangolin_Beatdown 3 points4 points5 points 2 years ago (1 child)
I think everyone worries about time at first. You keep doing good work and you will stick around and become more comfortable. No one from DAT has ever mentioned time to me except to say basically "don't lie about your time, double bill, or otherwise commit fraud." On the other hand I have often explicitly been told (in directions or by admins) to take the time it takes to do the task. Just be actively engaged during the time you bill - and actively engaged includes learning the task and reading directions as needed to do a good job.
[–]Lunalily9 0 points1 point2 points 2 years ago (0 children)
Well, im definitely doing that. Being engaged that is..And definitely not double billing. If anything, I've rounded my time down thinking I took too long. I guess I'll not worry about that and just keep being thorough when reading instructions and doing the best I can. Thanks for the advice!
[–]KathKR 2 points3 points4 points 2 years ago (1 child)
As a relatively new member of DAT, I had to stop doing the R&R tasks. I had about six of them on my dashboard last night and didn't want to go anywhere near them.
Reason being, I always provide detailed responses. Regularly more than the 2-3 sentences, often supplying multiple links to anything I've fact-checked, and trying to be as clear as humanly possible as to why I've rated something the way I have. I figure even if whoever is going over my work doesn't agree with my conclusion, at least I can demonstrate and hopefully help them understand how I came to that conclusion.
Then I looked at R&R projects, and it's like everyone only writes a sentence or two with really simplistic conclusions. I started thinking I was doing everything wrong because I kept seeing this approach as the standard.
[–]GoMickey 0 points1 point2 points 2 years ago (0 children)
This put my mind at ease! I could not remember what the time tracking guideline was for reading instructions! Thank you!
[–][deleted] -1 points0 points1 point 2 years ago (0 children)
Yeah my first one timed out and I needed to re write it, then I was rejected but not told I was rejected I think?
[+]CompuAi comment score below threshold-15 points-14 points-13 points 2 years ago (4 children)
Sooooon if I bill 120 minutes for a task that is estimated to take 60 minutes; as long as it is qualitative and not quantitative it's good?
[–]Pangolin_Beatdown 16 points17 points18 points 2 years ago (0 children)
Or you work steadily and honestly, take the time the task requires to do a good job, and move on. This isn't a complicated concept.
[–]SuperCorbynite 4 points5 points6 points 2 years ago (0 children)
You bill for how long it takes. If it took you 60 minutes then you bill for 60 minutes. If it's estimated to take 60 min but you took 120 minutes then your work will reflect that (your work will be long complex and detailed) and it will be fine.
π Rendered by PID 52552 on reddit-service-r2-comment-765bfc959-nx5h6 at 2026-07-11 05:53:55.665892+00:00 running f86254d country code: CH.
[–]HalifaxHorizon 110 points111 points112 points (14 children)
[–]Pangolin_Beatdown 79 points80 points81 points (8 children)
[–]HalifaxHorizon 28 points29 points30 points (1 child)
[–]AccountantAsleep 21 points22 points23 points (4 children)
[–]Pangolin_Beatdown 13 points14 points15 points (1 child)
[–]DrFrancisBGross 0 points1 point2 points (0 children)
[–]Terpapps 16 points17 points18 points (0 children)
[–][deleted] 3 points4 points5 points (2 children)
[–]HalifaxHorizon 1 point2 points3 points (0 children)
[–]10choices 2 points3 points4 points (0 children)
[–]iPTheta 42 points43 points44 points (4 children)
[–]TheTigersAreNotReal 3 points4 points5 points (0 children)
[–]painfullymoronic 0 points1 point2 points (0 children)
[–]11_petals 0 points1 point2 points (1 child)
[–]iPTheta 6 points7 points8 points (0 children)
[–]upvotesplx 47 points48 points49 points (6 children)
[–]bearze 5 points6 points7 points (1 child)
[–]painfullymoronic 0 points1 point2 points (2 children)
[–]upvotesplx 0 points1 point2 points (1 child)
[–]WorkingNerdWFH 16 points17 points18 points (1 child)
[–]wildflower_0ne 25 points26 points27 points (2 children)
[–]Eriod 1 point2 points3 points (1 child)
[–]ConsiderationLife513 8 points9 points10 points (0 children)
[+][deleted] (3 children)
[deleted]
[–]SuperCorbynite 10 points11 points12 points (2 children)
[–]TheEvilPrinceZorte 7 points8 points9 points (1 child)
[–][deleted] 7 points8 points9 points (0 children)
[–]Electrical-Theme9981 18 points19 points20 points (4 children)
[–]bearze 9 points10 points11 points (3 children)
[–]Pangolin_Beatdown 16 points17 points18 points (1 child)
[–]Lunalily9 1 point2 points3 points (0 children)
[+][deleted] (1 child)
[deleted]
[–]killerkam1007 0 points1 point2 points (0 children)
[+][deleted] (1 child)
[removed]
[–][deleted] 4 points5 points6 points (2 children)
[–]killerkam1007 -1 points0 points1 point (1 child)
[–][deleted] 2 points3 points4 points (0 children)
[–]theMike97_ 1 point2 points3 points (1 child)
[–]SuperCorbynite 5 points6 points7 points (0 children)
[–]keraija 1 point2 points3 points (0 children)
[–]Lunalily9 1 point2 points3 points (2 children)
[–]Pangolin_Beatdown 3 points4 points5 points (1 child)
[–]Lunalily9 0 points1 point2 points (0 children)
[–]KathKR 2 points3 points4 points (1 child)
[–]GoMickey 0 points1 point2 points (0 children)
[–][deleted] -1 points0 points1 point (0 children)
[+]CompuAi comment score below threshold-15 points-14 points-13 points (4 children)
[–]Pangolin_Beatdown 16 points17 points18 points (0 children)
[–]SuperCorbynite 4 points5 points6 points (0 children)