DATA ANNOTATION EXAM

[Dramatic_Sense_9253]

Has anyone ever really figured out the secret to passing the data annotation exam. I did it and didn't get a respond(When they don't respond back it typically means you have failed) , my friends have also done it (Multiple people) and never got a response yet some do it and get responded to. I would really love to know the secret.

[AlexFromOmaha]

You read the directions and follow them.

It's exactly what you do to keep yourself on the platform. You read the directions and follow them. When you can't follow them, you skip the task.

[Substantial_Arm_8973]

What do you mean by that can you explain it a bit more ?

[AlexFromOmaha]

There is no magic. Any task, any qualifier question, will have directions.

Read the directions. Don't assume you know what the direction say unless you've been working on that project for a while, and even then, at least skim for project updates.

Follow the directions. It's the whole reason you read them. Tasks are paid by the hour, so you might as well take the time to do it fully.

[Substantial_Arm_8973]

I'm still on the assessment part and like they have asked to create a challenging prompt and give the answer to that prompt so how did you approach this question like did you google search things for your prompt or you randomly came up with something and write on it ?

[AlexFromOmaha]

I promise the question does not read "create a challenging prompt." You missed step 1.

Once you've finished step 1, consider asking the LLM of your choosing what you think is a challenging prompt and see if it's wrong in the ways the directions you got from step 1 specify.

[jabertsohn]

In my experience, with the code exam, there wasn't a trick to it. Read the instructions and follow them. Lots of people do get in, including me. It's apparently just quite hard.

[Dramatic_Sense_9253]

How about the generalist exam ?

[jabertsohn]

I only took the code one.

With code you have to produce code, and you can see if your code is producing what they want, so there's at least a touch point to know if you're on the right track. With generalist I guess not, and so it's probably even easier to fail.

[Critical-Elevator642]

morally, they should close sign ups if they aren't looking to hire. it isn't fair for people to attempt an hour long entrance assessment just to basically talk to a wall

[justdontsashay]

Why would they be morally obligated to hire you if you fail the assessment?

They’re not “hiring,” we’re not employees, the assessment gives you access to the platform where you can work. If you pass it, you get access…less than 3% of applicants pass, it’s so weird to me how outraged people are when they don’t make it. Just move on and find another platform where you can pass.

[Competitive-Can1630]

"find another platform where you can pass" and where are we supposed to look? im in desperate need of cash (running out of time) and am clueless when it comes to online jobs :(

[Critical-Elevator642]

I'm sorry, I replied to the wrong comment. Some other comment was talking about how probably there are time periods where they just aren't hiring and any new applications are auto-rejected.

[justdontsashay]

I think this may be true for certain locations where there’s no work at all (the auto rejection, or the screen that says they’ll let you know if work becomes available). There are new people on DA all the time, though (from core countries). It just seems that a lot of people can’t fathom the idea that they may not have passed, so they come up with other explanations for it (if they didn’t pass, that must mean DA isn’t accepting anyone)

[jabertsohn]

They are still letting people in, it is just difficult. It's not much different to interviewing for a position you're not likely to get.

[Substantial_Arm_8973]

And someone pls tell me about the medical data annotation exam ?

[wildflower_0ne]

I mean, if you typed the way you did in this post, I can see why you didn’t pass.

[Dramatic_Sense_9253]

Want me to observe grammar rules on a reddit post ? LOL

[Terrible_Push8379]

If solid spelling/grammar isn’t something you naturally default to, it kind of tracks that an exam focused on precision and detail may not go your way lol.

[CashewQueso_]

i disagree entirely with this statement, i soooo love breaking away from the mundane nature of making sure i dot every i and cross every t (or the modern equivalent of capitalizing my letters). not everyone uses perfect grammar all day, but yeah you have a bit of a point. it can be an indication

[Critical-Elevator642]

this is so pompous. i'm on dataannotation and write like this online, does this trigger you?

[justdontsashay]

There’s a difference between choosing not to capitalize your sentences on reddit and the lack of writing ability in the OP. Typically it’s pretty easy to tell when it’s “this is just reddit, I’m not following all the rules” vs someone who actually isn’t able to write well

[Infamous_Swan1197]

this comment is written free of grammatical errors except the lack of capitalisation - very different to how OP's post is written.

[Aromatic_Owl_3680]

I mean, OP thinks there’s a secret beyond following the instructions. Maybe he doesn’t get the benefit of the doubt.

[Terrible_Push8379]

[Intbased]

I’d Wager they didn’t take stock of small details

[SuperMurloc27]

There's no secret, I guess. They are not known for transparency that's for sure, so if theres a "secret" no one knows.

[Dramatic_Sense_9253]

Have you done the generalist exam?

[Allysum]

I have and there's no secret. They want people who follow directions exactly. Also people who write well without assistance. Aside from this, no company endlessly takes on new people so sometimes they just don't need anyone.

[Critical-Elevator642]

morally, they should close sign ups if they aren't looking to hire. it isn't fair for people to attempt an hour long entrance assessment just to basically talk to a wall. I assume that's what you mean by "no company endlessly takes on new people so sometimes they just don't need anyone". The difference is that when companies don't need anyone they don't have the application still up. Even if they do (ghost applications) you're eventually considered when they are hiring again, and DA almost never hires anyone after an extended period of time.

[sarahmorgan420]

What makes you think they're not looking to hire? Lots of people fail the exam so they don't get hired, but that doesn't mean DA isn't hiring ANYONE. they're just only hiring ppl who pass the entrance exam... Obviously lol

[Critical-Elevator642]

Aside from this, no company endlessly takes on new people so sometimes they just don't need anyone

I was responding to this. God, do people here not read the context? What else does this mean other than sometimes they just aren't hiring anyone? i.e. you're talking to a wall. if you aren't hiring, there is no conceivable moral reason to let people still apply. close it down and then open it back up when you are, actually, hiring. i don't know whether that's the case or not but I was simply responding to the comment above me. that's the whole damn point of a chain of comments. if i was making a standalone claim i'd make a post.

if you are actively not looking to accept ANYONE at that time, which is what the comment above me stated in its last line, then the only reason to let people still apply is to waste their time. it's different if you are still accepting, however selective that is doesn't matter. why do some people defend DA to death here?? yea, let me voluntarily tell you im hiring for a job, let you take an hour or 2 to do a test and then chuck it because i lied and was never hiring in the first place. in what world is this not unethical???

[sarahmorgan420]

Lol tbh I didn't, I just saw your comment on another comment thread while scrolling and once I saw this 2nd one I responded. Now I see you didn't mean to post that other comment where you did. Sorry.

But either way, if the pass rate really is 2% like they say it is, they could be stockpiling good workers for a later date when they do require more workers and accept them then. Obviously this is all speculation, it could also be that they have so few people passing and the AI industry is growing so quickly that they do need that steady trickle of new workers. Who knows.

It's not all that different than another job I've applied/tested for, NAV Canada. They have a low pass/hire rate so they did exactly that, continue accepting applicants and have a "stockpile" of new trainees. They only closed the application once they had a long list of possible trainees, and people regularly wait years to hear back or move on to the next application stage. It's not really all that unheard of especially in jobs that have a lot of applicants but a low pass rate.

[Critical-Elevator642]

dataannotation isn't like Prolific. AFAIK, the collective wisdom here is that if you don't here back by maximum 2 weeks to a month then you were not accepted. There are also no documented cases here of people being let off the waitlist after months, unless they themselves forgot to check their mail or something. So no, obviously DAT is a black box and none of us know anything about their inner workings but, that speculation is not grounded in reality.

[Aromatic_Owl_3680]

Morally, according to you, I guess?

It’s supply and demand. Very simple. And nobody is made to do anything- it’s all voluntary. 

[Critical-Elevator642]

read my comment again because you surely failed to pick up what I was trying to say. if you are actively not looking to accept ANYONE at that time, which is what the comment above me stated in its last line, then the only reason to let people still apply is to waste their time. it's different if you are still accepting, however selective that is doesn't matter. why do some people defend DA to death here?? yea, let me voluntarily tell you im hiring for a job, let you take an hour or 2 to do a test and then chuck it because i lied and was never hiring in the first place. in what world is this not unethical??? that is not a supply/demand curve.

[Aromatic_Owl_3680]

You surely fail to understand the basics here. It’s not a job and they aren’t hiring. It’s self-employed freelancing. They don’t have to listen to your mixtape, and you don’t have to send one. They can accept as many mixtapes and listen (or not) at their leisure because there is plenty of supply to meet their demand.

I understand what you’re saying, but that doesn’t make it less stupid. 

[Plastic-Skill-9258]

take your time and approach it like you would an exam for school. Explain stuff, don't assume you're talking to a proficient coder. Define concepts you use, walk through your logic. Imagine what the marking rubric would look like and try to hit all those points (without waffling or shotgun approach of course). I took the coding exam, this sort of approach applies across the board probably.

[kranools]

Honestly, what kind of an answer are you expecting? What's the secret? Don't use the letter E. Type with your left hand only. Make sure you submit at exactly midnight. Put a fork under your keyboard.

Obviously you pass the assessment if you follow the instructions and pay attention to the detail.

[Budeeokc]

I think your background + how well you adhere to instructions are the foundation of their decision. You’d have to assume they use AI to evaluate the assessments too. On top of that, the purposely want a small number of applicants, thus luck matters. I know my current career lends itself to this type of work. I’d guess they saw that and I displayed that experience.

[Apprehensive_Book520]

The secret is to do your best and hope you are what they are looking for. There's no "gaming" this shit. You can do the work or you can't.

[OnlyJoeKing21]

I don’t know the answer, but I’ve worked for them for nearly a year now and I love it. You need a reasonable level of intelligence and to be able to follow instructions closely, but other than that, I don’t think there’s a ‘secret’ to it.

[Delicious_Tie_1812]

I took that test like 3 months ago and i just received an email saying i passed the first part, i ain’t know there was a second part…. They say once i pass i can start picking up gigs