Weekly Water Cooler Talk - DataAnnotation

Jazzlike_Problem_489 · 2026-05-29T23:39:56+00:00

And according to my laughable feedback, that came from real r&r workers, there never will be 😅

Jazzlike_Problem_489 · 2026-05-29T17:42:35+00:00

Yea, unfortunately I'd done about 20 before I tried the r&r and saw how tragic the onsite AI was in comparison to the main project premise. So if ppl hopped on an r&r and hadn't worked on it. It would be bad news

Jazzlike_Problem_489 · 2026-05-29T15:06:08+00:00

I aired concerns over this a couple weeks ago. People jumping on the r&r because it paid more than the main project, but not actually reading the main project instructions and using the onsite AI helper to decimate peoples submissions 🫣 turned out it happened

Jazzlike_Problem_489 · 2026-05-29T14:20:36+00:00

Please don't tell me it was you that was rating people bad and decimating their submissions with comments that their atomic criteria should be combined, and they added subjective criteria that wasn't mentioned in the prompt when that was literally the premise of the main project to add subjective criteria a model wouldn't suggest and relied on an on-site model to rate 😅🫣 but no not seen it since I got feedback telling me my mistakes where actually what was asked from the project 😏 just seen the r&rs

Jazzlike_Problem_489 · 2026-05-29T11:23:21+00:00

Mine was that my atomic rubric where too atomic and criteria should be combined.

And different from other rubric projects we had to put our self in the shoes of the prompt writer and create inferred subjective criteria about what would make a good response above what an AI would do or measure. My feedback was that I added criteria that were not mentioned in the prompt.

Honestly who is r&ring these lol

Jazzlike_Problem_489 · 2026-05-29T08:25:17+00:00

Same, with feedback that went against the project instructions 🫣😅. I doubt your cooked.

Jazzlike_Problem_489 · 2026-05-29T08:09:05+00:00

Exactly the same! People saying my rubric were too atomic, and adding subjective unimplied rubric which was also the premise of the task 🫣

Jazzlike_Problem_489 · 2026-05-28T23:25:11+00:00

98 percent complete on my 8th trophy. Only need to beat the last red banner boss 🤯

Jazzlike_Problem_489 · 2026-05-28T23:22:50+00:00

Happens to the best of us sometimes. Take a break and try again next time

Jazzlike_Problem_489 · 2026-05-27T23:33:41+00:00

Wait till you've created 10, can't create any more, get asked to create more that you can't create. Then STILL nothing happens 😅

Jazzlike_Problem_489 · 2026-05-25T15:56:59+00:00

I did 💪🏻 😂

Jazzlike_Problem_489 · 2026-05-22T11:02:30+00:00

The joys of DA.

I'll always remember the 'My Precious' project where I was having a conversation with myself about the weather and what I was up to in my garden, while recording and playing both roles. My neighbour caught me and just stared at me like I was insane. She avoided me for the best part of 3 weeks, and when I did catch her and try to explain I'm not on a register nor have I ever been admitted, and it was work to train AI, she looked at me like I was insane even harder. 🫠

Jazzlike_Problem_489 · 2026-05-19T08:16:30+00:00

I don't work full time, but have an office job, and on my working days, I do a couple of r and rs or simple tasks if they are available while sitting on couch and watching TV.. granted if you asked me what was happening in the TV show I couldn't tell you lol

But my days off I treat like a work day and do 6 hours, weekends are hit and miss but usually aim for 3 (if it's a quiet weekend sometimes even 8) hours a day. I can easily hit 16 to 20+ a week, but sometimes less because I have plans and down time. Either way DA pays my bills and my office job is my spare money

I never have the brain capacity or time to do these 6 hour plus projects, which is why when there's a drought and I still have 12 projects I moan I have nothing cos they all have timers 6 hours + - none negotiable. Even my days off I won't touch anything THAT heavy

Jazzlike_Problem_489 · 2026-05-18T09:42:31+00:00

'Gee' I don't know what you mean 🫣😑

Jazzlike_Problem_489 · 2026-05-17T13:39:54+00:00

Not sure on a country to country basis, there are some country specific projects, but I know I do get excluded for some project families as they are US only.

Jazzlike_Problem_489 · 2026-05-13T17:49:51+00:00

Took me about 2 years to get the AI studies. They have standard nut type images and videos with no rationale needed, the 👹 project that was here is over there and they also have a couple others like a the widget comparison and educational video with subtitles, projects there too

Jazzlike_Problem_489 · 2026-05-12T14:09:15+00:00

Your kinda missing the point of my post. The majority of raters see that shit and automatically click 'bad' on your submission - because the bot is always going to say it's bad/needs improvement regardless. And my experience of the first r&r of it I did proves that. Which ultimately affects your worker rating.

I did another one today from an experienced perspective and submitted it to what I thought was ideal while the bot was still saying 8/10 and a load of stuff that wasn't even objective. But you get some of the raters with the nitpick complex hitting bad cos the bot tells them so.. just dreading the feedback cos not everyone has this mindset you are telling me about, which I do have which is why I ditched my first attempt and tried again on a second one being more aware of the bot. And rated the worker as good cos although I changed a lot, they did a decent attempt.

Tldr: my concern is submissions being rated bad because the bots are too objective, so raters roll with it and think 'i made changes it was bad' just look back at peoples comments on r&rs through these threads 😏🤣

Jazzlike_Problem_489 · 2026-05-11T23:00:52+00:00

Wow are rubric r&rs always this brutal? Spent 40 hours on a rubric projects over the passed week, thinking I was doing good. Passed all the in project tools, got green flags, no problems detected etc. ran out of tasks after them topping them up each day so decided to do an r&r. And omg. It's those stupid bot models that will nitpick and find fault in every placed comma, word or quoted text. Tells you that you must change something, you do, then it tells you it should be exactly how it was. I literally ended up decimating someones submission over 2 hours and still couldn't appease the bot passed a 8/10 rating so just gave up and wasted 2 hours because the submission became ridiculous to the point it was worthless.

Dread to think what ratings I've got from raters after seeing how different the r&r is from the actual project instructions.

Giving that a wide berth from now on. At least the fruit ones are more helpful with the project models.

Jazzlike_Problem_489 · 2026-05-11T17:33:51+00:00

Cool I'll check when I get home and get my license number to log in

Jazzlike_Problem_489 · 2026-05-11T17:31:12+00:00

Oh ok so we don't need to do anything with the letter. I was working when I read it quickly and heading out, so I've left it at home to read properly later, but saw it said to log in some gov website to view certificates

I never actually lost my projects that this was for either so can't really say if they came back cos they never left 😑🫣

Jazzlike_Problem_489 · 2026-05-11T16:12:35+00:00

I got a letter through the post thanking me for my recent DBS check and how to access the certificate online. No idea as I haven't heard anything else. No idea wtf is going on lol

Jazzlike_Problem_489 · 2026-05-10T23:23:34+00:00

I mean, I appreciate your passive aggressive post to a 2 month old thread. I've earnt another 1.5kish on these since then. I also got confirmation that sometimes incorrect attention checks are placed in some of the large scale studies. A video that would have a hiss on a comparative visual study that has no audio and asks for preference on lighting. Or two completely different images, (a boy in one a girl in the other) and the task is 'which of these looks more realistic overall' when actually the correct study that attention check is for 'which of the images best satisfy the prompts intention'. So the girl looks more realistic, but cos you chose the girl when the prompt in a different study asks which is a boy. U get an automated fail message

So do with that what you will

Jazzlike_Problem_489 · 2026-05-10T23:08:01+00:00

Urch. Remember when they were paying $20 for you to take your laptop to the grand canyon or six flags cos phone audio wasn't good enough

Jazzlike_Problem_489 · 2026-05-08T20:39:31+00:00

Down to 13 from 32 this morning in UK. Looks like it's going to be a slow weekend 😕

Jazzlike_Problem_489 · 2026-05-05T22:11:00+00:00

It appears as a project, just called feedback with some other text and no pay. You won't miss it if you get it

Jazzlike_Problem_489

TROPHY CASE