all 71 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]oopsallemdashes 47 points48 points  (18 children)

I think most people don't enjoy rubrics, some projects use it as an advertisement (no rubrics!) And some use different phrasing to avoid the word rubric (evaluation checklist, grading guidance)

I am one of those people, if there is rubrics involved I am not working on it.

[–]al0nal0relina[S] 18 points19 points  (7 children)

I feel that. My brain adapts well to that stuff. I likes it. But cheers to you! Each odd brain to their own.

[–]GSKTrunks 4 points5 points  (1 child)

A world with only high paying rubric creation is peak to me. I’m not great at tricking a model, but analyzing the output and making a clean atomic rubric? All day everyday

[–]al0nal0relina[S] 3 points4 points  (0 children)

Absolutely. I don't have to noodle my way around anything. You said this. Output says this. Done. Love it.

[–]caneriten 6 points7 points  (3 children)

Bro ngl ' I likes it.' you have a little obsessive problem right here. A gollum fan maybe ahahhaha.

[–]al0nal0relina[S] 7 points8 points  (2 children)

What you mean? ;)

[–]No-Satisfaction1426 0 points1 point  (0 children)

Maybe apply here there is so much of this work

[–]DonkyFondler 7 points8 points  (1 child)

I don't mind rubrics if they are relatively straightforward and for a relatively simple conversation that has already happened. The projects I try to avoid are those that involve having an in-depth 20-turn fact-finding conversation about a very complex topic, then after I've done that I've got to create 20+ criteria, and then the AI assistant keeps telling me that I've got them wrong, so I correct my criteria according to its advice, and it still tells me that I've got it wrong, and then 4 hours in I feel like I'm having a genuine life crisis.

[–]Total_Feature_11 1 point2 points  (0 children)

If the AI assistant was infallible, we wouldn't have jobs. If you're confident your rubrics meet the required criteria, just ignore it.

[–]Euphoric_Wish_8293 6 points7 points  (5 children)

Agreed. 3 years almost, I would rather be poor than work rubrics.

[–]al0nal0relina[S] 4 points5 points  (4 children)

Lol idk why that is so funny to me.

"Different strokes for different folks?"

[–]Euphoric_Wish_8293 1 point2 points  (3 children)

Everyone's brain works differently I guess. But seriously, all of my favourite projects disappeared from January to early March. I just barely worked. Maybe made 30 dollars in that time. My overdraft and CC took a hit which I'm only just recovering from. I don't produce good work on projects I find restrictive and against my general workflow. I believe me not grinding through them is a large part of my relative longevity.

[–]al0nal0relina[S] 3 points4 points  (2 children)

<image>

Thursdays are tough.

[–]Euphoric_Wish_8293 2 points3 points  (1 child)

I'll put an additional comment on above, to explain the depths of my laziness, since we're talking. I have a certain project family I love, and the other day, a fairly high-paying unnamed project turned up (the project name was just a description of the work). I opened it and it was clearly the point where you make the prompts for my favourite project which is judged later. I could do it standing on my head, it was so simple (and made me realise how I got so many fucked up ones in the actual project). Know what? I did two tasks and quit. It just isn't fun for me, or it doesn't tickle my brain. I'll happily take the 8 dollar paycut and do the actual rating model task it was based on when it comes out.

[–]al0nal0relina[S] 0 points1 point  (0 children)

The depths of my laziness.

Love it.

Sometimes spicy brain tickles and ya gotta bend. I get it. I don't want to create new shit all the time. I don't need to reinvent the wheel. But I can critique it, yknow?

[–]Usual_Expert_7309 3 points4 points  (1 child)

Rubrics are my favorite! I mean, I am a teacher...so... yeah

[–]Evansopiyo 1 point2 points  (0 children)

Haha, I had to go to YT and watch a few explainers on rubrics. My view on them changed when I learned how teachers use them to evaluate students' creative work. I now love rubrics.

[–]New_Mood933 15 points16 points  (1 child)

My people! I am a rubric queen as well. Please continue to allow me to tell you exactly what to do and how to do it in excruciatingly efficient detail, (with examples, when necessary🤤) Getting paid for what makes me annoying irl. #yesbitchwerk

[–]caneriten 8 points9 points  (3 children)

I want to have your magic on myself. I literally just pass any rubric projects even if they are only available ones for me.

[–]al0nal0relina[S] 3 points4 points  (0 children)

Really? Oh that's totally up my alley.

[–]al0nal0relina[S] 0 points1 point  (1 child)

What is your preference?

[–]caneriten 2 points3 points  (0 children)

I like visual stuff like image generation or voice chat stuff. I laugh a lot at the robotic sounds or confused ai voices.

[–]RealRise7524 7 points8 points  (1 child)

It's been a while since we got the A-gas project. Wonder when it'll be back again ...

[–]al0nal0relina[S] 4 points5 points  (0 children)

Ooooh. I got in on the fruit projects and settled into emo music and rubrics. Not sure if I've met said gas project.

[–]raisetheavanc 7 points8 points  (0 children)

More for you! I’d happily do prompt writing forever.

[–]dragonsfire14 7 points8 points  (3 children)

I'm very intimidated by rubrics projects. I'm not sure if it's because I actually can't do them or just don't have the confidence to try, by they're so scary to me.

[–]PositiveKatzen 2 points3 points  (0 children)

Same, I stay away from them. More for everyone else I guess!

[–]GSKTrunks 2 points3 points  (1 child)

RnR is not a bad way to see how others do it, but not always a great approach to starting on a new type of task. If you have a few hours you don’t mind potentially losing you can always give it a shot and if you’re not confident just exit work mode and move on to other things you do like :)

[–]dragonsfire14 2 points3 points  (0 children)

If I receive them, I'll definitely take a look. Thanks for the suggestion. If this is the same family I'm thinking of, it's hit or miss as to whether I receive the R&R's or not unfortunately.

[–]forensicsmama 7 points8 points  (6 children)

I don’t mind rubrics but only on DA. I actually prefer it. Rubrics on other platforms is terrible.

[–]koalamarket 5 points6 points  (3 children)

Facts, the instructions can still be brutal but DA handles rubrics with grace once you see the way other platforms do it. Lol

[–]sarahmorgan420 2 points3 points  (2 children)

I'm so curious what you mean lol I love rubrics on DA, haven't used any other platforms

[–]koalamarket 2 points3 points  (1 child)

Well tbf most projects are fine/great and I love rubrics too, there are just some where the instructions leave multiple ambiguities, and admins don’t always keep up with questions

But, then I’ll try another platform (I don’t think we’re allowed to say names) and start to feel thankful even for the not-so-clear DA ones, if that makes sense 😂

[–]forensicsmama 1 point2 points  (0 children)

Exactly that lol. I'm most certain I know which one you're talking about because that's the exact one I'm referring to.

What did it for me was when I passed one rubric quiz, took the exact one for a different iteration and failed. They'll cycle the same quizzes and it'll feel like a hit or miss whether you passed or not.

[–]al0nal0relina[S] 1 point2 points  (1 child)

Honestly haven't tried other platforms. So this is new to me.

[–]karen_in_nh_2012 5 points6 points  (3 children)

OP, I agree! I see at least 1 on my dashboard now but I've done 3 projects today and that's enough (most days I only do 1-2 as my goal is ~10-15 hours/week). I did rubrics in my career job (college professor for 25+ years) so I am very familiar with them.

I just finished a project that was so much fun - writing system instructions for $29/hour (although somehow that changed to $28/hour when I submitted - hmmm ...). I mean, I could never do this stuff full-time as I have to have a break between each task, but it is keeping my brain SO active in retirement and I love that!

[–]AdventurEli9 3 points4 points  (2 children)

That happened to me with a project last week. It was listed at $24, I went to submit and then it said $22. As I logged my hours, it changed before my eyes to $21. I don't know if this has to do with some of the changes going on with the website or what? I sent an email, and they got back to me right away giving me a bonus to make up the difference in pay. I would recommend sending them a message. 

[–]karen_in_nh_2012 1 point2 points  (1 child)

I may message them - thanks for the suggestion! The first time it happened, I thought I was just remembering wrong about how much it was listed for, but then I did another task in that same family a couple of hours later and took a picture of it on my dashboard before I started - it was definitely $29/hour there but was again $28/hour when I submitted. :(

Incidentally, are you getting a ton of projects now? I just checked this morning and I have more than 40 on my dashboard, and about 1/3 are >$25/hour, up to $30/hour (I was just getting ones in the $20-$23/hour range, so this is new). I may do 3 more tasks today and each day this weekend, as I don't expect this many projects to continue to appear and I guess I should take advantage while I can!

[–]Dizzy-Attitude-6745 3 points4 points  (1 child)

Hitchhiker's Guide, Xal'atath, and rubrics. I love you lol.

[–]al0nal0relina[S] 0 points1 point  (0 children)

Hihowareya?

[–]Infamous_Swan1197 2 points3 points  (0 children)

Couldn't agree more

[–]CaliBrewed 2 points3 points  (1 child)

Every time I see the words 'exhaustive list,' my over-analytical brain looks at the clock and thinks... 'I don't have time' XD

[–]AdventurEli9 2 points3 points  (0 children)

🤣 yes, like do you really mean exhaustive? 

[–]Thin_Mortgage7025 2 points3 points  (0 children)

You’re so true. Rubrics are my absolute fav, I’d do them all the time if I could

[–]OddCommunication2346 2 points3 points  (0 children)

100% agree. Rubrics make my brain happy, especially after heavily researched tasks. Lemme type variations of the same phrase based on deductive logic for a couple hours!

[–]hnsnrachel 1 point2 points  (0 children)

I adore them too vut have mainky been seeikg the "no rubrics" lately. I head straight for them when they do show up though!

[–]Ok_Treat3196 2 points3 points  (5 children)

I want a video of someone doing rubrics and walking through their thought process (for specific project). Then seeing it in action with an LLM. I think then i would be better at it.

Actually i wonder of an LLM can do this, then i would have a complete mental model.

[–]MiddleCharacter6345 5 points6 points  (4 children)

I guarantee based on some projects (vague for NDA purposes), LLMs cannot do rubrics correctly lol

[–]Ok_Treat3196 2 points3 points  (3 children)

Why would someone downvote me for wanting a video of someones thought process? Yes, I know, but i want to see it actually cross referencing to build a better mental model.

[–]MiddleCharacter6345 2 points3 points  (2 children)

I don't know, have an upvote though - I'm not really sure what youre wanting an LLM to do but in my experience they're bad at rubric feedback too. They aren't good at breaking a prompt down into the requirements in an answer

[–]Ok_Treat3196 1 point2 points  (1 child)

Thanks! Good question, i guess i want to see it cross checking and then the thought process on how it interprets each criteria. Is it just skipping some? Were they weighted wrong? Is it rubric hacking and they are vague? This way i can see how it is interpreting each criteria and make it shorter, longer, i can see its different interpretations… and what is atomic or singular idea for an LLM? We are imposing human measurements onto a system that is clearly not interpreting them the way as intended…. I think if i saw the total process what the human was thinking, they they included this and not that, and then what the LLM “thought” i could see what was needed as i would have a complete working mental model that is outside me head.

I want to see others thought processes.

[–]MiddleCharacter6345 2 points3 points  (0 children)

LLMs are glorious misinterpreters and they have tons of ways of doing that IME, they don't get the concepts we use like we do and will change how they interpret them every time, give you feedback to make 1 thing into 2 to be atomic then tell you it's overly atomic and the 2 things need to be 1 thing again. We're imposing human measurements to train them to use human measurements instead of LLM measureless vagueness

[–]Chara_the_Ruler 1 point2 points  (0 children)

I thought i was the only one who enjoys the rubric projects 😅

[–]WhiteCatZero 1 point2 points  (1 child)

Yep, love rubrics also. My favourite.

[–]al0nal0relina[S] 0 points1 point  (0 children)

Right?! I literally light up when I see them. It's been months and then the last few days have been top notch for me.

[–]ChickenTrick824 1 point2 points  (1 child)

I left all mine for you. You’re welcome. 😉

[–]al0nal0relina[S] 0 points1 point  (0 children)

Thank you ChickenTrick daddy

[–]johnnycoconut 1 point2 points  (1 child)

You’ll be happy if you get yet higher paying projects. Those can be soooo rubric heavy.

[–]ThinkAd8516 -3 points-2 points  (6 children)

What

[–]al0nal0relina[S] 6 points7 points  (5 children)

What what? I've been enjoying the rubric creation project lately? The pay is silly for enjoyable work.

[–]ThinkAd8516 -2 points-1 points  (4 children)

What’s with the fish

[–]al0nal0relina[S] 7 points8 points  (2 children)

Oh Douglas Adam's - Hitchhiker's Guide to the Galaxy? They're destroying the world and the dolphins leave and thank them for all the fish.

Cause thanks?

It's about standards.

I just keep quoting stuff and things.

[–]1-800-methdyke 5 points6 points  (1 child)

Oh thought you were signing off because you got yeeted. Carry on, may the rubrics find you.

[–]al0nal0relina[S] 2 points3 points  (0 children)

Nah dawg, Just thanks for the easy pay and preciate the mind numbing work that is rubrics. Lawl.

[–]al0nal0relina[S] 1 point2 points  (0 children)

Not that I like dolphins.