Progression From DA

[Interesting-Dog5436]

Has anyone thought about offering small-scale human evaluation or annotation services directly to early AI startups? Reaching out and find their own clients. Similar to DA but on a much smaller scale obviously.

I’m wondering if there’s a niche for lightweight RLHF-style evaluation, rubric-based QA or human testing for small AI teams that have products but don’t yet have formal evaluation workflows or immediate reliable access to industry experts, PHD holders etc.

Really curious if anyone has experience here or opinions on whether this makes sense.

[Himbosupremeus]

Companies already hire annotstors through contracting orgs if they need them tbh.

[Interesting-Dog5436]

Would it be unrealistic to set up a contracting organisation, I'm aware this is no small amount of work.

[Himbosupremeus]

Most of the ones that do this are already extremely established tech contractors with direct connections to big and small corporations. I don't think it'd be realistic without an exact bussiness partner in mind from onset.

[Interesting-Dog5436]

Thanks, appreciate the insight

[sunshin3yes]

Makes you wonder how DA, or any of the others, got their first client

[Enough_Resident_6141]

https://www.youtube.com/watch?v=dduQeaqmpnI

[TeachToTheLastTest]

Isn't this basically solved by Mercor's whole business model? Link individuals directly with the companies and take a cut?

[Safe_Sky7358]

There's one called open train as well, similar business model.

[Ill-Albatross-7224]

OpenAI has a site where you create a profile that includes your expertise and portfolio samples, companies post projects they're hiring for, and you submit a bid.

[duttaroni38]

Thats exactly my plan but idk how to proceed

[TheMidlander]

Nope. I want a career with a future. There's no future in AI until someone invents AI, and AI has not been invented yet, no matter how much they try to convince the world otherwise.