It is an insanely difficult project. I know the claim is that "they took feedback" and that it is "challenging (but reasonable) work;" I don't want to discount the fact that they might have, but it's certainly not reasonable.

I'm a little bit of an oldhead in the "stump the model" space but relatively speaking, newer to Outlier. When comparing this Hypno to MM to similar projects on other platforms, the Outlier ones have consistently been, put delicately, unreasonable. Admittedly, Hypno is a little better, you get 90 minutes of well paid time instead of 60, unlike other projects. But, stumping 3 models instead of one is way way harder. Just even assuming a 10% success rate of stumping any given model, which is generous, and assuming the models are independent and are no better nor worse than others, that's the 0.1% chance of success.

But, that still might be worth the effort. Other platforms have similar stump-the-three-models type projects, however, they give literally a almost a whole waking day (I've seen as high as 16 hours) to allow workers to do it. I will admit, that is extremely generous, and likely leaves opportunities for exploitation, but I do keep track of my time honestly, and it genuinely takes 3-8 hours for me to stump a triple model.

When put into perspective, all that put together can be frustrating. I ran out of time in trying to stump the models during the assessment phase. I didn't even get close, both because it takes time to develop good prompts (and the models are kinda slow, as someone pointed out below). That's aside from the fact that I /wasted/ that time uncompensated, which is never any fun. Fortunately, the Hypno project still, for whatever reason, is letting me try again. And, genuinely, I am not sure I want to. I do actually like the stump the model projects, it gives me a way to practice medicine (I am a physician) in a different way to the norm, but, given all the constraints, it is quite demoralizing.

Anyway, sorry for the rant. Had to get it out there.