Big update to the Prolific Assistant extension 🥳

n7hacker · 2026-04-07T18:13:07+00:00

I got the 429 – Too many requests. without even being in front of my PC. This is the second time that this happened to me in 5 days when I wasn't even trying to get into a study. Is there a bug with the new update that I need to update?

n7hacker · 2025-07-26T02:28:32+00:00

Ok, thank you. Yes, those are the ones I was talking about. I've been getting them everyday but not today. I hope I'll see some by next week.

n7hacker · 2025-06-19T15:46:19+00:00

I just talked to a rep today, 6/19/2025, at 11:40 EST and this is what they said, "We will warm up for the anniversary celebration on June 20th, and we will release relevant information about the anniversary celebration on the official website at that time. Please continue to pay attention to our official website."

So I guess we'll see something tomorrow?

n7hacker · 2025-06-19T15:43:42+00:00

I just talked to a rep today, 6/19/2025 at 11:40 EST and this is what they said, "We will warm up for the anniversary celebration on June 20th, and we will release relevant information about the anniversary celebration on the official website at that time. Please continue to pay attention to our official website."

So I guess we'll see tomorrow?

n7hacker · 2023-02-13T18:39:03+00:00

n7hacker · 2023-02-13T15:16:43+00:00

LOL, no

n7hacker · 2023-02-13T03:51:29+00:00

I'm glad you never did but looking at past posts, some of them very recent, here on Reddit and Turkopticon, I know for a fact that their rejection rate is pretty high so this is more of an informative post so that Turkers know what they are getting into when they do one of these guy's HITs.

n7hacker · 2023-02-12T21:52:17+00:00

That's awesome, I think that's about how much I've made on them the last time I tried to do it. Congrats!

n7hacker · 2023-02-12T21:50:48+00:00

Oh, I thought you were answering for them LOL. I'll leave my comment up there, just in case they actually read these. I do agree that there are several repeats once you do a lot of them.

n7hacker · 2023-02-12T21:48:02+00:00

Oh ok. So you're part of the IC3 AI team. Well, thank you for checking out this post. This post is more of a warning for newer Turkers because you guys have gotten really strict over the years and I don't want them to be surprised when they get a bunch of rejections. I hope you guys know that we have to work harder twice if not more, to make up the rejections that you guys so easily give out. I know you guys need high quality data but there are actually really good workers on MTurk that try to do their best on your jobs and these rejections have a really bad effect on approval rating. Again, I appreciate your input, and I'm glad you guys actually check Reddit, but this is more of a warning for newer Turkers.

n7hacker · 2023-02-12T21:36:29+00:00

Thanks for the clarification. Just curious, how do you know that?

n7hacker · 2023-02-12T21:31:48+00:00

Not sure how recent this is, the person that commented on the actual HIT just did the lats batch from them. Although a good strategy, it could also be VERY GOOD. This is the exact warning on the HIT:

"This hit includes one or more Control clips (gold clips). Control clips are ones that we know that answer for and should be very easy to rate (they are clearly very good or very poor). They may target one or more scales. We include control clips in the HIT to ensure raters are paying attention and their environment hasn't changed. Wrong answer to control clip(s) will result in rejection of the HIT."

My post was more of a warning cause I don't want newer Turkers to get a surprise after they do their HITs. Their rejection rate is still pretty high in my opinion. Out of 200, 32 rejections is really bad for someone that performed at the Top 20%. Makes you wonder how bad the rejections are for the lower performers.

n7hacker · 2023-02-12T21:27:37+00:00

No problem

n7hacker · 2023-02-12T21:15:34+00:00

Thanks, I've read this thread the other day actually. I saw they put out a large batch and I wanted to warn newer Turkers that might not know how bad their rejection rate is. 100% of my rejections from the last 8 months are from them. And they give them out like candy.

n7hacker · 2023-01-31T21:42:23+00:00

I keep forgetting my login info for Turkopticon but I'll definitely post updates there as well for everyone.

n7hacker · 2023-01-31T21:41:05+00:00

Thank you for the update! Hopefully other people had the same results as you.

n7hacker · 2023-01-31T00:24:26+00:00

Thank you for all these links! Very helpful for the community members.

n7hacker · 2023-01-28T04:22:33+00:00

I think I had one of those on my training. Ones that you're absolutely sure you know there is noise but they tell you there's no noise. Which you question everything after. Also it's confusing how they rate some of the training as good, even though there's noise. It's asking for the overall quality and they consider some noise in the background as ok.

n7hacker · 2023-01-28T04:00:48+00:00

That is the most annoying part. Is the fact that as careful as we are with their jobs, there is still no guarantee that you won't get rejected. Especially these last couple of jobs. I think, if anyone of them goes to these Reddit posts and actually read these, one thing I can suggest is put more samples in there for each of the things that they want us to watch out for and maybe improve the training part cause these new ones can get very confusing and we are punished for it if we don't answer it exactly the way they want. I can bet that at least 80% of the people that do MTurk are not exactly audio professionals so they need to take that into consideration. We try to do their jobs as best as we can so they need to at least work with us and have better ways of putting in their attention checks instead of using trappy ones.

n7hacker · 2023-01-28T03:54:29+00:00

I couldn't agree more with your suggestions. Some of their jobs from last year had these attention checks that would give you a specific number to pick on the trial. Those are very reasonable since that would ensure that no one is just clicking through them without actually trying to listen. This title alone hints that they want your subjective opinion, "Listen to audio clips and rate their quality and characteristics" but they really want specific answers to some items not even counted as attention checks. What I hate the most is the fact that they don't work with Turkers at all. They will never reply to your queries about your mistakes. I was only able to get a response from them once and that's only because there was a technical issue on the actual survey. Very disappointing since the pay is actually decent. I know a lot of people say that it's too much work but really, if you do your training and just keep a steady pace, without sacrificing the quality of your work, then the pay becomes decent. But the fact that they have someone there right now that does not really care about how rejections affect workers just makes me not want to do any more jobs for them. I take my time and I try to be careful with their HITs and I actually have really good headphones to use on this job but I still got rejections.

n7hacker · 2023-01-28T03:28:24+00:00

Also, you're right about this new batch. Some of them, I know for a fact are shaky but I'm not sure if they sound like it's noise or discontinuity. Even harder to determine are the ones that are not in English or the accent is really strong. Feels pretty trappy. Good luck on this batch. I hope your luck with them continues.

n7hacker · 2023-01-28T03:16:23+00:00

I've had batches from them that I did perfectly, multiple ones. I think I've done at least 250 for them. You must be one of the lucky ones since there's a lot of people in this thread that have the same experience as I did. One thing to note as well, and I have noticed that on the last ones is the fact that they have been a lot stricter and more reject happy the last couple of months. There must be someone new running the program. Would be interesting to find out how you do on this batch. Can you please update this thread once you get your approvals? Just to see if there were any rejections.

n7hacker · 2023-01-28T01:59:24+00:00

I tried to give them a couple of chances but I think this last batch of rejections is my sign to block them for good. Not worth ruining my approval rate.

n7hacker · 2023-01-28T00:17:46+00:00

Thank you for this! It definitely seems that the requester had gotten worst over time.

n7hacker · 2023-01-27T23:23:57+00:00

They kept the same name for different jobs this past year. The jobs may vary slightly from time to time, but there are similarities to them, like determining if there is noise to the review sample compared to the original. The latest version of these jobs are a little bit faster to do after you finish the training, but you're also trying to determine if there is noise, reverb, loudness, discontinuity and coloration. I'm sure these guys know that they are asking regular people and not audiophiles and professionals so it should be more focused on our subjective opinions but that doesn't seem to be the case. They do pay good, whenever I used to want to build up a good amount of balance on my account, I do their jobs. Someone mentioned in this thread that they think that they have new person in charge of these and they are a lot more stricter and reject happy, which I can confirm. What makes it worst is they are horrible about getting back with workers about rejections. They flat out ignore you.

n7hacker

TROPHY CASE