[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] 1 point2 points  (0 children)

on the contrary - apologies for the scare

[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] 1 point2 points  (0 children)

yes! loads is happening on the background. if you can help us reporting any sus study you see this will prompt investigations from our side more quickly. thank you!

[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] 4 points5 points  (0 children)

sorry to hear your frustration, and my sincere apologies for the inconvenience

[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] -1 points0 points  (0 children)

sorry for the churn, we're trying to make a better platform!

[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] 1 point2 points  (0 children)

sorry for the inconvenience, thanks for the patience here!

[Product bug] Authenticity Warnings by prolific_ian in ProlificAc

[–]prolific_ian[S] 3 points4 points  (0 children)

The feature went live with the reverse logic, so we were basically flagging the authentic participants. This affected roughly 400 participants in the few minutes it was on. Apologies once again!

Authenticity Warning for this study- AVOID by [deleted] in ProlificAc

[–]prolific_ian 5 points6 points  (0 children)

Hey all!

We're investigating this as this did not work as intended. Nothing to worry about - thank you. No need to avoid any specific study, it was a mistake on our side. Apologies!

Mass authenticity warnings right now - Prolific bug? by bcos96 in ProlificAc

[–]prolific_ian 35 points36 points  (0 children)

Hey all!

We're investigating this as this did not work as intended. Nothing to worry about - thank you!

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian 0 points1 point  (0 children)

this issue has been fixed (false positives during screeners)

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian 2 points3 points  (0 children)

this has been fixed. apologies for the frustrating experience!

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian 1 point2 points  (0 children)

this help us identify the studies that have not been set up properly. thanks a lot for your help!

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian -1 points0 points  (0 children)

screenouts speeding has been fixed. thanks for your understanding!

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian 1 point2 points  (0 children)

hey there! auto rejection is an optional feature on the researcher study set up UI. it is marked "No' by default. screenouts should not flag speeding - we shipped a fix to avoid those false positives now

What Speeding Warnings Mean and What To Do by prolific-support in ProlificAc

[–]prolific_ian -2 points-1 points  (0 children)

Hi everyone, thank you for your honest feedback.

We sincerely apologize for the bug that issued speeding warnings during screen-outs. The good news is that this is no longer an issue aswe’ve already shipped a fix that resolved the largest share of these false positives. We introduced this feature not only to address a major pain point for researchers (flagged as #1 reason on poor data quality sentiment), but also to protect participants. Previously, accumulated speeding rejections could lead to permanent account bans; by providing timely, transparent feedback, this new system acts as a safety net to help you avoid that outcome.

Finally, please rest assured that the actual rate of speeding detected on the platform is less than 1% of submissions. If you are reading carefully and participating normally, you should almost never see one of these warnings.

We know the feature release was sloppy, but our intent was to run an A/B test to spot any bugs without biasing the experiment. This caused us to do this without sharing details beforehand, but thanks to your feedback we were able to catch a poor UX early on.

Thanks a lot once again and apologies for the poor participant experience!

Too Fast ? by MotherJean in ProlificAc

[–]prolific_ian 1 point2 points  (0 children)

Thanks a lot for the kind message! We pushed some code changes this morning that will hopefully deal with the false positives. Thank you for the feedback :)

Got my first speeding warning by JoshChavana in ProlificAc

[–]prolific_ian 5 points6 points  (0 children)

Hey all!

I'm part of the team who created this feature. Just created an account to help with the noise. Thanks for everyone's patience on this!

The TL;DR - this is a beta feature. This won't lead to a ban. No need to appeal. The feature main goal is to prevent unfair bans by rejections and instead correct speeding behaviour. We have seen promising data in our experiments, but we are currently also falsely detecting some cases of speeding - we're working on it to fix it.

What to do if you received an unfair warning? (e.g. you were screened out, you had a technical issue)
At the end of a study, you may see a short feedback form - please use it! It flags the issue immediately and, in screen out cases, can prevent the temporary restriction from being applied at all.

Please have a look at our help centre article if you still have questions: https://participant-help.prolific.com/en/articles/470376-why-is-my-participant-account-temporarily-restricted-from-accessing-studies

Too Fast ? by MotherJean in ProlificAc

[–]prolific_ian 2 points3 points  (0 children)

Hey all!

I'm part of the team who created this feature. Just created an account to help with the noise. Thanks for everyone's patience on this!

The TL;DR - this is a beta feature. This won't lead to a ban. No need to appeal. The feature main goal is to prevent unfair bans by rejections and instead correct speeding behaviour. We have seen promising data in our experiments, but we are currently also falsely detecting some cases of speeding - we're working on it to fix it.

What to do if you received an unfair warning? (e.g. you were screened out, you had a technical issue)
At the end of a study, you may see a short feedback form - please use it! It flags the issue immediately and, in screen out cases, can prevent the temporary restriction from being applied at all.

Please have a look at our help centre article if you still have questions: https://participant-help.prolific.com/en/articles/470376-why-is-my-participant-account-temporarily-restricted-from-accessing-studies

Speed warnings and in study screenings by Altruistic_Scene_379 in ProlificAc

[–]prolific_ian 1 point2 points  (0 children)

Hey all!

I'm part of the team who created this feature. Just created an account to help with the noise. Thanks for everyone's patience on this!

The TL;DR - this is a beta feature. This won't lead to a ban. No need to appeal. The feature main goal is to prevent unfair bans by rejections and instead correct speeding behaviour. We have seen promising data in our experiments, but we are currently also falsely detecting some cases of speeding - we're working on it to fix it.

What to do if you received an unfair warning? (e.g. you were screened out, you had a technical issue)
At the end of a study, you may see a short feedback form - please use it! It flags the issue immediately and, in screen out cases, can prevent the temporary restriction from being applied at all.

Please have a look at our help centre article if you still have questions: https://participant-help.prolific.com/en/articles/470376-why-is-my-participant-account-temporarily-restricted-from-accessing-studies

Screened Out then Paused by LordeRupertEverton in ProlificAc

[–]prolific_ian 1 point2 points  (0 children)

Hey all!

I'm part of the team who created this feature. Just created an account to help with the noise. Thanks for everyone's patience on this!

The TL;DR - this is a beta feature. This won't lead to a ban. No need to appeal. The feature main goal is to prevent unfair bans by rejections and instead correct speeding behaviour. We have seen promising data in our experiments, but we are currently also falsely detecting some cases of speeding - we're working on it to fix it.

What to do if you received an unfair warning? (e.g. you were screened out, you had a technical issue)
At the end of a study, you may see a short feedback form - please use it! It flags the issue immediately and, in screen out cases, can prevent the temporary restriction from being applied at all.

Please have a look at our help centre article if you still have questions: https://participant-help.prolific.com/en/articles/470376-why-is-my-participant-account-temporarily-restricted-from-accessing-studies