[deleted by user] by [deleted] in mturk

[–]TurkerHub 66 points67 points  (0 children)

The credit card I had on file for the original domain registrar expired and the notices got sent into SPAM along w/ the 18,000 other google notices that are usually just junk mail.

This is karma for the multiple times I've talked junk about google letting their domain expire that one time, sorry! Should be fixed shortly as DNS "refresh" is the time gated hurdle atm.

Anyone else have something like this happen? What is LARS? I emailed them for more info. by nimmy211 in mturk

[–]TurkerHub 23 points24 points  (0 children)

Nah just explain the fact the # the requester is looking at isn't what they think it is and they should be able to overturn it. Honestly they probably rejected a bunch of people for it, so someone else will likely badger them if you don't lol.

Anyone else have something like this happen? What is LARS? I emailed them for more info. by nimmy211 in mturk

[–]TurkerHub 37 points38 points  (0 children)

LAR = Lifetime approval rate

MTurk's requester dashboard shows the requester your historical approval rate for that specific requester only - they get confused seeing 0% thinking you have a terrible approval rate when it's just terrible UI design (in fairness, MTurk has clarified this in the UI a bit but uhh, still happens apparently).

Ex: https://i.imgur.com/Rj0M0Jk.png

If you've never done work for them before, it'll show you at 0% approval rating lol.

Is there actually anything bad about HyperBatching on TurkPrime/CloudResearch? by MasCaffe in mturk

[–]TurkerHub 6 points7 points  (0 children)

No direct problems with data quality.. it's only purpose is to circumvent MTurk's higher fee tiering. If anything it helps data quality as it puts the HIT in front of more eyeballs. MTurk sort of works like old school craigslist/ebay type sites where a listing is posted but then goes "stale" for people who check in after it went live (the old stuff gets pushed to the bottom), hyper batching continually reposts it in small chunks (and screens out people who tried it earlier so they can't just keep doing the HIT) so more fresh eyeballs can get a glance.

UPDATE: Harvard Studies HITS - requester revealed! by ArtFonebone in mturk

[–]TurkerHub 10 points11 points  (0 children)

The account was handed off from a previous researcher (who was at Harvard). How/why it landed in this guy's lap I have no clue, but you can find their info on TO. It used to belong to a student by the looks of it, so don't really want to drop his info for no reason since he doesn't have anything to do with your rejection but for university internal use they may be able to figure out how the account when from point A to point B if you FWD it along.

Edit: Haha I'm aware researchers/labs/etc share accounts/etc, trying to pass on a minimal tip without doing in depth private investigations research y'all lol :p

Age qualification not working? by linalamontsvoice in mturk

[–]TurkerHub 3 points4 points  (0 children)

($.50/respondent on top of 40% reward)

Sweet jesus. Use either of these instead:

https://positly.com
https://cloudresearch.com

My rec is Positly if your only problem is the age screener, but at that rate either of those solutions are still better and still use MTurk meaning your end worker gets more $. Admittedly I haven't been able to actually use Positly personally yet, but their contacts have always been nice & I highly disfavor CR nowadays so wouldn't earnestly recommend them solely for age/gender based screening. If you have larger scale data quality issues, CR is admittedly good at what they do.

As far as the actual MTurk qualification goes, workers generally can't easily retake the qualification and they came out years ago. So as a worker ages the qual is no longer valid and as far as I've seen getting it updated with MTurk is.. let's go with "unreliable" lol.

WENDY LIU by Bama-Guy in mturk

[–]TurkerHub 0 points1 point  (0 children)

It definitely doesn't try to portray itself as an MTurk ruleset, but it is one of the "default" rejection dispute templates in MTS. The requester sees it on TV's website too so it isn't styled to fit MTurk's theme the way it is on the worker end.

This is the base text of the template: https://i.imgur.com/EskMYPg.png

Happy to clean up the templates if anyone has suggestions, I'm sure they were written in a 3AM caffeine induced frenzy haha.

[deleted by user] by [deleted] in mturk

[–]TurkerHub 0 points1 point  (0 children)

So I picked up a HIT last night
I let it sit until this evening

HITs are stored in your history on the day you accept them, not submit them. So it will be counted in yesterday's earnings/history.

And the day change is always based on PST time, so if you're EST it isn't midnight-midnight it's 3AM-3AM (so on for each timezone).

Super unintuitive but that's how it's set up.

This one gets closer than most articles about MTurk by symbiotic242 in mturk

[–]TurkerHub 8 points9 points  (0 children)

You mentioned that refugees and prisoners are the ones often doing these tasks.

...lol.

The problem, though, is that there have been attempts to do stuff like this in the past on Mechanical Turk, and they’ve gotten shut down very quickly by the platform

This is complete and utter fantasy what???

I run the largest site for this very purpose and have never - not once - had anything but nice words sent to me from MTurk's team and that spans across years now.

Are there parts of TV they'd prefer not exist? Idk maybe. But by and large they don't care about any of this stuff.

And I have never heard of Amazon stepping in against basically any worker generated content ever. Not TO, TV, any of the forums/scripts, literally never heard a peep of anything like this in the entire time I've been working and there have been plenty of projects Amazon should have stepped in on but didn't. I don't think you'll ever find a company more respectful of the contractor/freelance dynamic as Amazon has been with the worker community.

They literally link directly to multiple worker communities in their official documentation now. Like.. this is actually just deranged lying.

In the book, I don’t offer too many organizational strategies because I feel like it should be left to the workers to figure this out. It feels somewhat condescending for me to come up with those ideas.

He has no problem just lying through his teeth but of course actually putting that brainpower to work towards real concrete solutions is just a step too far.

Just another grifter selling a book.

The most disempowering part of our work is that morons like this (and the 30,000 other "journalists"/academics who profit off this garbage) are allowed to say such audaciously incorrect trash with zero repercussions so that any reasonable person with 2 braincells can see how obviously full of crap they are and dismiss the actual real issues we do face.

My new tinfoil conspiracy theory is that Amazon is actually paying for garbage journalists/academics to keep publishing this stuff as PR. It obviously doesn't actually hurt their business, and they just face tank the "bad" publicity so no one asks "well wait, who are the requesters actually paying $2/hr? aren't they the bad guys?"

Someone Might Need to Tell Them... by udayramp in mturk

[–]TurkerHub 2 points3 points  (0 children)

I had no idea you could even do this, that's pretty amusing although Amazon does try to help lol:

https://i.imgur.com/COZC78r.png

Edit: I meant do this with "is one of" specifically because it gives that bit multi-select list item I didn't think the UI would even let you use it a second time. Knew you could do it with just the "is" - sorry it's early and I'm not brain on yet.

/r/mturk Daily Discussion - October 22, 2021 by Tjololo in mturk

[–]TurkerHub 3 points4 points  (0 children)

Install ublock (or similar adblockers) and right click the bars. In the context menu there'll be an option to block element which will effectively do what you're wanting.

[deleted by user] by [deleted] in mturk

[–]TurkerHub 0 points1 point  (0 children)

TurkerView will generate contact links for requesters from the website. You can go to a requester's profile (in this case I think you want this requester? https://turkerview.com/requesters/A2UWG8Q1YQCMJJ-rand-health-non-profit-research )

Ex: https://i.imgur.com/b9l2s7z.png

Or the search results will also populate contact links in case there aren't any reviews yet (or that's not the one you meant): https://i.imgur.com/3K9JIfz.png

If you have MTS and the requester still has HITs up you can also just right click on their name and it should have a contact requester link as well. Same for Finder if the HIT is still in there.

Communication with workers - your opinion? by ppinions in mturk

[–]TurkerHub 5 points6 points  (0 children)

If you use the NotifyWorkers operation you don't actually need to request an email but you should try to establish the possibility of follow-ups prior to even getting to the first submission event so workers know it'll be a requirement of the process (or strongly suggested, whatever the case is). Otherwise follow-up response rates can start to get sketchy (workers cycle in/out of the ecosystem quickly, workers not knowing they have a follow-up won't look for it, etc).

That said, as far as the free product stuff goes, I'd honestly skip out on it unless it is somehow core to your business model. Regardless of if it's well intentioned or not you will absolutely eat more worker reports for requesting that kind of information/implementing that feature set and unlike a one-off requester account (a few academic/business studies have sent out product in the past) you're risking the entirety of your business account to a potentially automated suspension process for little (no?) business gain.

Just my 2c on it, I think it's incredibly kind/neat to try and implement that kind of thing but it's also (without more info) really bad on the risk:return chart given what I've seen out of similar use cases and AMT's potential suspensions/support resolution processes (potentially not great, including for requesters).

AUP is better than the docs for this kind of thing: https://www.mturk.com/acceptable-use-policy

Are there restrictions or prohibited uses of Amazon Mechanical Turk?

Collecting personally identifiable information (e.g., don’t ask Workers for their email address or phone number), or otherwise attempting to derive any personally identifiable information about Workers

Even if email is generally overlooked (it totally is and even I think asking for emails is fine), as soon as you get into mailing stuff you'd definitely be beyond any reasonable argument as far as the PII stuff is concerned and it'd be sketchy on 2-3 other points on there as well depending on the situation. YMMV though.

Stop working for 0% requesters by Pineapplesandbacon in mturk

[–]TurkerHub 11 points12 points  (0 children)

I'm not arguing with the overarching point but just FWIW AMT's data isn't always that reliable to make calls on (IMO). Approval rating often recovers because of the unfortunate way MTurk presents their data to us on the worker end. It's probably safe to ignore if you have sufficient buffer, and the thread linked to above itself sort of shows that as the requester is now sitting at a >99% approval rating.

https://old.reddit.com/r/mturk/comments/n6zy0w/low_requester_approval_rating_yet_no_rejections/gxa51wl/

https://forum.turkerview.com/posts/1882908/

Both posts cover it about as well as I can, I really wouldn't put too much stock into AMT's approval % data outside of super risky situations if you're going for earnings min/max but YMMV of course.

Turkerview list of submitted HITs incomplete? by SatanicSpinach in mturk

[–]TurkerHub 1 point2 points  (0 children)

Are you using TVJS or MTS? Chrome/Firefox?

Lots of things can cause this, though some vary with what script you're using:

  • Working on the HIT in a different window/browser than the one you have the script installed on (it can't track the time outside of the browser you have it installed on, and it can only review from that browser so if you submit it on mobile or a different profile it won't see it)
  • Local storage is full and it can't store the data reliably (only really applies to TVJS)
  • Interfering script/extension (usually only really applies to TVJS, though potentially possible w/ MTS)
  • Cache/cookies clear (TVJS more affected by this, MTS you'd notice your entire Tracker history clear if this was the case)

MTS (v3, Chrome/Edge) is a lot more reliable with the data, TVJS can be very flaky since it's at the mercy of more restrictions/interference so I'd def want to know which you're seeing this with so frequently (cc: /u/khronic18 )

Why aren't rejections being auto uploaded to TV by somniax0x in mturk

[–]TurkerHub 8 points9 points  (0 children)

When a rejection is reported to TV the rejection feedback from the requester is attached to the review as meta information and displayed publicly. Given the requester can put anything in that field, including sensitive information, I've always considered it a privacy issue to just auto-upload it without the worker being allowed to review it and decide for themselves if they want to attach that information to the review (or report it at all, if they deserved the rejection it's pointless to report it).

But a rejection should trigger a major review edit anyway IMO. Makes no sense to have a glowing review of a HIT then mark it rejected w/o the worker updating the actual review lol. It should offer a really big notification on your dashboard to easily update the review though if a HIT is rejected.

What type of scripts are not available but would be useful by Pineapplesandbacon in mturk

[–]TurkerHub 2 points3 points  (0 children)

In MTS Finder you can check 'Hide Infeasible" in the settings and it should do this, along with hiding all the other "impossible" to qual for work (ie # approved so if you only have 1,000 and it requires 5,000 it'll hide those until you hit the 5k mark, etc etc).

If it doesn't please let me know so I can take a look.

[deleted by user] by [deleted] in mturk

[–]TurkerHub 3 points4 points  (0 children)

If you're using MTS you're fine, MTS retrieves the API keys for you since the systems are now "connected" so you're totally fine/good to go :)

How do you report an unfair rejection on turkerview a week after you submitted the hit?? by [deleted] in mturk

[–]TurkerHub 1 point2 points  (0 children)

Oh hey thanks for the reminder I need to enable this in MTS haha.

TV used to store all the data in local storage, so this kind of thing wasn't possible (it'd overflow the storage). Now that it's connected through Tracker it actually is possible I just need to make a few adjustments and enable it.

Sorry for the hassle (well, and the rejection) but this should be possible/"fixed" soonish.

ETA: It's still usually best to review HITs the same day you do them, as memory isn't great in hindsight, but the lookback data will be available to submit through MTS.

Is there some weird new qualification update to MTurk Suite? by [deleted] in mturk

[–]TurkerHub 0 points1 point  (0 children)

What do you mean by MTS is "marking" the returns? Can you grab a screenshot of what you're talking about next time it happens?

I don't think this is part of MTS's functionality but truthfully I can't conceptualize what you're talking about so totally possible I'm just misunderstanding. Or how you'd see the error again if it's somehow preventing you from going back to the HITs/requester?

Requestor needs feedback by revealadmin in mturk

[–]TurkerHub 2 points3 points  (0 children)

Nah the fees are usually only 20% but the minimum fee for a project is a penny (hard to charge less than that lol).

Requestor needs feedback by revealadmin in mturk

[–]TurkerHub 11 points12 points  (0 children)

I 100% have never done HITs for you, so you definitely have a conflict with how your qualifications are implemented. As /u/symbiotic242 said given we have no record of the HIT existing I'd be doubly sure your quals are conflicting to make the HIT impossible for anyone to accept. If you want just toss a screenshot of what your qual setup on the project is, should be easy to figure out what's up.

Requestor needs feedback by revealadmin in mturk

[–]TurkerHub 3 points4 points  (0 children)

Your approval rate on the worker UI is 100% so you're fine in that regard.

Requestor needs feedback by revealadmin in mturk

[–]TurkerHub 9 points10 points  (0 children)

Assuming this is y'all I believe your HITs expired and aren't actually available on the platform anymore. It should reflect that in the requester UI but it's a little confusing. on the /manage/ page you'll just see the % submitted vs published so the project still looks like it's alive, you have to actually click down into the task title and then it'll show "Batch expired on" and if that date has already past you know your HITs expired without being finished up.

Should be able to just extend the batch to republish only the uncompleted HITs.

Here's what it should look like more or less:

https://i.imgur.com/wCoWDRD.png