Link To TurkPrime

How to run successful experiments and get the most out of Amazon's Mechanical Turk

Showing posts with label mturkgate. Show all posts
Showing posts with label mturkgate. Show all posts

Tuesday, January 5, 2016

HyperBatch - Run Batched HITs at Hyper Speeds

HyperBatch Feature 

You can now run your Amazon Mechanical Turk studies at Hyper speeds. We worked hard to make the experience identical to our classic MicroBatch option so that you simply launch your study and TurkPrime does all the heavy lifting for you.

How it works

When you launch a HyperBatch study with 100 participants, for example, your study appears on TurkPrime exactly as a standard study. However, the study, in fact, is broken down into multiple HITs with 9 or less participants. When you pause or change a study, all of the HITs associated with your study are paused or updated, respectively.

Workers who completed one HIT in the study are disabled from taking additional HITs. TurkPrime automatically assigns the Worker a Qualification that prevents them from taking your study twice.

All existing features such as secret code, include / exclude / groups etc work exactly as you expect them to.

Monday, June 29, 2015

Our Micro-batching Feature will Improve the Quality of Your Data

MicroBatch


We have deployed a micro-batching feature which allows Requesters to break up their studies into smaller segments, and to include time intervals between the segments. We developed this feature to increase sample representation. This feature can also save 50% in MTurk fees.


The Problem

Here is why this feature is important for data quality. If a Requester launches a study on Monday afternoon, there may be a bias in the sample toward people who are not working on a weekday (unemployed, stay at home parents etc.)