Link To TurkPrime

How to run successful experiments and get the most out of Amazon's Mechanical Turk

Sunday, October 18, 2015

WorkerId (and all MTurk Fields) Sent to Qualtrics

Background

TurkPrime can now automatically add Worker ID, HIT ID, and assignment ID to datafiles, including csv and SPSS. These fields can be very useful for matching Workers across multiple datafiles. For example, in longitudinal studies researchers typically have to ask Workers to provide their Worker IDs. These IDs are then used to alight the rows across multiple datafiles that are collected at different time points of the study. Relying on Workers to provide their Worker IDs however typically results in data loss, as some Workers do not enter their Worker ID correctly. Embedded query strings solve this problem by guaranteeing that Worker ID are correctly entered for each Worker.

 How to automatically add Worker ID and other fields to data files.

A video tutorial can be viewed here

On the Design Survey page go to  3. Setup HIT and Payment.

 


Scroll down to Query String Parameters where you can see some information about how this works 

Tuesday, August 25, 2015

Easily Copy Past HITs

TurkPrime has just released a Copy feature which makes duplicating past TurkPrime HITs simple and fast.

To copy the settings from an old survey to a new one, follow these simple steps:


  1.  Go to the HIT you want to copy in your Dashboard, and click the Copy HIT button in the Actions section.
  2. A message box will appear asking you which environment you want to launch your HIT into.



    You can then decide if you want to test out your HIT in Sandbox mode or if you want to review it in Live Mode. This feature is also useful if you originally launched your HIT in Sandbox and now you want to change it to Live.
  3. Once you choose where you want to launch your HIT, you will be taken to the Design Survey screen with all your original survey settings already filled in on the page. You can go over the settings and make any changes you want to before you approve the HIT. After you review the new survey settings just Approve the survey and launch it in your Dashboard, like you would with any other survey.













Monday, June 29, 2015

Our Micro-batching Feature will Improve the Quality of Your Data

MicroBatch


We have deployed a micro-batching feature which allows Requesters to break up their studies into smaller segments, and to include time intervals between the segments. We developed this feature to increase sample representation. This feature can also save 50% in MTurk fees.


The Problem

Here is why this feature is important for data quality. If a Requester launches a study on Monday afternoon, there may be a bias in the sample toward people who are not working on a weekday (unemployed, stay at home parents etc.) 

Monday, June 8, 2015

Bounce and Completion Rate

In the latest release of TurkPrime.com we added many new features and fixes among them 2 additional metrics for every survey:

  • Bounce Rate
  • Completion Rate

The Bounce Rate is the percentage of Amazon workers who previewed your survey but decided not to accept it. An open question is whether and how this self-selection of participants affects the representativeness of the participant pool. In addition, a high bounce rate may be an indicator that there is something wrong with your survey

Thursday, May 21, 2015

Association for Psychological Science Symposium

Please join us this Friday, May 21st at 1pm at our APS symposium in New York City. We will be presenting talks on TurkPrime and how to make the most of Mechanical Turk.




Wednesday, May 13, 2015

Reverse Rejections

Problem:

How can a Requester who rejected an assignment in error undo his mistake? A rejected assignment affects the Worker negatively and will often impact the Requester with negative feedback which can damage the Requester's online reputation which lowers Worker participation in future HITs. What can a Requester do to reverse the rejection?


Solution:

Reversing a rejection in TurkPrime is as simple as using the "Reverse Rejection" feature. Select the WorkerIds you wish to reverse, add an optional message. and you are done! No programming or installations are needed.