Link To TurkPrime

How to run successful experiments and get the most out of Amazon's Mechanical Turk

Showing posts with label follow up. Show all posts
Showing posts with label follow up. Show all posts

Tuesday, August 23, 2016

Survey Groups Ensure Unique Workers Across Multiple Concurrent Studies

Problem: Ever want to run multiple simultaneous studies and needed to ensure that each worker only took a single study? There is no simple way to block workers who completed one study from accepting another study run at the same time....until now. 

(The TurkPrime exclude feature will exclude workers who completed one study from taking another subsequent study but not if both studies are run at the same time.)

Solution: The TurkPrime Survey Group (arriving August 25, 2016)  feature allows a user to assign multiple studies to a survey group. Then, any worker who accepts any study in that group will be disqualified from accepting any other study in that group. Your studies will be guaranteed to have a mutually exclusive group of respondents.


The Survey Group option is also a broader exclusion than the standard Exclude Worker option: Survey Group excludes workers who even only accepted one study from taking the other studies in the group, while the standard Exclude Worker option only excludes workers who completed the study but will not exclude workers who accepted but did not complete the first study from taking the second study.

Thursday, May 7, 2015

Longitudinal and Follow up Surveys on Mechanical Turk

Problem:

Suppose you need to run a survey on Mechanical Turk and follow up with the same workers a week, month or year later. A few issues come up:

  1. How can I limit the follow up surveys to survey takers who completed the first study - without the worker needing to follow the link and enter their Worker ID? 
  2. Can I notify those workers of my follow up survey?
  3. Can I set up a follow up survey so that the workers who take that survey do not know why they were selected?

Solution:

Include Workers Feature 

Create your surveys using TurkPrime.com's "Include Workers" feature. When your HIT launches it will have a Qualification Requirement that will limit your HIT to only the Workers you allowed. All other workers will be unqualified from taking your HIT.