Quality control rules

• To keep track of how often performers make mistakes:

  • Control tasks: Use them to assign a skill to performers based on their responses to control tasks and ban performers who submit incorrect responses.
  • Majority vote: Quality is based on matching the response from the majority of performers who complete the same task.
  • Results of assignment review: Evaluate performers based on the number of accepted and rejected responses.
• To protect your project from fake users (robots) and cheaters:

  • Fast responses: Control the minimum time that must be spent on a task page.
  • Captcha: Show a captcha from time to time to make sure tasks aren't completed by robots.
  • Skipped assignments: Restrict access to pool tasks for performers who skip several task pages in a row.
• To attract a variety of performers:

  • Earnings: Limit the amount each performer can earn in the pool per day.
  • Submitted responses: Limit how many assignments each performer can submit in the pool per day.
• To allow recompletion of certain assignments:

  • Recompletion of assignments from banned users: Send completed assignments to other performers to redo them if the performer was banned.
  • Recompletion of rejected assignments: Send rejected assignments to other performers to redo them.

You can configure quality control in the pool and in the project.

Contact support