Tasks that are used in a pool for getting responses from performers.
Tasks for checking the performers' responses. Control tasks contain correct responses.
Add at least 1% of the control tasks to the main pool. Design control tasks so that different versions of correct responses are used with the same frequency. Configure the Golden set rule to filter out performers who give incorrect answers. Add Skill filters to select performers by response quality.
Tasks for performers to practice before completing general tasks. Training tasks contain the correct response and a hint. If the performer responds incorrectly, they see a hint.