Golden set

Add a rule to assign a skill to the performer based on their responses to control tasks and ban the performers who give incorrect responses.

Rule settings


Field	Description
History size	How many of the performer's recent responses in the project's control tasks to use for the calculation. If the field is empty, the calculation is based on all the performer's responses in the pool.
If	A condition for performing the action in the then field: Answer count — The number of completed training and control tasks. correct_answers — The percentage of correct responses in training and control tasks (from 0 to 100). % incorrect answers — The percentage of incorrect responses in training and control tasks (from 0 to 100). golden answers count — The number of completed control tasks. % correct golden answers — The percentage of correct responses in control tasks (from 0 to 100). % incorrect golden answers — The percentage of incorrect responses in control tasks (from 0 to 100). To add multiple conditions, click .
then	Action to perform for the condition: set skill from "If" — Save the performer's percentage of correct responses as the skill value. set skill — Assign a constant skill value. Pause — Suspend the performer's access to the pool for the specified number of days. Only the requester can view the reason for the ban. Ban — Block access to the project or all of the requester's projects for the specified number of days. Only the requester can view the reason for the ban. If access to tasks is blocked temporarily (for example, for 7 days), the history of the performer's responses is not saved after the ban is lifted. The skill value is based on new responses.


Field	Description
History size	How many of the performer's recent responses in the project's control tasks to use for the calculation. If the field is empty, the calculation is based on all the performer's responses in the pool.
If	A condition for performing the action in the then field: Answer count — The number of completed training and control tasks. correct_answers — The percentage of correct responses in training and control tasks (from 0 to 100). % incorrect answers — The percentage of incorrect responses in training and control tasks (from 0 to 100). golden answers count — The number of completed control tasks. % correct golden answers — The percentage of correct responses in control tasks (from 0 to 100). % incorrect golden answers — The percentage of incorrect responses in control tasks (from 0 to 100). To add multiple conditions, click .
then	Action to perform for the condition: set skill from "If" — Save the performer's percentage of correct responses as the skill value. set skill — Assign a constant skill value. Pause — Suspend the performer's access to the pool for the specified number of days. Only the requester can view the reason for the ban. Ban — Block access to the project or all of the requester's projects for the specified number of days. Only the requester can view the reason for the ban. If access to tasks is blocked temporarily (for example, for 7 days), the history of the performer's responses is not saved after the ban is lifted. The skill value is based on new responses.

Examples of rules

Calculating a skill and banning for incorrect responses

Both rules work independently:

If the performer gives at least 3 responses to the control tasks, the percentage of correct answers is assigned as the skill value.
If the performer gives at least 3 answers to the control tasks and the percentage of correct answers is less than 60%, they lose access to the project.

The calculation uses up to 10 of the performer's recent responses to the project's control tasks.

The performer is banned after the first incorrect response to the first, second or third control task. The skill is not assigned. Since the ban reason is not specified, there is no way to find out why the performer is banned.

All rules are applied independently:

If the performer gives at least 3 responses to the control and training tasks, the percentage of correct answers is assigned as the skill value.
If the performer gives 2 incorrect answers to 3 control tasks, they lose access to the pool for 10 days.
If the performer gives 2 incorrect responses to 4 control tasks, they lose access to the pool for 10 days.
If the performer gives 5 or more responses to the control tasks and the percentage of correct responses is less than 80%, they lose access to the pool for 10 days.

A set of rules like this prevents performers from being banned for one incorrect response and lets you maintain high accuracy.

Setting the skill

If the performer completes 3 control or training tasks, they get a skill. Use the skill value to set access to other pools with filters.

Example of filter settings

This rule will never take effect because the number of responses counted (History size) is less than the number of responses in the rule (answer count).

Blocking for incorrect responses

If the percentage of correct responses in the control tasks is less than 40%, the performer loses access to the project for 30 days.

This rule doesn't take into account responses in the training tasks for banning.

If the percentage of correct responses in the control tasks is less than 40%, the performer loses access to the project for 30 days. The rule will be applied once — after the fifth response in the control task.