Reviewing assignments

If the pool has the review of assignments configured, add a rule to:
  • Set the performer's skill based on their responses.

  • Block access for performers who give incorrect responses.

To have rejected tasks redistributed to other performers, set up the Re-completion after review rule.

Rule settings

Field

Description

History size

The number of the performer's recent responses in the project used for the calculation.

If the field is empty, the calculation is based on all the performer's responses in the pool.

If

A condition for performing the action in the then field:
  • reviewed assignments — The number of the performer's assignments that were reviewed.

  • % accepted assignments — The percentage of the performer's assignments that were accepted (from 0 to 100).

  • % rejected assignments — The percentage of the performer's assignments that were rejected (from 0 to 100).

To add multiple conditions, click .

then

Action to perform for the condition:

  • set skill from "If"— Save the percentage of performer's accepted responses as the skill value.

  • Ban — Block access to the project or all of the requester's projects for the specified number of days. Only the requester can view the reason for the ban.

    If access to tasks is blocked temporarily (for example, for 7 days), the history of the performer's responses is not saved after the ban is lifted. The skill value is based on new responses.

  • set skill — Assign a constant skill value.

  • Pause — Suspend the performer's access to the pool for the specified number of days. Only the requester can view the reason for the ban.

Examples of rules

Blocking for incorrect responses

If more than 50% of performer's responses are rejected, the performer is blocked and can't complete your tasks for 15 days.

Setting the skill

After 3 tasks are reviewed, the skill is set to the percentage of correct responses. Use the skill value to set access to other pools with filters.

Example of filter settings