Recompletion of assignments from banned users
The performer is blocked by one of the quality control rules (such as control tasks or majority vote).
All pool tasks completed by this performer will be resent to other performers. Tasks completed by banned performers are reassigned, but tasks completed by paused performers are not.
Rule settings
Field | Description |
---|---|
If | A condition for performing the action in the then field:
To add multiple conditions, click |
then | Action to perform for the condition:
|
Field | Description |
---|---|
If | A condition for performing the action in the then field:
To add multiple conditions, click |
then | Action to perform for the condition:
|
Examples of rules
- Resending tasks of the banned performer
-
If a performer is banned by a quality control rule (for example, for fast responses) and their responses aren't taken into account, their tasks are sent for re-completion to another performer.
- Resending tasks if the performer doesn't meet the skill filter
-
If the performer no longer meets the requirements of the skill filter and their responses aren't taken into account, their tasks are sent for re-completion to another performer.
Troubleshooting
Calculate the skill for each pool separately. The current skill value is the value of the skill in the pool the user completed last. This option is convenient if:
The pools are intended for different groups of performers (for example, there are filters by city or country).
Pools are started one by one and you don't want to take into account the responses in the previous pools to calculate the skill in the current pool.
This calculation method is used by default when adding a quality control rule to a pool. For the control tasks block, leave the Recent values to use field empty.
Calculate skill based on all tasks in a project This option is good if the pools are small and you don't need to have skill calculated for each pool.
This option is available only for skills on control tasks. To use it, fill in the Recent values to use field in quality control rules in pools.
Overlap defines how many performers complete the same pool task.
The best overlap is an overlap that provides satisfying quality of results. For most tasks that are not reviewed, overlap from “3” to “5” is enough. If the tasks are simple, overlap of “3” is likely to be enough. For tasks that are reviewed, set overlap to “1”.
Yes. Open edit mode for the pool and set a new overlap value. You don't need to restart the pool. Updating the settings is usually fast, but if there are many tasks, it may take several minutes.
It is better to use one skill in a project. You can choose the way to calculate the skill:
Yes, of course — you can use the same skill for different projects. But most often, a skill is intended for a specific project. If the performer completes a certain task well, this doesn't mean that they will complete other ones successfully. Another disadvantage is that if you filter by skills that were set long ago, you will artificially limit the number of available performers.