Recompletion of assignments from banned users

Use this rule if the Toloker was banned and you want someone else to complete their tasks.

Note

Don't use this rule in pools with dynamic overlap. This increases the maximum overlap value.

When to use

Alert

This rule can increase the cost of the pool.

Use the rule if you want to get responses only from honest Tolokers to each task in the given overlap.

The assignments submitted by banned Tolokers will be taken into account if they are not rejected manually using manual review. They can be reassigned by setting up the corresponding rule.

To download the responses of users who are not blocked:

  1. On the pool page, click Download results on the right.

  2. Click Additional options.

  3. Turn off the Include responses from banned Tolokers option.

  4. Click Download.

Don't use it if:

  • You don't want to increase the overlap for tasks.
  • You don't want the final budget for pool labeling to exceed the initial budget.
  • You set up dynamic overlap. This increases the maximum overlap value.

How to configure

Alert

All fields in this rule are required. If you don't fill in at least one of them, you won't be able to save the rule.

FieldOverview
If

A condition for performing the action in the then field:

then

Action performed under the If condition:

  • extend overlap by — Resend the task suite for completion to other Tolokers.

    If you want an assignment to be automatically reassigned even if your pool is already completed and closed, turn on the option Open pool if closed.

  • reduce overlap by — Decrease the number of times a task can be completed by Tolokers. For example, use this action to cancel the recompletion of accepted assignments.

Examples

Task: classify photos for a dataset across different categories. If a Toloker is banned by a quality control rule (for example, fast resposes) or no longer matches the skill, their responses aren't counted and their tasks are sent for re-completion to another Toloker.

Correct settings
Incorrect settings

Resending tasks from a banned Toloker

If a Toloker is banned by a quality control rule, their tasks are sent for re-completion to another Toloker.

Resending tasks if the Toloker doesn't meet the skill filter

If the Toloker no longer meets the requirements of the skill filter and their responses aren't taken into account, their tasks are sent for re-completion to another Toloker.

For developers

Troubleshooting

What overlap should I set?
Can I change overlap after the pool is started?
Should I create a skill for every pool?
Can I use a skill beyond a particular pool or project and apply it to other projects as well?
What output format do I use for the review results to filter out mismatching Tolokers based on the “Majority vote”?
How do I classify Tolokers as good or not as they complete tasks, and ban the poor Tolokers?
Contact support

Last updated: March 2, 2023

Introduction
Getting started
Important tips
Useful recommendations
Working with Toloka
Projects
Pools
Tasks
Results
Project analysis
Toloka settings
Task interface
Template Builder
HTML/CSS/JS editor
Help and support
FAQTroubleshootingSupportGlossary