Reviewing assignments

You can review assignments manually and reject them if they weren't completed satisfactorily. Rejected tasks are not paid for.

Reviewing assignments may take from 1 to 21 days (this period is set by the requester). When the period ends, assignments that haven't been reviewed are automatically approved. The performer may challenge the results by writing to the requester. The decision can be changed within 30 days from when the assignment was sent for review.

You can also filter out performers based on the percentage of rejected assignments.

Setting up review of assignments for a pool

To be able to review assignments when they are completed, make the settings before starting the pool:

  1. Choose the Offline accept parameter on the pool page in edit mode.

  2. In Deadline, enter the number of days for reviewing (from 1 to 21 days). The performer will see the deadline in the task information on the main Toloka page.

  3. Save your settings.

Performers' responses will become available for reviewing as assignments are completed.

Note. Explain the acceptance criteria in the instructions for performers.

Resending assignments for completion

If you reject an assignment, Toloka can resend it for completion to other performers. To set up automated resending of assignments, add the After review re-assessment quality control rule to the pool.