Toloka

Pool parameters

Parameter

Description

Name

The pool name and description (only accessible to the requester).

Description

Training

The name of the training pool.

Level required

Proportion of correct answers in training tasks (from 0 to 100) required to be admitted to the main tasks. Only first answer of the user in each task is taken into account.

Price

Payment per task suite in U.S. dollars. For cents, use the dot (".") as the separator. The minimum price is $0.01.

Time on task

The time allowed for completing a task suite, in seconds. Tasks not completed within this time are reassigned to other users.

We recommend spending no more than 60 seconds per task (including the time for page loading and sending responses).

Overlap

The number of users who should complete each task in the pool.

Expires

The date the pool closes. The pool closes on this date, even if the tasks aren't completed.

Adult content

Whether the tasks have porn content. Tasks with porn content are only issued to users who are prepared to perform these tasks.

If you didn't check whether the tasks have porn content, select "Yes".

Mobile only

Tasks are only available for performing in the mobile interface. In the desktop version, the user will see them in the list of tasks.

Keep task order

Assign tasks in the order they are listed in the TSV file. If the pool has an overlap, the next task is distributed only when the previous task is completed by the neccessary number of users. Use this option to:

  • Speed up collection of responses for majority vote check.

  • Issue tasks by priority. Put important tasks in the beginning of the file. They will be completed faster and with the necessary overlap.

By default, tasks are issued in random order.

Captcha frequency

The frequency of showing captchas:

  • “No” — Don't show captchas.

  • “Low” — Show a captcha after every 20 tasks.

  • “Medium”/ “High” — Show a captcha after every 10 tasks.

To use captchas for selecting users, set up quality control rules. For example:

Offline accept

Check the completed tasks manually.

Deadline

The number of days for accepting the tasks (max — 21). Users will see the deadline:

  • in the task information on Toloka main page;

  • in the history of completed tasks.

Users filter

Settings for selecting users: filters and quality control rules.