Toloka

Skills

You can use skills to restrict access to a pool. A skill is an assessment of some aspect of the user's performance (a number between 0 and 100), which can be updated as tasks are completed.

To select users by skill:

  1. Create a skill.

  2. Set up a quality control rule for calculating the skill.

    You can also set and edit the skill value manually.

  3. Add a skill filter to the pool.

You can track statistics for skill values and the history of skill changes for each user.

Creating a skill

To create a skill, click Add skill on the Skills page, and fill in the fields:

Field

Description

Name

Skill name. The skill name should specify the project or describe the task this skill is used in.

If the skill is public, users will see the name.

Description

Description of the skill. Only available to the requester.

Public

Access to information about the skill (the name and value):

  • “Off” — Only the requester sees this information.

  • “On” — Users will see this information.

Note. A public skill allows users to get feedback on the quality of their responses and adjust their approach to completing tasks.

Skill statistics

To get statistics about use of a skill, select it on the Skills page. You will see the following information:

  • Maximum level of the skill.

  • Minimum level of the skill.

  • Average level of the skill.

  • Median level of the skill.

  • Number of users that have this skill.

  • Projects and pools where the skill is used (in filters or quality control rules).

  • A list of users and skill values (in a CSV file).

Change history

The history of changes to the skill level for each user is available in a CSV file. To download the file:

  1. Select a user on the Users page.

  2. Point the cursor at the skill line and click .

  3. Open the downloaded CSV file:

    worker_id|skill_id|skill_name|value|created_date|action
    <user ID>|<skill ID>|<skill name>|<skill value>|<skill creation date>|<action: CREATE/MODIFY>

Setting user skill

To set the initial skill value for an individual user:

  1. Select a user on the Users page.

  2. Click ActionsAssign skill, then enter the skill name and value.

To set the initial skill value for multiple users:

  1. Create a skill.

  2. Select users using the filters on the Users page, or upload a CSV file:

    <user id 1>
    <user id 2>
    ...
    <user id n>
  3. Click +Skill, then enter the skill name and value.

You can then use the skill value for user selection.

Editing a skill

To change the skill value for a user:

  1. Select a user on the Users page.

  2. Point the cursor at the skill line and click .

  3. Enter the new skill value.