Sandbox

The Sandbox is a testing environment for Yandex.Toloka. This is where you can test your project settings as a performer before moving the project to the production version of Yandex.Toloka and posting tasks for real performers. This helps you avoid making mistakes and spending money on a task that isn't working right.

Restriction. Note that you can only move project and pool settings. You can't move tasks and responses to them. The project's quality control settings can't be moved, either.

How to run a project in the sandbox

  1. Register in the sandbox as a requester. To do this, follow the link.

    Tip. To avoid confusion, use the Yandex account that you used in the Yandex.Toloka production version to register as a requester.
  2. Configure and launch your project:

How to complete tasks

To complete your tasks in the sandbox:

  1. Register in the sandbox as a performer (see the instructions in the user documentation).
    Attention. Authorization via social media isn't allowed, so you need to register a new user in Yandex.
  2. Log in to the sandbox using the requester account.

  3. Open the Users page and click Add trusted users.

  4. Click Add user and enter the case-sensitive login name of the created performer.

    Only trusted users can access your tasks.

    The number of trusted performers required for testing depends on the overlap settings.

    To test your project in the Sandbox, set overlap 1. If you increase the overlap, you will need to register more performers and add trusted user accounts.

    When exporting a project to the main Yandex.Toloka version you can specify the necessary overlap, in accordance with your project goals.

  5. Log in to the sandbox using the performer account and test your tasks. Make sure that the buttons and response validation are set up correctly, and assess how long it takes to complete the tasks. Make sure that the performer selection and quality control work.

How to move a task to the production version of Yandex.Toloka

To move tasks from the sandbox to the production version:

  1. Link the sandbox and production version's accounts:

    1. Open the External services Integration tab in the production version on the profile page and copy the OAuth token.

    2. Open the same tab in the sandbox on the profile page and paste the copied token into the Production OAuth token field.

  2. Go to the project page in the sandbox and click Project actions → Export.

  3. Choose the pools to export and click Export.

    If to the pool has linked training, it is exported automatically.

Troubleshooting

Is it possible to use the same account for the sandbox and main Toloka version?

No, you need a separate account for each version of Yandex.Toloka. To create a task in the sandbox, register in it as a requester. To complete your own task, register another account for yourself as a performer.

Why don't I see my task in the sandbox?

Make sure that:

  1. The pool is started.
  2. The user is added as a trusted user.
  3. The trusted user is registered in the sandbox as a performer.
  4. The trusted user didn't use social networks when registering.
  5. Your trusted performer matches the filters you set.
I can't add a trusted user.

Possible reasons:

  • The user isn't registered in the sandbox. The account you registered in the Yandex.Toloka production version doesn't suit. Make sure you have specified the correct performer's account as a trusted one.
  • The performer's account is authorized through social networks. Register a new user in Yandex.
What overlap should I set?

Overlap defines how many performers complete the same pool task.

The best overlap is an overlap that provides satisfying quality of results. For most tasks that are not reviewed, overlap from “3” to “5” is enough. If the tasks are simple, overlap of “3” is likely to be enough. For tasks that are reviewed, set overlap to “1”.

Can I change overlap after the pool is started?

Yes. Open edit mode for the pool and set a new overlap value. You don't need to restart the pool. Updating the settings is usually fast, but if there are many tasks, it may take several minutes.