Product monitoring


Run the project in the Sandbox first. This helps you avoid making mistakes and spending money on a task that isn't working right.

  1. Create a project
  2. Add a task pool
  3. Upload tasks
  4. Start the pool and get the results

Field tasks are completed in the Toloka mobile apps for Android and iOS. A performer chooses a point on the map where they need to go to check something and take photos.

You may need additional projects for your task, such as dataset pre-check or checking performers' responses. Learn more about this in Decomposition of the task.

You may need additional settings for your project, like to add a new button with a particular scenario or a section for attaching files. Learn more in Customization examples.

Let's say you need to check how products are displayed in a store.

To do this, create the following task: the performer needs to come to the store, take a photo of the front of the store, find the relevant section inside, and take a photo of the rack with a certain brand of products. If there are no products of this brand, photos are needed as proof. If there is no store at the address, the performer needs to take a photo of the address sign and the building where it should be located.

Note. This tutorial shows how to create a task interface in the HTML/JS/CSS editor. You can also try creating a task interface in Template Builder.
Task interface

To run tasks and get responses:

Create a project

The project defines what the task will look like for a performer.

  1. Choose a template:
    1. Click + Create project.

    2. Select the Audit of the planogram of products displayed in the store template in the Field tasks block.

  2. Provide general information:

    1. Enter a clear name and a short description for the project. Performers will see this in the task list.

    2. Optionally add a Private comment.

    3. Click Save.

  3. Edit the task interface:

    1. The task interface describes how the task elements should be arranged, what they should look like, and what logic they should follow.

      You can use standard HTML tags and special expressions in double curly brackets in input and output data fields in the HTML block. HTML describes how the elements should be arranged in the task.

      JS is used to describe the task logic. Also, the main content of the task is embedded in JS for ease of editing.

      The template logic specifies a minimum number of photos of the store's front, the object, address sign, and, if there is no object, of the surrounding area. If you want to change these values, find all strings and change the minimum number of photos for each task completion option:

      if (solution.output_values.imgs_facade.length < 2)
      if (solution.output_values.imgs_category.length < 2)
      if (solution.output_values.imgs_around.length < 4)

      In this project, the texts variable stores the texts for the information block and three task completion options: I found the rack; There are no brand products; Store closed or missing.

      The MAX_DISTANCE variable specifies the maximum distance from the designated point (in kilometers by default) that the performer must stay within during task completion. You can specify whatever value you prefer.

    2. Define which objects you are going to pass to the performers and receive from them in response. To do this, add input and output fields in the Data specification section.
      What are input and output data?

      Input data is types of objects that are passed to the performer for completing the task. For example, this could be a text, an image, or geographic coordinates.

      Output data is types of objects that you receive after the task is completed. For example, this could be one of several response options, typed text, or an uploaded file.

      Learn more about input and output data fields.

      The template includes these fields:
      • Input data field:
        • name — A string with the name of the organization.
        • image — A string with the link to the product photo.
        • address — The task address.
        • product — A string with the object description.
        • coordinates — Coordinates of the point that the performer should go to.
      • Output data fields:
        • address — The task address.
        • coordinates — The task coordinates.
        • verdict — The task status.
        • imgs_facade — Array of files with photos of the store uploaded by the performer.
        • imgs_category — Array of file with photos of the rack uploaded by the performer.
        • imgs_around_org — Array of files with photos of the surrounding area uploaded by the performer.
        • imgs_plate_or_address — Array of files with photos of the address sign uploaded by the performer.
        • comment — Text field with the performer's comment.
        • worker_coordinates — The performer's coordinates at the moment of task completion, with the Current location option turned on.
    3. To show the name and description of the point in the task, edit the fields:
      • Address: {{inputParams['address']}};
      • Coordinates: {{inputParams['coordinates']}} .
    4. Click to see the performer's view of the task.

      Note. The project preview shows one task with standard data. You can define the number of tasks to show on the page later.
    5. Save the changes.

  4. Write instructions for performers:

    1. Write short and clear guidelines (see the recommendations). Describe what needs to be done and give examples in them.

      You can prepare instructions in HTML format, then copy and paste into the editor. Click <> to switch to HTML mode.

      Field task instructions should be easy to read on a mobile phone screen.

    2. Click Finish.

Add a task pool

A pool is a set of paid tasks sent out for completion at the same time.

  1. Open the project and click Add pool.
  2. Give the pool any convenient name and description. The pool info is only available to you. Performers can view only the project name and description.
  3. Set the price per task, for example $0.2. For field tasks, always add one task per suite.
    What is a task suite?

    A task suite can contain one or several tasks that are shown on the same page. If the tasks are simple, you can add 10-20 tasks per suite. Don't make task suites too long because it slows down loading speed for performers.

    Performers get paid for completing the entire task suite.

    The number of tasks per suite is set when uploading tasks.

    What is a fair price for a task suite?

    The general rule of pricing is the more time the performer spends to complete the task, the higher the price is.

    You can register in Toloka as a performer and find out how much other requesters pay for tasks, or see examples of cost for different types of tasks.

  4. Set the Time allowed for completing a task suite. It should be enough to get to the place, find the specified point and upload photos. For field tasks, we recommend allocating a day — 86,400 seconds.
  5. Set Overlap, which is the number of performers to complete the same task. For field tasks, it is usually 1.
  6. Turn on the Non-automatic acceptance option and enter the number of days for checking the task in the Deadline field (for example, 7).
    What is non-automatic acceptance (assignment review)?

    The non-automatic acceptance option allows you to review completed assignments before accepting them and paying for them. If the performer didn't follow instructions, you can reject the assignment. The maximum allowed period for the review is set in the Deadline field.

  7. Add Filters to select performers. To make your tasks available in the Toloka mobile app to English-speaking performers located in Moscow, set the language and region.
  8. Save the pool.

Upload tasks

Download the sample upload file. You can find it on the pool page. At the top-left of the page, there are links to TSV files with regular, control, and training tasks. Use it to prepare your own file with tasks.

  1. Click Upload. In the window that opens, you can also download a sample TSV file by clicking Sample file for uploading tasks.

    What is TSV?
    A TSV file presents a table as a text file in which columns are separated by tabs.
    You can work with it both in a table editor and a text editor, and then save it to the desired format. More about working with a TSV file. There is a CSV format that is similar to TSV, but you should use a TSV file for uploading.
    Note. Before uploading the file, make sure it is saved in UTF-8 encoding.
  2. Add input data in it. The header of the input data column contains the word INPUT. For field tasks, you also need to specify the latitude AI:latitude and longitude AI:longitude of the point. You can use a service like Yandex.Maps to get the coordinates.

  3. Upload the tasks by choosing Set manually and set 1 task per page.

Start the pool and get the results

  1. Start the pool by clicking .
  2. Track the completion of tasks in the Pool statistics section.
  3. When the first results come in, you can start reviewing.

    To review assignments, go to the pool and click Download results. To download attachments, click the button next to and choose Download attachments.

    Note. After the specified time period, all responses are automatically accepted, regardless of their quality.