Project statistics

Open pools

The number of open pools.

Pools (total)

The total number of pools.

Submitted responses

The total number of completed task suites (taking overlap into account).

There may be few completed tasks if your tasks are only available to a small number of performers. This could be due to incorrectly configured filters or skills. In this case, some users don't see your tasks.

It's also possible that training is too complicated or training settings are incorrect.

Recommendations

It there are fewer completed tasks than expected, we recommend that you check the number of active users who can access your tasks. If there are none or very few, check user filters, skill settings, and selection pools.

Additionally, try checking how this parameter might be related to the number of interested users, task completion time, and the number of banned users.

Assignments

The graph shows the number of tasks by type.

• Submitted — the number of task suites sent for review across all pools.
• Accepted — number of accepted task suites for all pools.
• Skipped — number of task suites skipped by performers.
• Expired — the number of task suites that have expired. The pages that the performers failed to complete on time or refused to complete them are taken into account.

Recommendations

If you have a lot of skipped or expired tasks, we recommend that you read our Tips for designing tasks and set up the skipped assignments rule.

Average overlap

The average number of performers who completed the same task in the project.

Recommendations

If you think that this number is too large or small, you may have incorrectly configured Recompletion of assignments from banned users or Processing rejected and accepted tasks. You may also want to check:

• Dynamic overlap (incremental relabeling, IRL).
• Random majority vote check.

Task completion time

The average time spent on one task suite across all project pools. Specified in seconds.

Money spent (+markup)

The total amount of money spent on the project. The fee amount is shown in parentheses.

Please note that the minimum fee is $0.005.

Recommendations

If you spent more than you planned, check the price settings in the pool and the quality control rules. For example, Dynamic pricing and Recompletion of assignments from banned users increase the cost of the pool.

Disable rules that increase overlap and then revise the price per task suite. You might need to decrease it, but don't make it unreasonably small.

You can also increase or decrease the number of tasks per suite and adjust the price accordingly.

Spending (excluding markup)

The graph shows the amount of money spent excluding markup.

• Spending on bonuses — The amount of money spent on extra rewards.
• Spending on assignments — The amount of money spent on tasks.

Average task price

The average price in USD per main task in the project, including overlap.

Note that this is the price per task, not per suite with overlap.

Recommendations

If you think that the price is too high, check the price settings in the pool and the quality control rules. For example, Dynamic pricing and Recompletion of assignments from banned users increase the cost of the pool.

Banned users

The number of performers who are blocked from accessing the project.

The graph shows two indicators:

• On the project — Number of performers banned from the project.
• By the requester — Number of performers banned by the requester.

Note that the graph only shows banned performers. It doesn't include performers whose access is suspended.

Recommendations

If there are too many banned users, check the quality control rules. Maybe they are too strict.

This graph shows the percentage of correct responses in the control and training tasks.

Recommendations

If the percentage is too low, maybe your tasks are too complicated or the instructions are not clear enough.

Maybe there are errors in the control tasks or they are irrelevant. If the tasks have links, make sure that they work.

Another possible reason is incorrect settings for the quality control rules. Maybe they fail to filter negligent performers.

Blocked by rules

The number of performers banned by the quality control rules.

Note that the number of performers is counted separately for each rule.

Recommendations

If the number is too large or too small, check the settings for the quality control rules.

Active users

The number of performers who started at least one task suite within the last hour and have access to the project.

Interested in pool

The number of performers who started or completed at least one task suite.

It includes both interested and engaged performers.

Recommendations

If there is a large difference between the numbers of interested and engaged performers, perhaps the instructions are unclear, the task is too complicated, or there are errors in the interface.

Submitted in pool

The number of performers who completed at least one task suite.

Recommendations

If this number is low but you're satisfied with the number of properly completed tasks, it means that you set up the project correctly.

Users completing tasks in project

The total number of performers who completed tasks in the project.

Recommendations

If the number is too small, check the instructions, quality control rules, and filters. Perhaps performers find the task too difficult or can't access it due to incorrect settings.