Majority vote

The majority vote check determines how well the performer's responses match the responses of other performers. For example, if a task has an overlap of “5” and three performers selected the same answer, this is considered indirect confirmation of the correct response.

The skill level is calculated using the formula:

$\text{[math]}$ ,

where:

$\text{[math]}$ is the number of the performer's responses that matched the majority.

$\text{[math]}$ is the number of the performer's tasks where the majority all answered identically.

Majority vote check

To use verification by the majority:

Create a skill on the Skills page.

Set up a quality control rule on the pool page (click Add Quality Control Rule → Majority vote).


Field or group of fields	Description
Answer threshold	The number of matching responses that is considered the “majority vote” (for example, 3). The threshold should be less than or equal to the overlap.
History size	How many of the performer's recent responses in the project are used for the calculation. If the field is empty, the calculation is based on all the performer's responses in the pool.
then	Action to perform for the condition: “Set skill from "If"” — Save the performer's percentage of correct responses in the control tasks or tasks with majority vote. To save the percentage (a number between 1 and 100), use a skill — an assessment of the performer's work that has a name and value. For example, you can create a skill called “Completing control tasks in my pool” and use it for saving the percentage of correct responses for each performer. Then you can set a filter using this skill to control performers' access to the pool. “Set skill” — Assign the skill a fixed value of N (from 1 to 100). “Pause” — Suspend the performer's access to the pool for the specified number of days. The reason for banning is only shown to the requester. “Ban” — Block access to the project or all of the requester's projects for the specified number of days. The reason for banning is only shown to the requester.


Field or group of fields	Description
Answer threshold	The number of matching responses that is considered the “majority vote” (for example, 3). The threshold should be less than or equal to the overlap.
History size	How many of the performer's recent responses in the project are used for the calculation. If the field is empty, the calculation is based on all the performer's responses in the pool.
then	Action to perform for the condition: “Set skill from "If"” — Save the performer's percentage of correct responses in the control tasks or tasks with majority vote. To save the percentage (a number between 1 and 100), use a skill — an assessment of the performer's work that has a name and value. For example, you can create a skill called “Completing control tasks in my pool” and use it for saving the percentage of correct responses for each performer. Then you can set a filter using this skill to control performers' access to the pool. “Set skill” — Assign the skill a fixed value of N (from 1 to 100). “Pause” — Suspend the performer's access to the pool for the specified number of days. The reason for banning is only shown to the requester. “Ban” — Block access to the project or all of the requester's projects for the specified number of days. The reason for banning is only shown to the requester.

Add a skill filter on the pool page (in the Users filter section). For example, “The myskill skill is missing or ≥ 60”.