Detailed analysis
On the experiment's main report page, you'll find the Detailed analysis feature, which lets you take a closer look at statistically significant metric changes grouped by various filters.
Note
This functionality is available in the extended version of Varioqub.
To view a detailed analysis:
-
In Yandex Metrica, go to Varioqub → Experiments.
-
Under the name of the experiment, click Report.
-
On the report page, click Detailed analysis.
Structure
Detailed analysis displays a table containing metrics and filters with statistically significant changes. The table shows only the results where P-value ≤ 0.05.
Analysis results include the following information:
-
Metric / Filter: Metric name and applied data filters.
-
Experiment variants: The table displays only variants with statistically significant changes. If a variant doesn't have significant changes, it doesn't appear in the results. Column names correspond to the variant names specified when the experiment was created.
-
Results: Transition to the main report page.
Note
Detailed analysis shows data with a longer delay and doesn't include the current day. Because of this, the final metric values may differ slightly from the data on the main report page.
Available filters
Detailed analysis uses a limited set of filters. You can currently choose from these:
- Without filters
- Without robots
- Without bounce visit
More filters may become available in future updates.
Benefits of detailed analysis
- Focus on significant results: View only statistically significant changes.
- Break down by filter: See how an experiment affects various audience segments.
- Quickly assess the changes: Quickly review the most significant changes without going through the entire report.