- It is only possible to set a monitoring alarm before your A/B test starts and while your A/B test is in progress.
- Monitoring alarms are only available for paid plans of Pro plan or higher.
This function allows you to receive an email alert when an abnormality (or a deviation from the normal trend) occurs in your metrics during A/B testing.
An alarm will be sent to the team member who created the A/B test.
An alarm is sent to the corresponding email if test group B is performing poorly compared to group A and the value is statistically significant. In other words, if the result of group B of a specific metric is not performing as well as that of group A, and the p-value is less than 0.05, an alarm will be generated.
Updated almost 2 years ago