Setting Up Monitoring Alarm


Please Note

  1. It is only possible to set a monitoring alarm before your A/B test starts and while your A/B test is in progress.
  2. Monitoring alarms are only available for paid plans of Pro plan or higher.

This function allows you to receive an email alert when an abnormality (or a deviation from the normal trend) occurs in your metrics during A/B testing.
An alarm will be sent to the team member who created the A/B test.


Monitoring Alarm

An alarm is sent to the corresponding email if test group B is performing poorly compared to group A and the value is statistically significant. In other words, if the result of group B of a specific metric is not performing as well as that of group A, and the p-value is less than 0.05, an alarm will be generated.