Live Exposure Count

The "Live" tab can be found on the far-right within the page for an individual A/B test.

Here, you can visualize the exposure status of exposed users to a running A/B test by each test group.

  • Graph of exposed users for each test group
  • Table with information about specific users or device IDs exposed to the A/B test
    (Information on the time, user identifier value, and test group are sorted in the order of the most recent 50 cases.)

This graph can be useful as a reference when you want to check whether the traffic distribution to each test group is working properly.

Update

You can only see the live status of the A/B test from within the last 30 minutes, and the graph is updated every 30 seconds. When the update is available, the update button will turn blue, and pressing the button will update both the graph and the table on the dashboard.

Compare the values indicated by the red arrows in the two screenshots below.

2278

After 30 seconds of showing the exposure status, the update button became blue (enabled).

2338

If you click the update button, the status is updated, and the update button will stay gray (inactive) until the 30 seconds pass after the last update.

User Logging

You can check which users were distributed, when they were distributed, to which test group, and the corresponding distribution decision reason of each A/B test. These user logs are available for all users who have been exposed to A/B testing in the last 30 minutes.

1726
Decision ReasonDescriptionDistribution Result
SDK_NOT_READYThe SDK is not ready to use.
(e.g. initialized with the wrong SDK key)
(control) Test Group A
EXPERIMENT_NOT_FOUNDNo A/B tests were found for the experimental key you passed.
The experiment key may be incorrect or the experiment may be in the archive status.
(control) Test Group A
EXPERIMENT_DRAFTThe A/B test is ready to start.(control) Test Group A
EXPERIMENT_PAUSEDThe A/B test has been paused(control) Test Group A
EXPERIMENT_COMPLETEDA/B test has ended.Final winning test group from the experiment
OVERRIDDENUsers are distributed to a specific test group by manual assignment.Manually assigned test group
TRAFFIC_NOT_ALLOCATEDA/B test is running, but user has not been assigned to the experiment.(control) Test Group A
TRAFFIC_ALLOCATEDUser has been assigned to A/B test.Assigned test group
VARIATION_DROPPEDThe test group was removed from the A/B test.(control) Test Group A
EXCEPTIONAn unknown error has occurred.(control) Test Group A

Criteria for Counts

🚧

Real-time exposure stats show the total number of exposures without removing duplicates.

The number of unique users without duplicates can be seen in the Metrics tab.