You can set up detailed data segmentation on the Segmentation section of the Metrics tab on the A/B test detail page.
If you set up the detailed data segmentation, you can view a filtered version of the data collected by Hackle during A/B testing to perform a more in-depth analysis.
- This article will show you how to set up data segmentation in the Hackle Dashboard.
For more information on the overall data collection method, please refer to Introduction to Data Segmentation.
- Data segmentation is only available for paid plans (Pro plan and above).
The target property to filter the data into for further analysis. Properties can be also viewed as a group that shares similar characteristics.
For example, if you say "analyze each OS used by the user", the segmentation property will be OS.
A possible value of the property selected for analysis.
For example, if you select OS as the segmentation property, you can put Android, iOS, Windows, MacOS, etc. as the sub-property value items.
For more information on properties, please refer to the Introduction to Properties document.
Relationship between Segmentation Property and Property Value
- Segmentation property can be viewed as property names, and property values can be viewed as the sub-categories of segmentation properties.
- Please note that only the property data collected through SDK appears in the segmentation property list.
- You can set the segmentation analysis property for each metric.
- You can add up to 3 segmentation analysis criteria per metric.
- Dependent on the A/B Test Status
- Analysis criteria can be added or deleted when the A/B test status is in Draft mode, Running, or Paused.
- If the A/B test status is Terminated or Archived, you cannot add or delete the segmentation properties for data analysis.
- Data Results
- The filtered data of the selected segmentation property can be checked within 1 hour after the start of the A/B test.
- If a new segmentation property is added during A/B testing, it may take up to 1 hour to update the data results.
Use the supported SDKs!
The basic segmentation properties provided by Hackle to segment your data are the platform and browser used.
You can either choose not to select any of them or use both.
More than one segmentation property can be enabled on the dashboard.
Those with metrics without any data segmentation settings activated will be shown the following screen by default.
After selecting the segmentation property (platform, browser, or a customized property) to filter your data into, click on the
Filter data by... button in the center of the gray area to select the segmentation property to use, and after data update, you can analyze the values for each segmentation property.
Data updates can take up to an hour.
Once enabled, Hackle's built-in segmentation properties cannot be disabled.
- Click the
+ Custombutton on the far right of the segmentation data analysis bar
- In the dialog box, select the desired segmentation property.
- In the dialog box, add the property values for each segmentation property and save.
Assuming that the segmentation dialog box has been opened, the above process will be described in more detail below.
Select the segmentation properties to be added from the left side of the dialog.
The different types of segmentation properties that can be set are:
Properties that are collected and provided by Hackle
User-defining properties collected via SDK integration
As seen from the example below, Platform, Device, OS were properties provided by Hackle that were collected, while Membership, Location, User ID, and Platform were the custom properties collected.
The properties provided by Hackle are distinguishable through the Hackle logo on the left of the property name.
On the other hand, only the property name is displayed for properties that you set yourself and collect via the SDK. On the list, they appear under the properties provided by Hackle.
If there are no property data collected through the SDK, you will see the message There are no properties to select as above.
In order to troubleshoot this problem, refer to the Data Segmentation Troubleshooting document.
When you add analysis criteria, up to 4 most aggregated property values in the last 24 hours will be automatically selected.
Up to 4 property values can be added, so if you want to change the property value when all 4 are already selected, you need to delete an existing value or adding another value.
You can delete the analysis item by clicking the trash can icon to the right of the value you want to delete.
If you have fewer than 4 values, you can add more. Click the
+ Add values button in the lower right corner.
You can open a drop-down list by clicking the triangle (▼) icon to the right of a property value. This list shows the values collected for this specific property value criterion.
Select a value from this list. You can select one value or multiple values.
Be sure to click
Save to reflect the selected value. (If none is selected, the Save button will not be activated).
If there is an unselected value among the selectable values, the value is grouped with
If there are three selectable values, RED, GREEN, and YELLOW, and one value for each item is selected and added, 'other' items do not appear because all values have already become individual items.
On the other hand, if there are six selectable values, such as PC, Mobile, Tablet, TV, Watch, and Etc, and if PC / Mobile / Tablet / TV is added as an item, Watch and Etc that are not selected in any item are bundled together in 'Other'.
Save to complete the settings.
After the data update, you can check the values for each segmentation property.
Data updates can take up to an hour
Segmentation property added manually can be deleted as needed. However, it cannot be deleted after the experiment is terminated or archived.
After selecting the segmentation property to delete, click the
Delete button at the bottom right to confirm.
Membership property is selected as the segmentation property criterion, it will appear on the right side of Hackle's built-in segmentation properties as shown below. The
+ Custom button will also be shown on the right.
You can set up to 3 properties directly, and once you reach 3 properties, the
+ Custom button will no longer appear.
Updated over 1 year ago