You can set up detailed data segmentation on the Segmentation section of the Metrics tab on the A/B test detail page.
If you set up the detailed data segmentation, you can view a filtered version of the data collected by Hackle during A/B testing to perform a more in-depth analysis.

📘

Please note

1. This article will show you how to set up data segmentation in the Hackle Dashboard.
   For more information on the overall data collection method, please refer to Introduction to Data Segmentation.
2. Data segmentation is only available for paid plans (Pro plan and above).

Terms

1. Segmentation Property
   The target property to filter the data into for further analysis. Properties can be also viewed as a group that shares similar characteristics.
   For example, if you say "analyze each OS used by the user", the segmentation property will be OS.

2. Property Value
   A possible value of the property selected for analysis.
   For example, if you select OS as the segmentation property, you can put Android, iOS, Windows, MacOS, etc. as the sub-property value items.

3. Properties
   For more information on properties, please refer to the Introduction to Properties document.

📘

Relationship between Segmentation Property and Property Value

• Segmentation property can be viewed as property names, and property values can be viewed as the sub-categories of segmentation properties.
• Please note that only the property data collected through SDK appears in the segmentation property list.

Segmentation Policies

1. Settings
   • You can set the segmentation analysis property for each metric.
   • You can add up to 3 segmentation analysis criteria per metric.
2. Dependent on the A/B Test Status
   • Analysis criteria can be added or deleted when the A/B test status is in Draft mode, Running, or Paused.
   • If the A/B test status is Terminated or Archived, you cannot add or delete the segmentation properties for data analysis.
3. Data Results
   • The filtered data of the selected segmentation property can be checked within 1 hour after the start of the A/B test.
   • If a new segmentation property is added during A/B testing, it may take up to 1 hour to update the data results.

Using the basic segmentation properties provided by Hackle

🚧

Use the supported SDKs!

The built-in segmentation properties provided by Hackle are only possible with either JavaScript or React SDK. SDK version 2.0.0 is required.

The basic segmentation properties provided by Hackle to segment your data are the platform and browser used.
You can either choose not to select any of them or use both.

Enable segmentation properties

More than one segmentation property can be enabled on the dashboard.

Those with metrics without any data segmentation settings activated will be shown the following screen by default.

After selecting the segmentation property (platform, browser, or a customized property) to filter your data into, click on the Filter data by... button in the center of the gray area to select the segmentation property to use, and after data update, you can analyze the values for each segmentation property.

🚧

Data updates can take up to an hour.

Disable

Once enabled, Hackle's built-in segmentation properties cannot be disabled.

Set your own segmentation properties

1. Click the + Custom button on the far right of the segmentation data analysis bar
2. In the dialog box, select the desired segmentation property.
3. In the dialog box, add the property values for each segmentation property and save.

Assuming that the segmentation dialog box has been opened, the above process will be described in more detail below.

Selecting Segmentation Property Types

Select the segmentation properties to be added from the left side of the dialog.
The different types of segmentation properties that can be set are:

1. Hackle-provided properties
   Properties that are collected and provided by Hackle

2. Custom properties
   User-defining properties collected via SDK integration

As seen from the example below, Platform, Device, OS were properties provided by Hackle that were collected, while Membership, Location, User ID, and Platform were the custom properties collected.

The properties provided by Hackle are distinguishable through the Hackle logo on the left of the property name.
On the other hand, only the property name is displayed for properties that you set yourself and collect via the SDK. On the list, they appear under the properties provided by Hackle.

If there are no property data collected through the SDK, you will see the message There are no properties to select as above.
In order to troubleshoot this problem, refer to the Data Segmentation Troubleshooting document.

Edit the property value

When you add analysis criteria, up to 4 most aggregated property values in the last 24 hours will be automatically selected.
Up to 4 property values can be added, so if you want to change the property value when all 4 are already selected, you need to delete an existing value or adding another value.

Deleting a property value

You can delete the analysis item by clicking the trash can icon to the right of the value you want to delete.

Add a property value

If you have fewer than 4 values, you can add more. Click the + Add values button in the lower right corner.

Select and save values

You can open a drop-down list by clicking the triangle (▼) icon to the right of a property value. This list shows the values collected for this specific property value criterion.
Select a value from this list. You can select one value or multiple values.

Be sure to click Save to reflect the selected value. (If none is selected, the Save button will not be activated).

"Other" values

If there is an unselected value among the selectable values, the value is grouped with Other.

If there are three selectable values, RED, GREEN, and YELLOW, and one value for each item is selected and added, 'other' items do not appear because all values have already become individual items.

On the other hand, if there are six selectable values, such as PC, Mobile, Tablet, TV, Watch, and Etc, and if PC / Mobile / Tablet / TV is added as an item, Watch and Etc that are not selected in any item are bundled together in 'Other'.

Finish customizing

Click Save to complete the settings.

After the data update, you can check the values for each segmentation property.

🚧

Data updates can take up to an hour

Delete segmentation property

Segmentation property added manually can be deleted as needed. However, it cannot be deleted after the experiment is terminated or archived.

After selecting the segmentation property to delete, click the Delete button at the bottom right to confirm.

Custom your segmentation tab

If the Membership property is selected as the segmentation property criterion, it will appear on the right side of Hackle's built-in segmentation properties as shown below. The + Custom button will also be shown on the right.

You can set up to 3 properties directly, and once you reach 3 properties, the + Custom button will no longer appear.