When conducting an A/B test, not only do you need to distribute your users to different test groups, but you also need to write a logic for each test group. After the SDK integration stage, the Hackle SDK will distribute users into different test groups.

📘

Test Groups

The test groups are basically the different groups that are exposed to the versions (features, screens, algorithms, etc) of a page of an experiment. Test groups include both the control test group A and treatment test groups B, C, D, etc., that are exposed to the "improved" versions of the pages.
The test groups can be set on the dashboard and further information on the test groups can be found on the What is a Test Group? document.

🚧

Unity Editor

Unity SDK relies on Android and iOS SDKs.
Hence, A/B tests conducted on Unity Editor will return all users to test group A.

variation

By passing the experiment key to the variation() method, the SDK will distribute users and you will receive the results of the distribution for the specific experiment. After that, we implement the logic of the page version applicable for each test group.

In the example code below, we are passing an experiment key of 42, and there are two test groups, A and B.

// Determines the test group to assign in an A/B tests with an experiment key of 42.
// For undetermined cases, the user is returned to test group A.
string variation = hackle.Variation(42);

// Logic for the different test groups
if (variation == "A") {
  // Logic for test group A
} else if (variation == "B") {
  // Logic for test group B
}

variationDetail

The variation_detail() method works the same as the variation() method but provides the reason for a user being distributed to a specific group. This method can be a useful tool to see if the distribution is working properly.
You must pass the experiment key as a parameter. For the example code below, we are passing experimental key 42.

// Traffic distribution details 
HackleDecision decision = hackle.VariationDetail(42);

// Test group determined from distribution
string variation = decision.variation;

// Reason for distribution to a test group
string reason = decision.reason;

You will receive the reason for the distribution or the allocation of a specific user to a specific test group in the form of SDK_NOT_READY. Please refer to the table below for the full list of different distribution reasons.

Parameter

• Parameter values of the distributed group can also be provided through the variationDetail() method.
• In the Decision instance passed through the variationDetail() method, there is a ParameterConfig object which contains all parameter setting information.
• Parameter values you've set on the dashboard exists in the form of key and value, therefore you can use the method below to set the parameter values.

📘

Parameter setting is only available for SDK version 1.3.0 or higher.

GetString

• Returns the parameter value set to STRING, JSON type.
• Returns the set value of the distributed group.

HackleDecision decision = hackle.VariationDetail(42);

string strValue = decsision.GetString("parameter_key_string_type", "defaultValue");
string jsonValue = decsision.GetString("parameter_key_json_type", "{}");

getInt

• Returns the parameter value set to Number type as Int type.
• Returns the set value of the distributed group.

HackleDecision decision = hackle.VariationDetail(42);

int intValue = decsision.GetInt("parameter_key_number_type", 0);

getDouble

• Returns the parameter value set to Number type as Double type.
• Returns the set value of the distributed group.

HackleDecision decision = hackle.VariationDetail(42);

double doubleValue = decsision.GetDouble("parameter_key_number_type", 0.0);

GetLong

• Returns the parameter value set to Number type as Long type.
• Returns the set value of the distributed group.

HackleDecision decision = hackle.VariationDetail(42);

long longValue = decsision.GetLong("parameter_key_number_type", 0);

GetBoolean

• Returns the parameter value set to Boolean type.
• Returns the set value of the distributed group.

HackleDecision decision = hackle.VariationDetail(42);

bool boolValue = decsision.GetBoolean("parameter_key_boolean_type", false);