How to start URL Testing

Create URL Testing

1. Create URL Testing

You can create URL Testing by clicking [A/B Test] on Navigation bar -> Click [Create a New A/B Test] button -> Choose [URL Testing] on the modal (like below image)

2. Enter the hypothesis

Enter the URL Testing name simply. Also Adding the specific hypothesis (purpose of the testing) would be very helpful.

3. Add Each URL of group

You can find the [URL Settings] tab on the URL testing detail page. Please enter and save a description and URL for each group.

First of all, Please enter the url for group A.

Group A is target URL where Testing is started. so there is few options to help you set the Target URL like below.

Using [+ Add an OR condition] : if there are more than one URL to target, using [or] condition to add more URL.
- Example : Set the URL1 or URL2 on the Group A. Either URL1 or URL 2 would be the target of this Testing.
Using Match Condition : you can choose matching condition by considering the url structure or range of page that you want to experiment with.
- Exact match : Add URL you want to experiment exactly.
  - Example URL : http://www.example.com/category/1/product/1/display/1 . Only this URL allow to testing.
  - Now allowed :http://www.example.com/category/1/product/1/display/2or`http://www.example.com/category/1/product/1/display/1?utm_source=google&utm_medium=shopping
- Start with : All URLs starting with the URL you entered will be allow to experiment.
  - Example URL : http://www.example.com/category/1/product/1
  - Allow case : http://www.example.com/category/1/product/1/display/1
- Contains : You can use this condition if you want to experiment with all url containing a specific word. Any word that comes at the beginning or the end of the URL you entered, as in the example below, will be allowed to experimentation.
  - Example URL : promotion/best-seller/product/1/display/10
  - Allow case 1 : www.hackle.io/promotion/best-seller/product/1/display/10
  - Allow case 2 : www.hackle.com/promotion/best-seller/product/1/display/10/utm=source

4. Integration Code

You can click the Check Code button at the top, or you can find information about the interlocking code at the bottom of the URL Settings tab.

You can add that code to the existing code head on the page of url you want to experiment with.

If there are three url entered for the experiment, you need to put all three in the head of the three pages to operate the experiment normally.

5. Set the Metrics

You can set the metrics to see the effect of each indicator you choose.

Please refer to Metrics docs to figure out more.

Set the Target (optional)

you can set the target rule you want to target (like below image). To see more detailed information, please see target docs.

Set the Mutually Exclusive Settings (Optional)

if you want to set the mutually exclusive setting, you can also use this function with A/B Testing, MAB Testing and URL testing as well.

please refer to Introduction of Mutually exclusive settings docs.

Run the URL Testing.

When you ready to start Testing, please click the [start] button as below image.

Then you can see and check the URL you enter right before the testing.

1. Health Check

To run the testing correctly, Hackle provide the health check like test integration, event transmission etc.

You can see more detailed description of this in Step 6: Press Start (Health check)docs.

2. Allocating Traffic

Traffic Allocation is a function that allows you to designate only a desired percentage of the total eligible traffic to the A/B test.

More details is in this docs. Step 5: Allocate Traffic

Data Analysis and Make a Decition

You can see the data of each metrics you choose when you starting the testing.

To analysis data to interpret and monitoring your testing, below docs would be helpful.

About Metrics : Metrics Tab (Data Analysis Tab)
About Outliers : Outliers
About Interpreting Results : Step 8: Interpret Results

Tip : Even if you add Metrics during the experiment, the Metrics you add are calculated based on data from the start of the experiment, so you can check them correctly whenever you add them during the experiment.

Change the status of Testing.

while running experiment, you can use all the editing function like pause or create new version or edit name etc.

Please refer to Status of an Ongoing A/B Test docs to see more details about status.