Hackle vs. Optimizely

These are some of the additional features provided by Hackle A/B Testing that are not available with Optimizely's A/B Testing.

Brief Overview Description

1. Hackle's A/B test allows you to customize any type of metric you want.
2. Hackle's A/B test allows you to analyze your metrics by segment.
3. Hackle provides real-time data analysis functions such as data insight and user funnel analysis.
4. Hackle's A/B test provides a free trial account along with competitive, reasonable pricing.
5. Hackle's A/B test does not have a limit on the active audience reach.
6. Hackle's A/B test provides fast result updates.

Detailed Description

1. Hackle's A/B test allows you to customize any type of metric you want.

With Hackle, you can select desired events as the denominator/numerator to set as your A/B metrics. Moreover, through the various calculation methods provided by Hackle, you can also customize how you calculate the metric values. For example, calculations for the conversion rate, average order amount (AOV), the average purchase price per user (ARPU), and the average purchase price per purchaser (ARPPU), can all be set up.

Additionally, there is also a "filter" setting that allows users to only calculate the metrics for specific user segments.

2. Hackle's A/B test allows you to analyze your metrics by segment.

A segmentation analysis for the results of each metric set in the A/B test can be conducted on the basis of platform (iOS, Android, Web, etc.), browser, app version, or property information managed internally by your company (ex. membership member status, first purchase status, gender, age group, etc.)

This allows you to determine whether the results for certain metrics in your A/B testing are only affecting specific user segments.

3. Hackle provides real-time data analysis functions such as data insight and user funnel analysis.

Hackle listens to the voice of consumers and through our accelerated development cycle we are gradually providing data analysis functions required for designing and analyzing the results of an A/B Test. You can check the trend of event occurrences through our data insight function. This feature will be updated so that you will be able to gain insights into the trend of future users (ex. active users) and metrics registered in the A/B test.

In addition, we provide a user funnel analysis function so that you can check the status of your desired user journey.

4. Hackle A/B test provides a free trial account along with competitive, reasonable pricing

The price point puts Optimizely out of reach for many businesses due to the high price. In comparison, we believe in growing together with our start-up partners.

5. Hackle A/B test does not have a limited audience reach

Optimizely has a quota of users who are permitted in each experiment depending on the package plan used. Once this Monthly unique user quota is reached, your experiment on Optimizely will be paused and will not go on any further, meaning that you miss out on your experiment’s full potential. Hackle A/B testing gives you full flexibility in who receives the experiment without stopping your experiment midway once the quota is reached.

6. Hackle A/B test provides fast data result updates despite the amount of incoming data

With many other A/B Testing platforms in the market, as the amount of data increases and more data from the experiment has to be processed and stored to create results, updates become slower. However, with Hackle’s A/B Testing the data update cycle is not compromised and we provide reliable updates by the hour rather than inconsistent random updates.