Mobile A/B Test Results

Across 14 mobile experiments, 7% resulted in a statistically significant win. Winning variants saw an average lift of +12.2%. Meanwhile, 1 test underperformed the control with an average drop of -13.5%.

12 experiments were inconclusive, meaning the difference between control and variant was not statistically significant. Inconclusive results are still valuable — they tell you what doesn't move the needle, so you can focus testing effort elsewhere.

These results come from real A/B tests with sample sizes ranging from hundreds to millions of visitors. Use them to inform your own mobile testing strategy and avoid repeating experiments that have already been run.