Skip to main content
inconclusive+3.4% lift

Homepage: Alberta Homepage

LayoutHomepageEnergy & UtilitiesClarityRelevanceundefinedTest ArchiveHeuristic/Best PracticeValue Proposition

Test Results

0.99%
Control CR
1.03%
Variant CR
37,467
Sample size
42
Days run
Control0.99%
Variant1.03%

Key Learning

Context: How "Alberta homepage" is implemented on the homepage can meaningfully affect conversion — this element is worth testing.

What was tested: A variation was tested against the existing experience.

Result: No statistically significant difference was detected. No significant difference suggests users adapted to the change quickly, or the variation didn't address the actual friction point. Try testing more targeted elements.

How to Apply This to Your Site

This experiment tested homepage: alberta homepage but produced no statistically significant change. The test was run on a homepage page in the energy & utilities industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that layout tests typically require large sample sizes to detect small effects. This test ran for 42 days — plan for at least that long.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

A/B test on homepage testing layout changes.

Methodology

Primary Metric
Transactions
Confidence Level
95%
Lift Range
1.4% to 5.4%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments