Skip to main content
loser-5.8% lift

Landing Page: Combination

LayoutLanding PageEnergy & UtilitiesClarityLayoutundefinedTest Archive

Test Results

7.63%
Control CR
7.19%
Variant CR
15,455
Sample size
11
Days run
Control7.63%
Variant7.19%

Key Learning

Problem: How "Combination" is implemented on the landing page can meaningfully affect conversion — this element is worth testing.

What was tried: The variant changed the existing experience but introduced unexpected friction. (-5.8% change)

Why it failed: Major layout changes often lose because they disrupt learned user behavior. Test smaller, incremental layout tweaks instead.

How to Apply This to Your Site

This test showed that landing page: combination led to a -5.8% drop in conversions. The change was tested on a landing page page in the energy & utilities industry. Avoid replicating this exact approach — instead, consider testing the opposite direction or a more subtle variation.

Before you test: Consider that layout tests typically require large sample sizes to detect small effects. This test ran for 11 days — plan for at least that long.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

A/B test on landing page testing layout changes.

Methodology

Primary Metric
Transactions
Confidence Level
95%
Lift Range
-7.8% to -3.8%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments