Skip to main content
loser-13.5% lift

Mobile: Mobile & Tablet Grid Builder Experience

LayoutMobileEnergy & UtilitiesLayoutCTAFormHeadlineCopyInformation ArchitectureTest ArchiveBusiness ContextComprehensionProduct UnderstandingLead to Hypothesis/Idea

Test Results

4.09%
Control CR
3.54%
Variant CR
15,342
Sample size
55
Days run
Control4.09%
Variant3.54%

Key Learning

Problem: Users arriving at the mobile can't efficiently find what they're looking for, increasing bounce rates.

What was tried: The variant changed the existing experience but introduced unexpected friction. (-13.5% change)

Why it failed: Major layout changes often lose because they disrupt learned user behavior. Test smaller, incremental layout tweaks instead.

How to Apply This to Your Site

This test showed that mobile: mobile & tablet grid builder experience led to a -13.5% drop in conversions. The change was tested on a mobile page in the energy & utilities industry. Avoid replicating this exact approach — instead, consider testing the opposite direction or a more subtle variation.

Before you test: Consider that layout tests typically require large sample sizes to detect small effects. This test ran for 55 days — plan for at least that long.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

A/B test on mobile testing layout changes.

Methodology

Primary Metric
sales:enroll:confirm
Confidence Level
95%
Lift Range
-15.5% to -11.5%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments