Skip to main content
inconclusive+5.7% lift

Landing Page: Desktop Grid Builder Experience

Hypothesis

Cancelled E62.... IS BACK ON! Previous experiments using Grid builder experience: E57 & 59 Ethan's latest designs: https://preview.uxpin.com/d23921874b9a9dfc4754e29ddef9f0ed5292b0f6#/pages/152588127/simulate/no-panels?mode=if E62 Designs: https://www.figma.com/proto/mULndkaPEoHoy58iV7zDRa/Z1?page-id=203%3A2&node-id=329%3A2140&viewport=241%2C&show-proto-sidebar=1&starting-point-node-id=329%3A2140

Copy & MessagingLanding PageEnergy & UtilitiesRelevanceCopyTest ArchiveWeb AnalyticsScent TrailComprehensionProduct UnderstandingLead to Hypothesis/Idea

Test Results

5.52%
Control CR
5.83%
Variant CR
11,805
Sample size
41
Days run
Control5.52%
Variant5.83%

Key Learning

Context: Users on the landing page need validation from others before committing — without visible proof of success, they hesitate.

What was tested: Cancelled E62.... IS BACK ON! Previous experiments using Grid builder experience: E57 & 59

Ethan's latest designs: https://preview.uxpin.com/d23921874b9a9dfc4754e29ddef9f0ed5292b0f6#/pages/152588127/simulate/no-panels?mode=if

E62 Designs: https://www.figma.com/proto/mULndkaPEoHoy58iV7zDRa/Z1?page-id=203%3A2&node-id=329%3A2140&viewport=241%2C&show-proto-sidebar=1&starting-point-node-id=329%3A2140

Result: No statistically significant difference was detected. Inconclusive copy tests usually mean both versions are equally (in)effective at addressing user motivations. Try a fundamentally different angle.

How to Apply This to Your Site

This experiment tested landing page: desktop grid builder experience but produced no statistically significant change. The test was run on a landing page page in the energy & utilities industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that copy & messaging tests typically require large sample sizes to detect small effects. This test ran for 41 days — plan for at least that long.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

Cancelled E62.... IS BACK ON! Previous experiments using Grid builder experience: E57 & 59 Ethan's latest designs: https://preview.uxpin.com/d23921874b9a9dfc4754e29ddef9f0ed5292b0f6#/pages/152588127/simulate/no-panels?mode=if E62 Designs: https://www.figma.com/proto/mULndkaPEoHoy58iV7zDRa/Z1?page-id=203%3A2&node-id=329%3A2140&viewport=241%2C&show-proto-sidebar=1&starting-point-node-id=329%3A2140

Methodology

Primary Metric
sales:enroll:confirm
Confidence Level
95%
Lift Range
3.7% to 7.7%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments