A/B tests run on homepages. See which hero sections, value props, and layouts convert visitors into engaged users.
Across 2 homepage experiments, 50% resulted in a statistically significant win.
1 experiment was inconclusive, meaning the difference between control and variant was not statistically significant. Inconclusive results are still valuable — they tell you what doesn't move the needle, so you can focus testing effort elsewhere.
These results come from real A/B tests with sample sizes ranging from hundreds to millions of visitors. Use them to inform your own homepage testing strategy and avoid repeating experiments that have already been run.
The story behind this win is the iteration discipline. The first attempt at this homepage redesign changed two systems at once (messaging + routing) and produced an ambiguous result: the entry metric moved slightly positive while downstream metrics moved meaningfully negative. The team correctly identified that the routing change — which inadvertently replaced direct links to a personalized plan-search experience with modal-driven entry into a generic flow — was the downstream killer. The iteration restored the original routing and kept ONLY the homepage hierarchy changes. All funnel metrics moved directionally positive in lockstep (entry +2.38%, mid-funnel +7%, conversion +11.81%) — none stat-sig individually but consistent enough across the funnel to justify shipping. Element-level diagnostics confirmed the mechanism: the segment CTAs the team intended to promote saw a 26-30% lift in unique-visitor interaction, while the unchanged hero banner stayed flat (as expected). Two key behavioral observations: (1) page-length reduction surfaced a 4x lift on a previously buried bottom-of-page zip code input — proving the secondary lesson that 'less page' can mean 'more conversion real estate'; (2) desktop strongly outperformed mobile, with the suspected cause being mobile's lead-with-form pattern (zip code above hero) — putting the form before the message creates friction. The broader transferable insight: when a messy test confounds multiple variables, the right move is to isolate one variable in the next test, not to abandon the hypothesis.
Principle: The highest-ROI tests on homepages are usually structural (CTA placement, sticky nav, multi-step forms) rather than content changes. Copy matters most for nav labels and CTAs. Social proof works for social platforms but can backfire for professional services. Carousels consistently underperform static alternatives.
Save your own experiments, get AI-powered test ideas, and build on patterns from 2+ real tests.
View Plans & Pricing