Restructuring Homepage Hierarchy to Surface Personalized Offers
Hypothesis
On a brand-led homepage where personalized customer-segment offers (home owner, renter, mover, switcher) compete with hero messaging and reviews for above-the-fold real estate, restructuring to surface the personalized offers immediately below the hero — while preserving the original direct-routing pathway to plan selection — should improve high-quality entry into the primary conversion flow without introducing the routing friction observed in a prior iteration.
Evidence: E1 Reported only
An outcome is reported, but there is not enough disclosed information to check whether the result is reliable.
Why this rating
Use for inspiration or follow-up, not as proof.
Integrity: Caution. Analysis: Unknown.
Missing for a higher tier: Control description, Variant description, Positive sample size, Positive duration, Valid arm counts, Expected allocation, and more.
Caution: Stored caution integrity status, Analysis method not independently specified.
Read the evidence-rating methodologyKey Learning
The story behind this win is the iteration discipline. The first attempt at this homepage redesign changed two systems at once (messaging + routing) and produced an ambiguous result: the entry metric moved slightly positive while downstream metrics moved meaningfully negative. The team correctly identified that the routing change — which inadvertently replaced direct links to a personalized plan-search experience with modal-driven entry into a generic flow — was the downstream killer. The iteration restored the original routing and kept ONLY the homepage hierarchy changes. All funnel metrics moved directionally positive in lockstep (entry +2.38%, mid-funnel +7%, conversion +11.81%) — none stat-sig individually but consistent enough across the funnel to justify shipping. Element-level diagnostics confirmed the mechanism: the segment CTAs the team intended to promote saw a 26-30% lift in unique-visitor interaction, while the unchanged hero banner stayed flat (as expected). Two key behavioral observations: (1) page-length reduction surfaced a 4x lift on a previously buried bottom-of-page zip code input — proving the secondary lesson that 'less page' can mean 'more conversion real estate'; (2) desktop strongly outperformed mobile, with the suspected cause being mobile's lead-with-form pattern (zip code above hero) — putting the form before the message creates friction. The broader transferable insight: when a messy test confounds multiple variables, the right move is to isolate one variable in the next test, not to abandon the hypothesis.
How to Apply This to Your Site
The reported outcome labels this treatment a winner. The record reports an improvement in the measured outcome. The test was run on a homepage page in the energy & utilities industry. Treat it as context for a new hypothesis, not as an expected lift for another site.
Before you test: use your own baseline, business MDE, traffic, and risk tolerance to set the sample and stopping rule. Declare whether the analysis is fixed-horizon, sequential, or Bayesian before launch, and log campaign, targeting, instrumentation, and concurrent-experiment changes while it runs.
What Was Tested
Iteration of an earlier homepage redesign that confounded messaging and routing changes (positive entry-step, negative downstream). v2 isolates the variable: tests only homepage hierarchy and offer placement; restores the original direct routing to the plan-search experience. Energy & Utilities sector, brand homepage, prospect-only audience.
Methodology
Build On These Learnings
Save your plans, results, context, and limitations so the next decision can use the strongest available evidence without treating every outcome as universal.