Skip to main content
E1 · Reported onlyreported loser

Does Restructuring Plan Detail Cards Improve Click-Through?

Hypothesis

On a plan-selection page where users click 'View Details' to expand long-form plan information, restructuring the expanded content with stronger visual hierarchy (bolded category headers, rounded grouping boxes, consistent sequence across desktop and mobile) should improve scannability and downstream click-through to enrollment.

LayoutProduct Listing PageEnergy & Utilitiesvisual hierarchyform vs contentqualitative-research-to-test mappingisolation orthodoxy vs interaction effectspost-click engaged-user segment

Evidence: E1 Reported only

An outcome is reported, but there is not enough disclosed information to check whether the result is reliable.

32/100
Record completeness
Sample size
Not disclosed
Test duration
Not disclosed
Primary metric
downstream click-through
Statistical result
Not disclosed
Why this rating

Use for inspiration or follow-up, not as proof.

Integrity: Caution. Analysis: Unknown.

Missing for a higher tier: Control description, Variant description, Positive sample size, Positive duration, Valid arm counts, Expected allocation, and more.

Caution: Stored caution integrity status, Analysis method not independently specified.

Read the evidence-rating methodology

Key Learning

The intervention rearranged the presentation, but the diagnosed problem concerned comprehension. Earlier user feedback pointed to three obstacles: people could not estimate total cost, offer labels did not explain meaningful differences, and the page made simultaneous comparison difficult. Reordering the same unclear information left those obstacles intact. After reaching the planned sample, the observed movement was small and negative. The practical lesson is to make the test variable match the user problem: change the cost explanation when cost is unclear, improve differentiation when offers seem interchangeable, and change layout when navigation or scanning is the issue.

How to Apply This to Your Site

The reported outcome labels this treatment a loser. The measured outcome reportedly underperformed control. The change was tested on a product listing page page in the energy & utilities industry. Diagnose the mechanism and context before testing the opposite; a losing result does not prove that every related treatment will fail.

Before you test: use your own baseline, business MDE, traffic, and risk tolerance to set the sample and stopping rule. Declare whether the analysis is fixed-horizon, sequential, or Bayesian before launch, and log campaign, targeting, instrumentation, and concurrent-experiment changes while it runs.

What Was Tested

Test on a plan-selection / pricing page in the Energy & Utilities sector. The variant kept the underlying content identical but restructured its visual presentation — adding section headers, grouping cards, and aligning mobile vertical order with desktop horizontal order. Audience scoped to engaged users who actually clicked 'View Details.'

Methodology

Primary Metric
downstream click-through
Reported Lift Range
-1% to -3% (directional, within noise)
Analysis Method
Unknown
Integrity Review
Caution

Build On These Learnings

Save your plans, results, context, and limitations so the next decision can use the strongest available evidence without treating every outcome as universal.

Related Experiments

reported winner

Restructuring Homepage Hierarchy to Surface Personalized Offers

The story behind this win is the iteration discipline. The first attempt at this homepage redesign changed two systems at once (messaging + routing) and produced an ambiguous result: the entry metric moved slightly positive while downstream metrics moved meaningfully negative. The team correctly identified that the routing change — which inadvertently replaced direct links to a personalized plan-search experience with modal-driven entry into a generic flow — was the downstream killer. The iteration restored the original routing and kept ONLY the homepage hierarchy changes. All funnel metrics moved directionally positive in lockstep (entry +2.38%, mid-funnel +7%, conversion +11.81%) — none stat-sig individually but consistent enough across the funnel to justify shipping. Element-level diagnostics confirmed the mechanism: the segment CTAs the team intended to promote saw a 26-30% lift in unique-visitor interaction, while the unchanged hero banner stayed flat (as expected). Two key behavioral observations: (1) page-length reduction surfaced a 4x lift on a previously buried bottom-of-page zip code input — proving the secondary lesson that 'less page' can mean 'more conversion real estate'; (2) desktop strongly outperformed mobile, with the suspected cause being mobile's lead-with-form pattern (zip code above hero) — putting the form before the message creates friction. The broader transferable insight: when a messy test confounds multiple variables, the right move is to isolate one variable in the next test, not to abandon the hypothesis.

Explore More Experiments