Skip to main content
inconclusive

Landing Page: Texas Grid Plan Builder_New Codebase

Hypothesis

We need to re-build DIR_E57_Texas_Gird_Plan_Builder on new Control, define any roadblocks, provide solutions/recommendations for the client and understand complexity of building future experiments on new codebase. [https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|smart-link] [https://www.raresportan.com/object-change-detection/|https://www.raresportan.com/object-change-detection/]

LayoutLanding PageEnergy & UtilitiesClarityRelevanceLayoutStylingRedesignTest ArchiveUsabilityComprehensionProduct Understanding

Test Results

8,897
Sample size
35
Days run

Key Learning

Context: The information hierarchy on the landing page may not match how users actually scan and process the content.

What was tested: We need to re-build DIR_E57_Texas_Gird_Plan_Builder on new Control, define any roadblocks, provide solutions/recommendations for the client and understand complexity of building future experiments on new codebase. [https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|smart-link] [https://www.raresportan.com/object-change-detection/|https://www.raresportan.com/object-change-detection/]

Result: No statistically significant difference was detected. No significant difference suggests users adapted to the change quickly, or the variation didn't address the actual friction point. Try testing more targeted elements.

How to Apply This to Your Site

This experiment tested landing page: texas grid plan builder_new codebase but produced no statistically significant change. The test was run on a landing page page in the energy & utilities industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that layout tests typically require adequate traffic to reach statistical significance. This test ran for 35 days — plan for at least that long.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

We need to re-build DIR_E57_Texas_Gird_Plan_Builder on new Control, define any roadblocks, provide solutions/recommendations for the client and understand complexity of building future experiments on new codebase. [https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/Proxy|smart-link] [https://www.raresportan.com/object-change-detection/|https://www.raresportan.com/object-change-detection/]

Methodology

Primary Metric
Transactions
Confidence Level
95%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments