Skip to main content

Homepage Optimization

16 experiments testing homepage changes across Direct Energy and NRG brands. Win rate: 31%. 5 winners found.

5 findings5 validated1% avg success rateMedium ConfidenceHomepageHomepage

Key Findings

Homepage Redesign 2.0

WinnerLow Confidence

Winner: Homepage Redesign 2.0.

Expected Lift
2% – 3.8%
Success Rate
1%
Type
winning pattern
Plain-language summary: This homepage test showed a +2.89% improvement. Projected annual revenue impact: $664,860. The winning approach should be implemented as the new default.
brand:Direct Energyteam:Canadaorg:NRGtype:quantitativedevice:Desktopdevice:Mobiledevice:Tabletfocus:Layoutcomponent:CTAfocus:Copyfocus:Information Architectureevidence:Test Archiveevidence:Web Analyticslever:Usabilitylever:Effort

Homepage Use Case

WinnerHigh Confidence

Hypothesis: A first test could be just the pathways but no actual changes to the grid (or minor changes) in order to test as an MVP and see if users engage. Follow up experiments couple include adding/removing certain filters or plans from the next step to ensure the plans shown are most relevant as well as additional headline and copy changes for that audience. Category analysis - this is done on competitor sites for apt/home and on comparison sites for multiple use cases. *Zip code:* 77024, 77080 *Address*: 30 mott ln (the number 30 can be changed to anything)

Winner: Homepage Use Case. A first test could be just the pathways but no actual changes to the grid (or minor changes) in order to test as an MVP and see if users engage. Follow up experiments couple include adding/removing certain filters or plans from the next step to ensure the plans shown are most relevant as well as additional headline and copy changes for that audience. Category analysis - this is done on competitor sites for apt/home and on comparison sites for multiple use cases. *Zip code:* 77024, 77080 *Address*: 30 mott ln (the number 30 can be changed to anything)

Expected Lift
7.3% – 13.6%
Success Rate
1%
Type
winning pattern
Key Learnings

Hypothesis: A first test could be just the pathways but no actual changes to the grid (or minor changes) in order to test as an MVP and see if users engage. Follow up experiments couple include adding/removing certain filters or plans from the next step to ensure the plans shown are most relevant as well as additional headline and copy changes for that audience. Category analysis - this is done on competitor sites for apt/home and on comparison sites for multiple use cases. *Zip code:* 77024, 77080 *Address*: 30 mott ln (the number 30 can be changed to anything) Next steps: Lead to Hypothesis/Idea

Plain-language summary: This homepage test showed a +10.43% improvement. Projected annual revenue impact: $668. The winning approach should be implemented as the new default.
brand:Direct Energyteam:Canadaorg:NRGtype:quantitativedevice:Desktopdevice:Mobiledevice:Tabletnext-step:Lead to Hypothesis/Ideafocus:Layoutcomponent:CTAfocus:Information Architectureevidence:User/Market Researchevidence:Business Contextlever:Comprehensionlever:Product Understanding

Homepage / Grid

WinnerLow Confidence

Winner: Homepage / Grid.

Expected Lift
-0.3% – -0.5%
Success Rate
1%
Type
winning pattern
Plain-language summary: This homepage test showed a +-0.42% improvement. Projected annual revenue impact: $-2,857. The winning approach should be implemented as the new default.
brand:Direct Energyteam:Canadaorg:NRGtype:quantitativefactor:Clarityfactor:Relevancefactor:Value Propositionevidence:Test Archiveevidence:Heuristic/Best Practicepsychology:Scent Traillever:Usabilitylever:Motivationlever:Persistencelever:Value Statementlever:Value Proposition

Homepage

WinnerHigh Confidence

Winner: Homepage.

Expected Lift
14.7% – 27.3%
Success Rate
1%
Type
winning pattern
Plain-language summary: This homepage test showed a +21.01% improvement. Projected annual revenue impact: $230,918. The winning approach should be implemented as the new default.
brand:Direct Energyteam:Canadaorg:NRGtype:quantitativedevice:Desktopfactor:Clarityfactor:Distractionfocus:Layoutfocus:Stylingcomponent:CTApsychology:Social Proofevidence:User/Market Researchevidence:Heuristic/Best Practiceevidence:Web Analyticslever:Trustlever:Usabilitylever:Credibilitylever:Attentionlever:Social Prooflever:Distraction

Homepage Hero Redesign

WinnerMedium Confidence

Hypothesis: Evidence - Heatmap: Here we can see that when presenting users with the option for non-conversion journeys, a majority of users who land on the homepage are looking for a way to sign up. Evidence - Competitor Research: When users are already personalizing their plans from first impression, there is a higher commitment to purchase as the user moves down funnel. Evidence - Removing Distraction: https://docs.google.com/presentation/d/194ySs7bvSlBKl_hbxtTfGXZTl1fNTWRc7pXMeOm8VvU/edit#slide=id.p7

Winner: Homepage Hero Redesign. Evidence - Heatmap: Here we can see that when presenting users with the option for non-conversion journeys, a majority of users who land on the homepage are looking for a way to sign up. Evidence - Competitor Research: When users are already personalizing their plans from first impression, there is a higher commitment to purchase as the user moves down funnel. Evidence - Removing Distraction: https://docs.google.com/presentation/d/194ySs7bvSlBKl_hbxtTfGXZTl1fNTWRc7pXMeOm8VvU/edit#slide=id.p7

Expected Lift
4% – 7.4%
Success Rate
1%
Type
winning pattern
Key Learnings

Hypothesis: Evidence - Heatmap: Here we can see that when presenting users with the option for non-conversion journeys, a majority of users who land on the homepage are looking for a way to sign up. Evidence - Competitor Research: When users are already personalizing their plans from first impression, there is a higher commitment to purchase as the user moves down funnel. Evidence - Removing Distraction: https://docs.google.com/presentation/d/194ySs7bvSlBKl_hbxtTfGXZTl1fNTWRc7pXMeOm8VvU/edit#slide=id.p7

Plain-language summary: This homepage test showed a +5.73% improvement. Projected annual revenue impact: $2,847. The winning approach should be implemented as the new default.
brand:Direct Energyteam:Canadaorg:NRGtype:quantitativedevice:Desktopdevice:Mobiledevice:Tabletfactor:Clarityfactor:Distractionfocus:Layoutfocus:Stylingevidence:Heuristic/Best Practiceevidence:Web Analyticslever:Usabilitylever:Attentionlever:Distraction

Frequently Asked Questions

What is the "Homepage Optimization" insight cluster?

This cluster aggregates 5 research findings, test results, and optimization principles related to homepage optimization. Each entry includes expected lift ranges, confidence levels, and source attribution so you can evaluate applicability to your own tests.

How reliable are the expected lift ranges in this cluster?

Lift ranges represent aggregated outcomes from multiple experiments and research sources. They are directional estimates, not guarantees. Your actual results will vary based on traffic volume, audience, current baseline, and implementation quality. Always validate with your own A/B test.

How do these findings apply to Homepage optimization?

These findings are specifically relevant to homepage optimization on homepage pages. Use the expected lift ranges to prioritize your testing roadmap and the key learnings to inform your hypothesis development.

Where does the data in this cluster come from?

Data is sourced from published UX research, aggregated experiment data across multiple organizations, industry studies, and validated internal findings. Each entry includes its source type so you can assess credibility. Entries marked as validated have supporting statistical evidence.

Turn Insights Into Winning Tests

Stop guessing which tests to run. Use GrowthLayer to track every experiment, surface winning patterns, and build on proven findings.

Explore More