Winner
Low confidence
Amazon: Site-wide — Loaded Hamburger Menu Beats Its Older Dropdown Version
At first glance some A/B tests may seem like they are beautifully simple with a single controlled variable. Yet as we look at the experiment in more detail, more and more subtle differences start coming into view. This I think is the case with Amazon's most recent experiment where it seems that only a dropdown menu was shifted into a hamburger one - which ended up winning.
Hypothesis
If we test a similar change on our any pages as Amazon tested, then our conversion metric will likely improve based on their implementation decision.
Why This Works
Key Learnings
Viewed 8+ times
Related Entries
Research Finding
Principle
4+ Variation Tests Win 2.4x More Often With 27% Higher Lift
testing_strategyany
Expected lift: 10%-30%
High confidence
Test Idea
Winner
Multiple Steps
navigationlisting
Expected lift: 5%-5%
High confidence
Test Idea
Winner
Pattern #14: Exposed Menu Options
navigationproduct
Expected lift: 0%-5%
High confidence
Research Finding
Principle
Personalized Experiences Generate 41% Higher Impact Than Generic
personalizationany
Expected lift: 20%-50%
High confidence
Best Practice
Loser
Ghost / Outline Buttons Lose to Filled Buttons — Consistently
ctaany
Expected lift: -25%-0%
High confidence