Mobile: Mobile Sitewide
Test Results
Key Learning
Context: Mobile users experience the mobile differently — smaller screens, touch targets, and limited attention require purpose-built design.
What was tested: A variation was tested against the existing experience.
Result: No statistically significant difference was detected. Navigation tests that don't show a difference may indicate the issue is content findability, not menu structure. Consider search and filtering improvements.
How to Apply This to Your Site
This experiment tested mobile: mobile sitewide but produced no statistically significant change. The test was run on a mobile page in the energy & utilities industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.
Before you test: Consider that navigation tests typically require large sample sizes to detect small effects. This test ran for 40 days — plan for at least that long.
This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.
What Was Tested
A/B test on mobile testing navigation changes.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Product: Exposed Menu Options
Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.
Listing: Instant Filter Results
Context: Users can't quickly find relevant products or content on the listing, leading to frustration and early exits.
Listing: Multiple Steps
Problem: Multi-step processes on the listing can overwhelm users if they can't see how far along they are or how much is left.
Product: Open In A New Tab
Context: Users arriving at the product can't efficiently find what they're looking for, increasing bounce rates.