Product: Product Page
Hypothesis
If we test a similar change on our product pages as tested, then our conversion metric will likely improve based on their implementation decision.
Test Results
Key Learning
Problem: This product has conversion optimization opportunities worth testing.
What worked: implemented this UI change (Feb 3, 2020). Implementation suggests positive internal results
Takeaway: Even small lifts compound — across thousands of sessions, this adds up. Use this win as a foundation for further iteration on adjacent elements.
How to Apply This to Your Site
This experiment demonstrated that product: product page can improve conversions. The test was run on a product page page in the travel industry.
Before you test: Consider that layout tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
What Was Tested
This was a simple calendar picker experiment that Aribnb recently ran and eventually rolled out. The A/B test contains at least 4 simple UI changes which might have contributed to a positive outcome. And so this also shows us what a slightly better UI component looks like.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Checkout: Multiple Steps
Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.
Product: Welcome Mat - Partial
Context: Capturing visitor attention on the product with modals or overlays is a balance between engagement and annoyance.
Content Page: Maybe Later on Content Page
Context: Key actions on the content page disappear as users scroll, creating a gap between intent and the ability to act.
Product: Least Or Most Expensive First
Context: How prices are displayed on the product directly influences perceived value and willingness to buy.