Listing: Listing Page — One Modal Too Far: Booking's Rejected Destination Overlay Experiment
Hypothesis
If we test a similar change on our listing pages as rejected, we should be cautious
Test Results
Key Learning
Problem: Capturing visitor attention on the listing with modals or overlays is a balance between engagement and annoyance.
What was tried: rejected this UI change (May 27, 2019). Rejection suggests the change underperformed the control
Why it failed: Major layout changes often lose because they disrupt learned user behavior. Test smaller, incremental layout tweaks instead.
How to Apply This to Your Site
This test showed that listing: listing page — one modal too far: booking's rejected destination overlay experiment hurt conversions. The change was tested on a category page page in the travel industry. Avoid replicating this exact approach — instead, consider testing the opposite direction or a more subtle variation.
Before you test: Consider that layout tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
What Was Tested
really likes to use popups, overlays and nudges of various shapes and sizes. Hey why don't you sign in? Why don't you pick your travel dates? Look, someone is about to rent out the room you're looking at. One of their recent destination listing experiments however hints that a particular modal was simply too much when it was eventually rejected.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Checkout: Multiple Steps
Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.
Product: Welcome Mat - Partial
Context: Capturing visitor attention on the product with modals or overlays is a balance between engagement and annoyance.
Content Page: Maybe Later on Content Page
Context: Key actions on the content page disappear as users scroll, creating a gap between intent and the ability to act.
Product: Least Or Most Expensive First
Context: How prices are displayed on the product directly influences perceived value and willingness to buy.