Product: Conversational Filters on Product Page
Hypothesis
If we replace standard filter UI with conversational question-based filtering, then product discovery and purchase rates will improve because it mirrors how customers naturally think about their needs
Test Results
Key Learning
Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.
What was tested: Conversational filters that mirror natural shopping language reduce cognitive load compared to multi-checkbox filters; guided discovery helps users find relevant products faster This large-scale test (3,080,311 visitors) provides strong statistical confidence in the directional findings.
Result: No statistically significant difference was detected. Navigation tests that don't show a difference may indicate the issue is content findability, not menu structure. Consider search and filtering improvements.
How to Apply This to Your Site
This experiment tested product: conversational filters on product page but produced no statistically significant change. The test was run on a product page page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.
Before you test: Consider that navigation tests typically require large sample sizes to detect small effects. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
What Was Tested
In this experiment, product pages (variant) asked users if they were interested to see holiday gifts with two buttons. Upon clicking "yes", the UI expanded to make another choice in order to see gifts for: Her, Him or Kids. Clicking any of these three would send users to dedicated listing pages with more product recommendations. Impact on sales was measured.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Listing: Instant Filter Results
Context: Users can't quickly find relevant products or content on the listing, leading to frustration and early exits.
Listing: Multiple Steps
Problem: Multi-step processes on the listing can overwhelm users if they can't see how far along they are or how much is left.
Product: Exposed Menu Options
Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.
Product: Open In A New Tab
Context: Users arriving at the product can't efficiently find what they're looking for, increasing bounce rates.