Listing: Search Keyword Highlighting
Hypothesis
If we implement 'Search Keyword Highlighting' on listing pages (In this experiment, a different style for keyword highlighting was used), then key conversion metrics will improve.
Test Results
Key Learning
Context: Users can't quickly find relevant products or content on the listing, leading to frustration and early exits.
What was tested: REAL-WORLD TEST: 'Search Keyword Highlighting' was tested on a live listing page. The test involved 738,295 real visitors. Full statistical results require paid access. Test methodology: In this experiment, a different style for keyword highlighting was used.
Result: No statistically significant difference was detected. This null result is still valuable — it narrows the search space and helps calibrate your minimum detectable effect for future tests.
How to Apply This to Your Site
This experiment tested listing: search keyword highlighting but produced no statistically significant change. The test was run on a category page page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.
Before you test: Consider that personalization tests typically require large sample sizes to detect small effects. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
What Was Tested
In this experiment, a different style for keyword highlighting was used.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Product-listing: Plans Page: User-Focused Filter Language Increases Plan Selection
Context: Coupon and promo code fields on product-listings can distract users — they leave to hunt for codes, reducing completion rates.
Product: Personalized Next Step
Context: A one-size-fits-all product experience underperforms compared to content tailored to the visitor's context and intent.
Homepage: Visitor Segmentation by User Type
Problem: Users on the homepage need validation from others before committing — without visible proof of success, they hesitate.
General: Personalized Experiences Generate 41% Higher Impact Than Generic
Principle: Personalization — even basic segmentation by traffic source, device, or returning vs new visitor