Listing: Customer Star Ratings
Hypothesis
If we implement 'Customer Star Ratings' on listing pages (This experiment tested the presence of customer review (in the variation)), then key conversion metrics will improve.
Test Results
Key Learning
Context: Users on the listing need validation from others before committing — without visible proof of success, they hesitate.
What was tested: REAL-WORLD TEST: 'Customer Star Ratings' was tested on a live listing page. The test involved 379,243 real visitors. Full statistical results require paid access. Test methodology: This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased ...
Result: No statistically significant difference was detected. Inconclusive social proof tests often mean the proof type or placement didn't match what users need at that moment. Try a different format or position.
How to Apply This to Your Site
This experiment tested listing: customer star ratings but produced no statistically significant change. The test was run on a category page page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.
Before you test: Consider that social proof tests typically require large sample sizes to detect small effects. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
What Was Tested
This experiment tested the presence of customer review (in the variation). As a result of adding customer reviews, the product page density decreased (requiring a bit more scrolling from longer product tiles). Impact on conversion was measured. Also the test originally ran as a "removal of customer reviews" test. However it was flipped here to align with the pattern.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Product: Social Counts
Problem: The registration experience on the product asks too much too soon, causing potential users to drop off.
Checkout: Testimonials
Context: Users on the checkout need validation from others before committing — without visible proof of success, they hesitate.
Checkout: Customer Star Ratings
Context: Users on the checkout need validation from others before committing — without visible proof of success, they hesitate.
Product: Benefit Testimonials
Context: Users on the product need validation from others before committing — without visible proof of success, they hesitate.