Skip to main content
inconclusive

Listing: Open In A New Tab

Hypothesis

If we implement 'Open In A New Tab' on listing pages (In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation)), then key conversion metrics will improve.

Test Results

37,497
Sample size

Key Learning

Context: Users arriving at the listing can't efficiently find what they're looking for, increasing bounce rates.

What was tested: REAL-WORLD TEST: 'Open In A New Tab' was tested on a live listing page. The test involved 37,497 real visitors. Full statistical results require paid access. Test methodology: In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signu...

Result: No statistically significant difference was detected. No significant difference suggests users adapted to the change quickly, or the variation didn't address the actual friction point. Try testing more targeted elements.

How to Apply This to Your Site

This experiment tested listing: open in a new tab but produced no statistically significant change. The test was run on a category page page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that layout tests typically require large sample sizes to detect small effects. Run your test for at least 2 full business cycles to account for weekly traffic patterns.

What Was Tested

In this experiment, product listing were either opened in the same window (control) or opened in a new tab and focused on (variation). Impact on signups and sales was measured.

Methodology

Confidence Level
70%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments