Skip to main content
inconclusive-4.7% lift

Listing: Filled Or Ghost Buttons

Hypothesis

If we implement 'Filled Or Ghost Buttons' on listing pages (In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts), then key conversion metrics will improve.

Test Results

Key Learning

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

What was tested: MIXED RESULTS: 'Filled Or Ghost Buttons' showed mixed outcomes on listing pages (lift range: -9.6% to 0.3%). Some metrics improved while others declined. Decision depends on which metrics are priority. In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contr...

Result: No statistically significant difference was detected. CTA changes that don't move the needle often mean the bottleneck is elsewhere — consider testing the surrounding context or the value proposition instead.

How to Apply This to Your Site

This experiment tested listing: filled or ghost buttons but produced no statistically significant change. The test was run on a category page page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that cta tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.

What Was Tested

In this experiment, the plus and minus quantity icons near the add to cart button were tested with different contrasts. The control had a higher contrast from a solid background color, and the variant was lower contrast. Impact on add to cart and sales was measured. (A/B test was inverted to B/A in order to fit the pattern).

Methodology

Confidence Level
85%
Lift Range
-9.6% to 0.3%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments