Skip to main content
inconclusive

Checkout: Add More For Extra Incentive

Hypothesis

If we implement 'Add More For Extra Incentive' on checkout pages (In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional thresh), then key conversion metrics will improve.

Test Results

36,284
Sample size

Key Learning

Context: Key actions on the checkout disappear as users scroll, creating a gap between intent and the ability to act.

What was tested: REAL-WORLD TEST: 'Add More For Extra Incentive' was tested on a live checkout page. The test involved 36,284 real visitors. Full statistical results require paid access. Test methodology: In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element...

Result: No statistically significant difference was detected. This null result is still valuable — it narrows the search space and helps calibrate your minimum detectable effect for future tests.

How to Apply This to Your Site

This experiment tested checkout: add more for extra incentive but produced no statistically significant change. The test was run on a checkout page in the cross-industry industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that form tests typically require large sample sizes to detect small effects. Run your test for at least 2 full business cycles to account for weekly traffic patterns.

What Was Tested

In this experiment, two changes were made to the checkout page: (1) the minimum basket size requirement was made more visible using a floating element, and (2) an additional threshold was introduced to encourage customers to add more items by offering a free gift at a higher spend level. The impact on sales was measured.

Methodology

Confidence Level
70%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments