Checkout: Personalized Free Shipping Threshold Message
Hypothesis
Personalizing shipping messaging on the cart page — showing 'Congratulations, you qualify for free shipping!' or 'Just $X more to qualify'
Test Results
Key Learning
Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.
What worked: Personalized, dynamic threshold messaging on cart pages outperforms generic free shipping statements. Critical insight: free shipping messaging only converts positively when the threshold is achievable — raising the threshold while displaying the message actively hurts conversions (−15% when threshold raised from $50 to $75). (+7.0% lift)
Takeaway: A meaningful improvement that compounds with other optimizations. Copy is the cheapest element to iterate on — test different headline frameworks and value propositions to push this further.
How to Apply This to Your Site
This experiment demonstrated that checkout: personalized free shipping threshold message can produce a +7.0% improvement in conversions. The test was run on a checkout page in the retail industry.
Before you test: Consider that copy & messaging tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.
This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.
What Was Tested
replaced Sport Chek's generic 'Free shipping on orders of $25 or more' cart message with a personalized state-based message: 'Congratulations, you qualify for free shipping!' for qualifying carts, and 'Just $X.XX more to qualify for free shipping' for those below threshold. The test discovered mid-experiment that changing the threshold from $50 to $75 caused messaging to have negative effect when threshold was higher.
Methodology
Build On These Learnings
Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.
Related Experiments
Content Page: Inline Link Nudge
Context: Form input design on the content page affects completion rates — label placement, validation timing, and field clarity all matter.
Does a 90-Day Plan-Change Guarantee Badge Increase Click-Throughs?
Ambiguity > absence. A vague benefit callout can create more friction than no callout at all: visitor diagnostics showed users were drawn in by the badge (time-on-page up, bounce rate down) but exit rate rose and FAQ-section attractiveness spiked — a signature of users searching for answers and not finding them. The same concept won at a sister brand whose variant used descriptive benefit-framed copy ("we'll help you find the right plan if this isn't a fit"); the variant in this test used short labelled-badge copy that raised more questions than it answered. The lesson is not that benefit guarantees fail — it's that surfacing one with insufficient context can backfire by introducing uncertainty the page doesn't resolve.
Home landing: Empowering Headline
Context: The headline on the home landing may not resonate with what users actually care about or address their top objections.
Product: More For Less Headline
Context: The headline on the product may not resonate with what users actually care about or address their top objections.