Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

11 experiments
Winners, losers & inconclusive
Full statistical details
winner+7.0%

Checkout: Personalized Free Shipping Threshold Message

Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.

Copy & MessagingRetail
winner+115.0%

Checkout: Checkout Objection Copy

Problem: Each additional form field adds friction to the checkout, increasing the chance users abandon before completing their submission.

Copy & MessagingSaaS
winner+20.0%

Checkout: Marketplace Order Confirmation Upsell

Problem: Users can't quickly find relevant products or content on the checkout, leading to frustration and early exits.

LayoutE-commerce
winner

Does Pinning a Mobile Checkout CTA Improve Conversion?

Sticky mobile CTAs can compress time-on-page meaningfully (~15% faster) without sacrificing engagement signals — users converted at a directionally higher rate AND moved through the page faster, suggesting reduced hesitation rather than rushed clicks. The result was shipped via 90/10 holdout monitoring rather than traditional 50/50 A/B inference — the high baseline (~85%) and limited mobile traffic made full A/B underpowered, so the team chose a holdout-validated rollout as the deliberate methodology. Bayesian P(variant > control) was ~0.90, supporting the directional ship call. Worth noting: external research flags sticky CTAs as context-dependent — they help when the primary action is buried below the fold, but can hurt on shorter pages where the original CTA is already visible.

CTAEnergy & Utilities
winner+8.3%

Checkout: Remove Coupon Fields

Problem: Coupon and promo code fields on checkouts can distract users — they leave to hunt for codes, reducing completion rates.

FormCross-Industry
winner

Checkout: Remove Coupon Fields

Problem: Coupon and promo code fields on checkouts can distract users — they leave to hunt for codes, reducing completion rates.

FormCross-Industry
winner+5.3%

Checkout: Multiple Steps

Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.

LayoutCross-Industry
winner+4.0%

Checkout: Sticky Call To Action

Problem: Key actions on the checkout disappear as users scroll, creating a gap between intent and the ability to act.

CTACross-Industry
winner

Checkout: Filled Or Ghost Buttons

Problem: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner+5.3%

Checkout: Grid Page Progress Bar

Problem: The first screen of the checkout must immediately communicate value — if it doesn't, users bounce before scrolling.

FormEnergy & Utilitiesn=33,413
winner+5.7%

Checkout: Mobile Checkout

Problem: Mobile users experience the checkout differently — smaller screens, touch targets, and limited attention require purpose-built design.

CTAEnergy & Utilitiesn=8,994

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More