Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

78 experiments
Winners, losers & inconclusive
Full statistical details
inconclusive

Listing: Links Or Buttons

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Contrast Links & Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Checkout: Back Buttons

Context: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Action Button

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Repeated Bottom Call To Action

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner

Checkout: Filled Or Ghost Buttons

Problem: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Benefit Button

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Checkout: No Commitment Default

Context: Friction during the checkout process causes users to abandon right when they're closest to converting.

CTACross-Industry
inconclusive

Product: Inverted Or Consistent Button Styles

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive-4.7%

Listing: Filled Or Ghost Buttons

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Buy Now Or Smaller Commitment Button

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Shortcut Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner+4.0%

Checkout: Sticky Call To Action

Problem: Key actions on the checkout disappear as users scroll, creating a gap between intent and the ability to act.

CTACross-Industry
loser

Does Adding a Shopping CTA to the Main Navigation Drive Plan Views?

A CTA's click rate is not its conversion contribution. This test surfaced one of the most consistently underweighted patterns in CRO: behavioral diagnostics almost always tell a more honest story than the topline. The aggregate result looked like a tiny non-significant lift (+1%); the diagnostic revealed that of every 100 button clicks, only 6 reached the next funnel step. Two failure modes converged: (1) copy intent mismatch — the chosen label read as 'create account' rather than 'shop,' so a large share of clicks came from users trying to log in / manage their account from support and customer pages; (2) extra modal step before the destination page added friction without value. The aggregate lift was partially cannibalization from higher-converting paths. The transferable pattern: when introducing a global navigation element, validate the click→conversion ratio per source page, not just the topline. High clicks from low-intent pages creates a false signal of engagement that can mask poor performance.

CTAEnergy & Utilities
inconclusive

Listing: Hover Button

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Single Or Alternative Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Checkout: Above The Fold Call To Action

Context: The first screen of the checkout must immediately communicate value — if it doesn't, users bounce before scrolling.

CTACross-Industry
inconclusive

Listing: Visible Payment Options

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner

Does Pinning a Mobile Checkout CTA Improve Conversion?

Sticky mobile CTAs can compress time-on-page meaningfully (~15% faster) without sacrificing engagement signals — users converted at a directionally higher rate AND moved through the page faster, suggesting reduced hesitation rather than rushed clicks. The result was shipped via 90/10 holdout monitoring rather than traditional 50/50 A/B inference — the high baseline (~85%) and limited mobile traffic made full A/B underpowered, so the team chose a holdout-validated rollout as the deliberate methodology. Bayesian P(variant > control) was ~0.90, supporting the directional ship call. Worth noting: external research flags sticky CTAs as context-dependent — they help when the primary action is buried below the fold, but can hurt on shorter pages where the original CTA is already visible.

CTAEnergy & Utilities
inconclusive

Product: Square or Rounded Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More