Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

203 experiments
Winners, losers & inconclusive
Full statistical details
winner

Listing: Listing Page

Problem: How "Listing page" is implemented on the listing can meaningfully affect conversion — this element is worth testing.

FormE-commerce
winner

General: CTA Button Optimization

Problem: The primary call-to-action on the general isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
winner

Listing: Listing Page

Problem: How prices are displayed on the listing directly influences perceived value and willingness to buy.

PricingTravel
winner

Product: Product Page

Problem: Users on the product don't feel confident enough to proceed — they need reassurance that their data and money are safe.

LayoutE-commerce
winner

Listing: Listing Page

Problem: Users can't quickly find relevant products or content on the listing, leading to frustration and early exits.

NavigationE-commerce
winner

Product: CTA Button Optimization

Problem: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

LayoutE-commerce
winner

Does Pinning a Mobile Checkout CTA Improve Conversion?

Sticky mobile CTAs can compress time-on-page meaningfully (~15% faster) without sacrificing engagement signals — users converted at a directionally higher rate AND moved through the page faster, suggesting reduced hesitation rather than rushed clicks. The result was shipped via 90/10 holdout monitoring rather than traditional 50/50 A/B inference — the high baseline (~85%) and limited mobile traffic made full A/B underpowered, so the team chose a holdout-validated rollout as the deliberate methodology. Bayesian P(variant > control) was ~0.90, supporting the directional ship call. Worth noting: external research flags sticky CTAs as context-dependent — they help when the primary action is buried below the fold, but can hurt on shorter pages where the original CTA is already visible.

CTAEnergy & Utilities
winner

Product: Product Page

Problem: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

TrustE-commerce
winner

Checkout: Remove Coupon Fields

Problem: Coupon and promo code fields on checkouts can distract users — they leave to hunt for codes, reducing completion rates.

FormCross-Industry
winner+9.0%

Listing: Icon Labels

Problem: Visual elements on the listing aren't doing enough to communicate value, build trust, or guide users toward the next step.

FormCross-Industry
winner+2.1%

Product: Social Counts

Problem: The registration experience on the product asks too much too soon, causing potential users to drop off.

Social ProofCross-Industry
winner+5.3%

Checkout: Multiple Steps

Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.

LayoutCross-Industry
winner+4.3%

Product: Exposed Menu Options

Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.

NavigationCross-Industry
winner+4.0%

Checkout: Sticky Call To Action

Problem: Key actions on the checkout disappear as users scroll, creating a gap between intent and the ability to act.

CTACross-Industry
winner

Content Page: Maybe Later

Problem: How "Maybe later" is implemented on the content page can meaningfully affect conversion — this element is worth testing.

LayoutCross-Industry
winner

Checkout: Filled Or Ghost Buttons

Problem: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner

Product: Product Page

Problem: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
winner

Product: Product Page

Problem: The information hierarchy on the product may not match how users actually scan and process the content.

LayoutE-commerce
winner

Product: Product Page

Problem: Users arriving at the product can't efficiently find what they're looking for, increasing bounce rates.

NavigationE-commerce
winner

Listing: Listing Page

Problem: Users on the listing need validation from others before committing — without visible proof of success, they hesitate.

Social ProofTravel

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More