Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

203 experiments
Winners, losers & inconclusive
Full statistical details
winner

Content Page: Maybe Later

Problem: How "Maybe later" is implemented on the content page can meaningfully affect conversion — this element is worth testing.

LayoutCross-Industry
winner

Product: Product Page

Problem: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
winner

Does Pinning a Mobile Checkout CTA Improve Conversion?

Sticky mobile CTAs can compress time-on-page meaningfully (~15% faster) without sacrificing engagement signals — users converted at a directionally higher rate AND moved through the page faster, suggesting reduced hesitation rather than rushed clicks. The result was shipped via 90/10 holdout monitoring rather than traditional 50/50 A/B inference — the high baseline (~85%) and limited mobile traffic made full A/B underpowered, so the team chose a holdout-validated rollout as the deliberate methodology. Bayesian P(variant > control) was ~0.90, supporting the directional ship call. Worth noting: external research flags sticky CTAs as context-dependent — they help when the primary action is buried below the fold, but can hurt on shorter pages where the original CTA is already visible.

CTAEnergy & Utilities
winner

Checkout: Remove Coupon Fields

Problem: Coupon and promo code fields on checkouts can distract users — they leave to hunt for codes, reducing completion rates.

FormCross-Industry
winner+9.0%

Listing: Icon Labels

Problem: Visual elements on the listing aren't doing enough to communicate value, build trust, or guide users toward the next step.

FormCross-Industry
winner

Product: Product Page — "In X Carts" Social Proof Message

Problem: Users on the product need validation from others before committing — without visible proof of success, they hesitate.

Social ProofE-commerce
winner

Listing: Listing Page

Problem: How "Listing page" is implemented on the listing can meaningfully affect conversion — this element is worth testing.

FormE-commerce
winner

Home landing: UX Pattern Optimization

Problem: How "Ux pattern optimization" is implemented on the home landing can meaningfully affect conversion — this element is worth testing.

LayoutTravel
winner

Home landing: UX Pattern Optimization

Problem: How "Ux pattern optimization" is implemented on the home landing can meaningfully affect conversion — this element is worth testing.

LayoutE-commerce
winner

Restructuring Homepage Hierarchy to Surface Personalized Offers

The story behind this win is the iteration discipline. The first attempt at this homepage redesign changed two systems at once (messaging + routing) and produced an ambiguous result: the entry metric moved slightly positive while downstream metrics moved meaningfully negative. The team correctly identified that the routing change — which inadvertently replaced direct links to a personalized plan-search experience with modal-driven entry into a generic flow — was the downstream killer. The iteration restored the original routing and kept ONLY the homepage hierarchy changes. All funnel metrics moved directionally positive in lockstep (entry +2.38%, mid-funnel +7%, conversion +11.81%) — none stat-sig individually but consistent enough across the funnel to justify shipping. Element-level diagnostics confirmed the mechanism: the segment CTAs the team intended to promote saw a 26-30% lift in unique-visitor interaction, while the unchanged hero banner stayed flat (as expected). Two key behavioral observations: (1) page-length reduction surfaced a 4x lift on a previously buried bottom-of-page zip code input — proving the secondary lesson that 'less page' can mean 'more conversion real estate'; (2) desktop strongly outperformed mobile, with the suspected cause being mobile's lead-with-form pattern (zip code above hero) — putting the form before the message creates friction. The broader transferable insight: when a messy test confounds multiple variables, the right move is to isolate one variable in the next test, not to abandon the hypothesis.

LayoutEnergy & Utilities
winner+5.0%

Listing: Multiple Steps

Problem: Multi-step processes on the listing can overwhelm users if they can't see how far along they are or how much is left.

NavigationCross-Industry
winner+8.3%

Checkout: Remove Coupon Fields

Problem: Coupon and promo code fields on checkouts can distract users — they leave to hunt for codes, reducing completion rates.

FormCross-Industry
winner+8.5%

Pricing Page: More Or Fewer Plans

Problem: How prices are displayed on the pricing page directly influences perceived value and willingness to buy.

PricingFintech
winner+4.3%

Product: Exposed Menu Options

Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.

NavigationCross-Industry
winner

Checkout: Filled Or Ghost Buttons

Problem: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
winner+2.1%

Product: Social Counts

Problem: The registration experience on the product asks too much too soon, causing potential users to drop off.

Social ProofCross-Industry
winner+8.5%

Pricing Page: Least Or Most Expensive First

Problem: How prices are displayed on the pricing page directly influences perceived value and willingness to buy.

PricingEdTech
winner+5.3%

Checkout: Multiple Steps

Problem: Friction during the checkout process causes users to abandon right when they're closest to converting.

LayoutCross-Industry
winner

General: CTA Button Optimization

Problem: The primary call-to-action on the general isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
winner

Product: Product Page

Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.

PricingE-commerce

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More