Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

599 experiments
Winners, losers & inconclusive
Full statistical details
inconclusive

Listing: Hover Button

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Product: Buy Now Or Smaller Commitment Button

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Checkout: Complementary Upsell

Context: Friction during the checkout process causes users to abandon right when they're closest to converting.

LayoutCross-Industry
inconclusive

Product: Shortcut Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
loser

Does Adding a Shopping CTA to the Main Navigation Drive Plan Views?

A CTA's click rate is not its conversion contribution. This test surfaced one of the most consistently underweighted patterns in CRO: behavioral diagnostics almost always tell a more honest story than the topline. The aggregate result looked like a tiny non-significant lift (+1%); the diagnostic revealed that of every 100 button clicks, only 6 reached the next funnel step. Two failure modes converged: (1) copy intent mismatch — the chosen label read as 'create account' rather than 'shop,' so a large share of clicks came from users trying to log in / manage their account from support and customer pages; (2) extra modal step before the destination page added friction without value. The aggregate lift was partially cannibalization from higher-converting paths. The transferable pattern: when introducing a global navigation element, validate the click→conversion ratio per source page, not just the topline. High clicks from low-intent pages creates a false signal of engagement that can mask poor performance.

CTAEnergy & Utilities
inconclusive

Content Page: Maybe Later on Content Page

Context: Key actions on the content page disappear as users scroll, creating a gap between intent and the ability to act.

LayoutCross-Industry
inconclusive

Product: Canned Response

Context: The registration experience on the product asks too much too soon, causing potential users to drop off.

LayoutCross-Industry
inconclusive

Listing: Visible Payment Options

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

Home landing: Example Situations

Context: Multi-step processes on the home landing can overwhelm users if they can't see how far along they are or how much is left.

LayoutCross-Industry
inconclusive-4.7%

Listing: Filled Or Ghost Buttons

Context: The primary call-to-action on the listing isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
inconclusive

General: Personalized Greeting Headline

Context: The headline on the general may not resonate with what users actually care about or address their top objections.

Copy & MessagingCross-Industry
inconclusive

Product: Welcome Mat - Partial

Context: Capturing visitor attention on the product with modals or overlays is a balance between engagement and annoyance.

LayoutCross-Industry
winner+8.5%

Pricing Page: More Or Fewer Plans

Problem: How prices are displayed on the pricing page directly influences perceived value and willingness to buy.

PricingFintech
inconclusive

Product: Visible Availability

Context: Multi-step processes on the product can overwhelm users if they can't see how far along they are or how much is left.

LayoutCross-Industry
inconclusive

Checkout: Floating Labels

Context: Key actions on the checkout disappear as users scroll, creating a gap between intent and the ability to act.

FormCross-Industry
inconclusive

Product: Single Or Alternative Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry
loser

Does Restructuring Plan Detail Cards Improve Click-Through?

Test the variable users actually complain about — not the variable that's easiest to redesign. This test is a textbook case of treating form when the problem is content. Cross-brand qualitative research had consistently flagged three specific confusion themes: (1) pricing structure is opaque — users can't predict what they'll pay; (2) plan names are brand-driven rather than benefit-driven, so the names themselves don't communicate what the user is buying; (3) no side-by-side comparison — vertical layouts force users to scroll and remember instead of compare in parallel. Visual hierarchy is a presentation improvement; it does nothing about pricing opacity, naming clarity, or comparison difficulty. The test reached its planned sample size and produced a directionally-negative result at the noise floor — because organizing unclear content doesn't make the content clearer. The transferable insight isn't about visual hierarchy specifically; it's about the importance of mapping qualitative complaints to the test variable. If the user research says 'I don't understand what this plan costs,' the test should manipulate cost-clarity. If it says 'I can't tell these plans apart,' the test should manipulate differentiation. Layout tests are appropriate when the complaint is about layout — not when they're a default reflex.

LayoutEnergy & Utilities
inconclusive

Checkout: Centered Forms & Buttons

Context: The primary call-to-action on the checkout isn't converting at its potential — design, copy, or placement may be the bottleneck.

FormCross-Industry
inconclusive

Product: Least Or Most Expensive First

Context: How prices are displayed on the product directly influences perceived value and willingness to buy.

LayoutCross-Industry
inconclusive

Product: Contrast Links & Buttons

Context: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTACross-Industry

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More