Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

51 experiments
Winners, losers & inconclusive
Full statistical details
loser

Home landing: Headline & Copy Test

Problem: The headline on the home landing may not resonate with what users actually care about or address their top objections.

FormTravel
loser

Product: Product Page — Smaller & Shorter Product Titles

Problem: How "Product page — smaller & shorter product titles" is implemented on the product can meaningfully affect conversion — this element is worth testing.

Copy & MessagingE-commerce
loser

Listing: Listing Page

Problem: The information hierarchy on the listing may not match how users actually scan and process the content.

LayoutE-commerce
loser

Product: Product Page

Problem: Visual elements on the product aren't doing enough to communicate value, build trust, or guide users toward the next step.

ImageryE-commerce
loser

Product: CTA Button Optimization

Problem: The primary call-to-action on the product isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
loser

Listing: Listing Page — Suggesting That Less Isn't Necessarily More

Problem: Users on the listing need validation from others before committing — without visible proof of success, they hesitate.

LayoutE-commerce
loser

Product: Product Page

Problem: The information hierarchy on the product may not match how users actually scan and process the content.

LayoutE-commerce
loser

Product: Product Page

Problem: Visual emphasis on the product may not be drawing attention to the right elements — size, color, and contrast guide the eye.

Copy & MessagingE-commerce
loser

Product: Product Page

Problem: Users on the product need validation from others before committing — without visible proof of success, they hesitate.

Social ProofE-commerce
loser

Product: Product Page — : Floating Buy Box

Problem: Key actions on the product disappear as users scroll, creating a gap between intent and the ability to act.

LayoutE-commerce
loser

Does a 90-Day Plan-Change Guarantee Badge Increase Click-Throughs?

Ambiguity > absence. A vague benefit callout can create more friction than no callout at all: visitor diagnostics showed users were drawn in by the badge (time-on-page up, bounce rate down) but exit rate rose and FAQ-section attractiveness spiked — a signature of users searching for answers and not finding them. The same concept won at a sister brand whose variant used descriptive benefit-framed copy ("we'll help you find the right plan if this isn't a fit"); the variant in this test used short labelled-badge copy that raised more questions than it answered. The lesson is not that benefit guarantees fail — it's that surfacing one with insufficient context can backfire by introducing uncertainty the page doesn't resolve.

Copy & MessagingEnergy & Utilities
loser

Product: Product Page

Problem: How prices are displayed on the product directly influences perceived value and willingness to buy.

PricingE-commerce
loser

Does Adding a Shopping CTA to the Main Navigation Drive Plan Views?

A CTA's click rate is not its conversion contribution. This test surfaced one of the most consistently underweighted patterns in CRO: behavioral diagnostics almost always tell a more honest story than the topline. The aggregate result looked like a tiny non-significant lift (+1%); the diagnostic revealed that of every 100 button clicks, only 6 reached the next funnel step. Two failure modes converged: (1) copy intent mismatch — the chosen label read as 'create account' rather than 'shop,' so a large share of clicks came from users trying to log in / manage their account from support and customer pages; (2) extra modal step before the destination page added friction without value. The aggregate lift was partially cannibalization from higher-converting paths. The transferable pattern: when introducing a global navigation element, validate the click→conversion ratio per source page, not just the topline. High clicks from low-intent pages creates a false signal of engagement that can mask poor performance.

CTAEnergy & Utilities
loser

Does Restructuring Plan Detail Cards Improve Click-Through?

Test the variable users actually complain about — not the variable that's easiest to redesign. This test is a textbook case of treating form when the problem is content. Cross-brand qualitative research had consistently flagged three specific confusion themes: (1) pricing structure is opaque — users can't predict what they'll pay; (2) plan names are brand-driven rather than benefit-driven, so the names themselves don't communicate what the user is buying; (3) no side-by-side comparison — vertical layouts force users to scroll and remember instead of compare in parallel. Visual hierarchy is a presentation improvement; it does nothing about pricing opacity, naming clarity, or comparison difficulty. The test reached its planned sample size and produced a directionally-negative result at the noise floor — because organizing unclear content doesn't make the content clearer. The transferable insight isn't about visual hierarchy specifically; it's about the importance of mapping qualitative complaints to the test variable. If the user research says 'I don't understand what this plan costs,' the test should manipulate cost-clarity. If it says 'I can't tell these plans apart,' the test should manipulate differentiation. Layout tests are appropriate when the complaint is about layout — not when they're a default reflex.

LayoutEnergy & Utilities
loser

Product: Product Page

Problem: Users on the product need validation from others before committing — without visible proof of success, they hesitate.

Social ProofE-commerce
loser

General: Potentially Confounded Button Color A/B Test

Problem: The primary call-to-action on the general isn't converting at its potential — design, copy, or placement may be the bottleneck.

CTAE-commerce
loser

Product: Product Page

Problem: Users arriving at the product can't efficiently find what they're looking for, increasing bounce rates.

FormE-commerce
loser

General: Big Navigation A/B Test With 8 Confounded UI Changes

Problem: Users arriving at the general can't efficiently find what they're looking for, increasing bounce rates.

NavigationE-commerce
loser

Home landing: UX Pattern Optimization

Problem: How "Ux pattern optimization" is implemented on the home landing can meaningfully affect conversion — this element is worth testing.

LayoutTravel
loser

Product: Product Page

Problem: This product has conversion optimization opportunities worth testing.

LayoutTravel

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More