Skip to main content

The A/B Test Library

Real experiments. Real outcomes. Actionable patterns. Browse A/B tests with problem-to-solution framing, results, and recommendations for what to test next.

58 experiments
Winners, losers & inconclusive
Full statistical details
winner

Home landing: UX Pattern Optimization

Problem: How "Ux pattern optimization" is implemented on the home landing can meaningfully affect conversion — this element is worth testing.

LayoutTravel
loser

General: Navigation Structure Test

Problem: The primary call-to-action on the general isn't converting at its potential — design, copy, or placement may be the bottleneck.

NavigationTravel
winner

Home landing: Hero Image Variation

Problem: The first screen of the home landing must immediately communicate value — if it doesn't, users bounce before scrolling.

ImageryTravel
winner

Home landing: CTA Button Optimization

Problem: The primary call-to-action on the home landing isn't converting at its potential — design, copy, or placement may be the bottleneck.

LayoutSaaS
winner

Home landing: UX Pattern Optimization

Problem: How "Ux pattern optimization" is implemented on the home landing can meaningfully affect conversion — this element is worth testing.

LayoutSaaS
winner

Home landing: Checkout Flow Simplification

Problem: Friction during the home landing process causes users to abandon right when they're closest to converting.

LayoutSaaS
winner

Home landing: Navigation Structure Test

Problem: Users arriving at the home landing can't efficiently find what they're looking for, increasing bounce rates.

FormTravel
winner

Home landing: Navigation Optimization

Problem: Users arriving at the home landing can't efficiently find what they're looking for, increasing bounce rates.

NavigationTravel
winner

Home landing: Search UX Enhancement

Problem: Users arriving at the home landing can't efficiently find what they're looking for, increasing bounce rates.

FormTravel
winner

Home landing: Homepage — 4 Button Labels With "Try It Now" Possibly Leading

Problem: The primary call-to-action on the home landing isn't converting at its potential — design, copy, or placement may be the bottleneck.

FormSaaS
winner

Home landing: Layout Optimization

Problem: The primary call-to-action on the home landing isn't converting at its potential — design, copy, or placement may be the bottleneck.

LayoutTravel
winner

Home landing: Homepage — All These Tested Homepage Variations - Perhaps This One Will Help?

Problem: Product recommendations on the home landing either help users find what they need or add noise that distracts from the primary purchase.

LayoutSaaS
winner

Home landing: Search UX Enhancement

Problem: Users can't quickly find relevant products or content on the home landing, leading to frustration and early exits.

FormTravel
winner

Home landing: Search UX Enhancement

Problem: Users can't quickly find relevant products or content on the home landing, leading to frustration and early exits.

LayoutTravel
inconclusive

Landing Page: Social Proof at Checkout Increases Orders; Social Proof at Top of Funnel Hurts

Context: Users on the landing page need validation from others before committing — without visible proof of success, they hesitate.

Social ProofFintech
inconclusive

Multiple: Thortful Greeting Cards: Experimentation Program Delivers 30x ROI

Context: Friction during the multiple process causes users to abandon right when they're closest to converting.

Testing StrategyE-commerce
inconclusive

General: Commonly Used Metrics Are Poor Predictors of Business Impact

Principle: Always tie test metrics to a revenue or retention outcome. Vanity metrics (CTR, bounce rate) are easy to move but rarely correlate with business results. Use downstream metrics wherever possible.

MeasurementCross-Industry
inconclusive

General: Test Quality Peaks at 1–10 Annual Tests Per Engineer; Drops 87% After 30

Principle: Use a prioritization framework (PIE, ICE, or custom scoring) before building a test. Quality hypothesis generation matters more than raw test velocity.

Testing StrategyCross-Industry

Stop Re-Running Failed Tests

Build on what's already been learned. Save your own experiments, surface winning patterns, and make every test count.

Browse Experiments By

Comparisons

Popular Combos

Explore More