Skip to main content
inconclusive+65.0% lift

Pricing Page: Codecademy Pricing and Plan Mix Testing Drives 5x Revenue Growth

Hypothesis

Strategic testing of pricing, plan structure, and checkout flow will significantly increase annual plan adoption and overall revenue for Codecademy's subscription business.

PricingPricing PageEdTechsaasedtechsubscriptionannual-plan

Test Results

Key Learning

Context: How prices are displayed on the pricing page directly influences perceived value and willingness to buy.

What was tested: Annual plan adoption can be dramatically increased through pricing page design and framing — not just discounting. 5x growth from experimentation requires sustained program investment, not one-off tests. Pricing page tests often have the highest leverage in subscription businesses. Checkout optimization in conjunction with pricing page changes compounds results

Result: No statistically significant difference was detected. Pricing tests that are inconclusive may indicate the price itself isn't the issue — the perceived value or the framing might matter more.

How to Apply This to Your Site

This experiment tested pricing page: codecademy pricing and plan mix testing drives 5x revenue growth but produced no statistically significant change. The test was run on a pricing page page in the edtech industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that pricing tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

(now ) worked with Codecademy on a multi-year experimentation program focused on pricing strategy and checkout optimization. Tests covered plan mix presentation, annual vs. monthly plan emphasis, pricing page layout, and checkout flow. The program delivered 5x revenue growth and a 75% increase in customers choosing annual plans over monthly

Methodology

Confidence Level
95%
Lift Range
30.0% to 100.0%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments