Skip to main content
inconclusive+75.0% lift

Onboarding flow: Guardian App Onboarding: Removing 'Start Reading' CTA

Hypothesis

The 'Start reading' CTA in the Guardian app onboarding was giving users an early exit ramp before they completed registration, causing drop-off. Removing it and simplifying the flow would keep users in the funnel and increase completion rates.

LayoutSignupMediaonboardingregistrationmobile-appCTA-removalmedia

Test Results

Key Learning

Context: The primary call-to-action on the onboarding flow isn't converting at its potential — design, copy, or placement may be the bottleneck.

What was tested: Removing an early exit option in an onboarding flow can dramatically increase completion rates even when it appears to restrict user choice. Users who intend to complete registration are not deterred by a more direct path, while users who would have abandoned anyway are redirected toward registration.

Result: No statistically significant difference was detected. This null result is still valuable — it narrows the search space and helps calibrate your minimum detectable effect for future tests.

How to Apply This to Your Site

This experiment tested onboarding flow: guardian app onboarding: removing 'start reading' cta but produced no statistically significant change. The test was run on a signup page in the media industry. Inconclusive results suggest this particular change may not be a priority — focus testing effort on higher-impact areas.

Before you test: Consider that layout tests typically require adequate traffic to reach statistical significance. Run your test for at least 2 full business cycles to account for weekly traffic patterns.

This result reached 95% statistical confidence, meaning there is a very low probability the observed effect was due to chance. Results at this confidence level are generally considered reliable for making business decisions.

What Was Tested

The Guardian app's onboarding flow included a 'Start reading' call-to-action that allowed users to skip registration and go directly to content. The hypothesis was that this early exit was cannibalising registrations. The variant removed the CTA and simplified the onboarding steps, requiring users to complete sign-in before accessing content.

Methodology

Confidence Level
95%
Lift Range
50.0% to 100.0%

Build On These Learnings

Save your own experiments, spot winning patterns across your test history, and stop repeating what's already been tried.

Related Experiments

Explore More Experiments