Skip to main content
Inconclusive
Low confidence

Long Titles

In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines. Developing it wouldn’t require much effort—just a few days of an engineer’s time—but it was one of hundreds of ideas proposed, and the program managers deemed it a low priority. So it languished for more than six months, until an engineer, who saw that the cost of writing the code for it would be small, launched a simple online controlled experiment—an A/B test—to assess its impact. Within hours the new headline variation was producing abnormally high revenue, triggering a “too good to be true” alert. HBR, September–October 2017 Issue, https://hbr.org/2017/09/the-surprising-power-of-online-experiments Note : This experiment was a solid success and replicated multiple times over a period of months. It worked at Bing and had a profound influence. The only reason why we atributed a 0.25 point (a "Maybe") was because we don't have the exact sample size and conversion data.

Hypothesis

If we implement 'Long Titles' on listing pages (In 2012 a Microsoft employee working on Bing had an idea about changing the way the search engine displayed ad headlines), then key conversion metrics will improve.

Why This Works

Key Learnings

Viewed 8+ times

Related Entries