Our book is out—after 12 years in the making. It’s the ultimate guide to growing any web business.

Multivariate Testing’s Role in CRO (Radiohead versus iTunes)

Radiohead vs iTunes

The music industry can teach web marketers a valuable lesson about how to maximize conversions. If you’re looking at buying multivariate testing software, this article will help you put things into perspective.

As you probably already know, A/B testing tools—and multivariate testing software—tells you which version of your page generates the most conversions. There’s a two-step process:

Step 1—the Content Creator: Someone creates different versions of a page (or page element).

Step 2—the Scorekeeper: Multivariate testing software keeps score of which version generates the most conversions—and declares a winner once there’s enough data.

The software is an extremely valuable part of the process. Without a scorekeeper, you’d never know which version of the page to keep. However, some newcomers appear to be under the illusion that the software is almost magical—that it can create winning pages out of thin air. It’s not true.

To understand this point, think of how the music industry works:

Step 1—the Content Creator: The artist (such as Radiohead, Coldplay or Madonna) records and promotes a song.

Step 2—the Scorekeeper: A company (such as Billboard, Gallup or iTunes) keeps score of which songs have sold the most copies—then declares the winners (by publishing the pop charts).

Now, if you were a record label looking to create a hit song, you wouldn’t just ask the guy next door to record thousands of tunes, then throw them all at the charts, hoping for a winner. You’d be much better off relying on a fantastic recording artist. That’s because the first step—creating the content—is by far the most important step. That’s presumably why Polydor Records signed a £130m (US$204m) deal with U2.

The same principle applies to your web business: you’ll only get fantastic increases in profits if you make the right changes to your webpages.

Amazon.com agrees…

Amazon Quote

In other words, what matters is what you test.

Please don’t misunderstand us: we think multivariate testing software is essential for a web business. And there are some great solutions on the market.

Just don’t expect the software to be more than a highly sophisticated scorekeeper.

If you want help creating amazing content, you could do a lot worse than read our free reports, or our beginner’s guide to multivariate testing.

What you should do now

1. If you’d like us to work on your website—to dramatically improve your conversion rate and profits (like we did for all these companies), then claim your FREE website strategy session. On this free phone consultation, one of our experts will discuss your conversion goals and suggest strategies to double your sales.

2. If you’d like to learn conversion for free, go to our “Learning Zone” page, where you can download templates of million-dollar winning pages. Or, if you’d like us to build your company’s in-house capabilities (not for free), then contact us and we’ll discuss your requirements.

3. If you’d like to work for us—or see why our team members love working for us—then see our “Careers” pages.

4. If you enjoyed this article, then so will your friends, so why not share it on LinkedInTwitterFacebook and Email

All of our articles are subject to our Testimonial Protocol, which is described here.

Next article

“Great return on investment” for the gaming operator 888

Previous article

At last, a comparison of A/B- and split-testing software

We work with clients in any country

So far, we have helped to grow clients in 34 countries in 11 languages.

Contact us

New York

445 Park Avenue
9th Floor
New York, NY 10022
Phone: +1 (212) 829-5720
Fax: +1 (212) 658-9097


207 Regent Street
United Kingdom
Phone: 0800 043 2650 or
+44 (0)203 368 6212
Fax: 0870 838 1135

Staffordshire, UK

Hawkesyard Hall
Armitage Road
Rugeley, Staffordshire
WS15 1PU
United Kingdom
Phone: 0800 043 2650 or
+44 (0)203 368 6212
Fax: 0870 838 1135

© 2018 Implementra Limited trading as Conversion Rate Experts. All rights reserved.