What is multivariate testing?

To get articles like this free in your inbox, subscribe to our newsletter (the link opens in an overlay).

If you’re serious about online profits, you need to be carrying out split tests on your webpages. The results from multivariate testing and A/B split testing can be amazing; increases in revenue of over 100% are not uncommon.

What is a split test?

In a simple split test, different visitors see different versions of one of your pages. For example, some visitors may see the existing version of a page, whereas others see a new version. Split-testing software “keeps score” of which version generates the most conversions. (A conversion can be whatever you want it to be—orders placed, leads submitted, etc.)

Once you have enough data, the software announces which page was the winner. You then promote that page to be the new “champion.”

The test described above would be called an A/B test, because two page versions were tested, Version A and Version B. A test with three page versions would be called an A/B/C test. “A/B/n” is often used as shorthand for a test that has n different page versions.

What is multivariate testing?

Depending on how frequently you get conversions, it can take weeks or months—or longer—to collect enough data to declare a winner. You may get frustrated waiting for one test to finish before you run the next one. If so, multivariate testing may help. It allows you to carry out several A/B/n split tests on different page elements simultaneously. For example, you may choose to test two different headlines whilst testing two different calls to action.

If you haven’t heard of multivariate testing, maybe you know it by another name, such as

Most of the software tools allow you to carry out both multivariate tests and A/B/n split tests.

Here are some great resources to help you get the best results from multivariate testing software:

How much did you like this article?

(Your feedback helps us shape future articles.)
What should we keep doing? What should we do differently?


What’s your goal today?

1. Hire us to grow your company

We’ve generated hundreds of millions for our clients, using our unique CRE Methodology™. To discover how we can help grow your business:

Claim your FREE strategy session

2. Learn how to do conversion

Browse hundreds of articles, containing an amazing number of useful tools and techniques. Many readers tell us they have doubled their sales by following the advice in these articles.

Download a free copy of our Amazon #1 best-selling book, Making Websites Win, recommended by Google, Facebook, Microsoft, Moz, Econsultancy, and many more industry leaders. You’ll also be subscribed to our email newsletter and notified whenever we publish new articles or have something interesting to share.

Download a free copy of our best-selling book

3. Work for us

If you want to join our team—or if you want to discover why our team members love working for us—then see our “Careers” pages.

4. Contact us

We help businesses worldwide, so get in touch!


© 2020 Implementra Limited trading as Conversion Rate Experts. All rights reserved.