Follow

Making an A/B Test Email

María Rico

In this section you will find information on the following:

  1. What can I do with A/B testing?
  2. Adjustments to set up your test
  3. How to select the sample?
  4. How to select the winning sample?
  5. What is the threshold?
  6. What time should I set to send the winning option?

_____________


1. What can I do with A/B testing?


With A/B testing you can quickly and easily test the following:

- Test two different subject texts to check which of them gets the best results and the highest rate of opens or clicks.

- Test two completely different designs to see which of returns the best results or find out which part of the creative turns out to be the most attractive.

 

 

2. Set up your test

To create an A/B Test, go to the Email/SMS Marketing section of the left side menu and select “Create A/B Test” from the “Create Campaign” button.

 

 

Test types (1 in the image)

You can validate the subject or the creative:

- Send one campaign with a subject to sample A, and another subject to sample B and the winning version that achieves the best result will be sent to the rest of the list.

- Send one campaign with a creative to sample A, and another creative to sample B and the winning version that achieves the best result will be sent to the rest of the list.

Thanks to this option you can optimize your creatives and subject lines, by analysing the subscribers’ behaviour from our list.

 

3. How do I select the sample? (2 in the image)

You can easily divide the sample and define the percentage of the list that you will send the winning test A/B to by using a selector bar.

By moving the selector bar you can choose the percentage of the total subscribers to be sent to test A and test B. The Winner of the test will be sent to the remaining percentage of the list.

 

4. How is the winning sample selected? (3 in the image)

We allow you to choose two criteria to decide on the winning test, which will present a higher percentage of opens or clicks.

 

5. What is the threshold? (4 in the image)

The threshold defines whether the winning test will be sent or not. For example, if you set a threshold of 10% opens and, within the time frame of the test, we do not reach this threshold, the winning test will not be sent to the rest of the list and the delivery will be cancelled because it has not met the minimum requirements. (The campaign will only be sent to samples A and B). If we use a threshold of 0% the winning test with the creative or subject that achieves the highest result of opens or clicks will be sent.

 

What time should I set to send the winning option ? (5 in the image)

Before the winning version is sent, the test gathers all the information about samples A and B. You can set the time in hours or days, or according to your needs. It is important to keep in mind that the winning test will be sent once the test time has finished, that means if we set an A/B test to be active for 4 hours, until this time frame is completed, the winner test cannot be sent to the rest of the list.


Fort other steps of the campaign please check the post "Creating an Email Campaing" here: https://mdtr.io/E5VkL

 

Was this article helpful?
1 out of 1 found this helpful
Have more questions? Submit a request

Comments

Powered by Zendesk