Mailings :: A/B Testing


Overview

The A/B Testing feature is a simple and fast way to test different mailings on a portion of your list before sending to everyone. You can see the performance (open rate, click-through rate, etc.) and then decide which mailing is the best - and then send that one to the rest of the list. You can use this feature to check if a different subject line would help or to see if a different creative, colors, etc. would be better. Test two or more versions head-to-head or just one message on it’s own to make sure it performs up to expectations before you send it.

How To

To get started with A/B testing, you’ll need to select multiple mailings to compare. You can either create new ones or use existing mailings already in your account.

  • Go to the Mailings tab
  • Create 1–5 mailings or select existing ones
  • Check the boxes next to the mailings you want to test
  • Click A/B Testing

upload-example.gif

After selecting your mailings for A/B testing, you’ll be taken to the scheduling page where you can define how much of your audience will be used for the test. A slider will appear on the right side, allowing you to choose the percentage of your list that will receive the test messages.

  • On the Schedule Mailing page, locate the slider on the right
  • Adjust the slider to select the test percentage of your list
  • The selected portion will receive the A/B test messages

upload-example-2.gif

We recommend waiting 24 hours before reviewing results to get an accurate comparison of your A/B test performance. You can then review detailed reports to determine which mailing performed best and send it to the rest of your list.

  • Go to the Reports tab
  • Select Individual Mailings
  • Choose the messages you tested
  • Run the report to compare performance side by side
  • Select the best-performing mailing
  • In the Schedule Remainder section, click Send Now to complete the campaign

upload-example-3.jpg

If you need a deeper analysis of your A/B test results, you can access detailed reporting for each mailing. This allows you to explore specific engagement metrics and take further actions based on recipient behavior.

  • Click the Details section in your report
  • View in-depth metrics and performance data
  • Use available options to:
    • Download opens, openers, or opt-outs
    • Review bounce data
    • Copy openers to a list for follow-up campaigns

upload-example-4.jpg

Note: The mailings should differ in some way. You may want to change subject lines, use a second domain, or maybe try out different content to gauge user response.

×

Contact Us

Support Resources

ReachMail is here to help. If you have any questions, please use the form below or contact us at:

Support Hours: 8am - 6pm (Central Time) Mon-Fri