A/B Split Testing Reports

Reporting gives you detailed statistics of the testing phase as a whole,  and the separate A/B messages themselves. You can see the final message reports separately.

To access message reports, click Campaigns > A/B Split Tests > Detailed Report.

 

Individual message reports follow the standard email reporting. For more info on each email report, click the links below:

When one of your contacts opens an email they receive, we track that as a unique read. When the mail is read more than once by that person, we track those reads too. The same happens for link clicks within a message. The system manages and stores all of this data in the live detailed reports.

Campaign Overview Report

The Campaign Overview report gives basic information about the overall performance of your campaign. This is only available once the testing period is complete.

Campaign Contact Overview

This section displays the overall campaign report for contacts:

  • Campaign Total Contacts: The first bar is dedicated to the total percentage, and total number of contacts who received the campaign.
  • Campaign Clicks: The second calculates the percentage of recipients who clicked any links in your campaign. Below it, is a section for the best performing links in either message within the campaign. If a list is split 50/50, no winner stats will be visible.
  • Campaign Report Overview: The third bar displays an overview report for Delivered, Unsubscribes, and Bounces.

Campaign Message Overview

This section displays the overall campaign report for opens and clicks for both test messages, and for the winning message. If a list is split 50/50, the winning message report will not appear.

The report shows the percentage and total number of unique opens, the percentage and total number of contacts who clicked, and how many contacts received each individual message.

Campaign Message Comparison

This section shows a graph comparing each message. The bars calculate Unique Opens, Contacts Who Clicked, and the Click-to-Open Rate.

Campaign Message List

The final section displays the sent messages, and stats for each one.

Test Overview Report

The overview report provides basic details on the selected A/B message.

Testing Period

The main graph tracks message opens and clicks during the testing period. These are the details you can see:

  • Total Sent: Displays the total number of messages sent during the testing period.
  • Total Opens: Displays the current open rate of the sent messages.
  • Total Clicks: Displays the current click rate of the sent messages.
  • Testing Metric: This will be determined by how you chose to select your winner. The choices are unique opens or unique clicks.

 

  • Current Test Status: During the testing period,
    • Winner determined: Displays the winning message, and determining percentage at conclusion of testing period.
    • No winner determined: The system will automatically send Message A if no winner is determined.
  • Current Time Status: Displays the current status of the testing period.
    • Test time remaining: Gives the remaining time before a winning message is determined and set.
    • Test Concluded: Once the test is complete, the text displays the date and time the test was concluded.

Test Comparison

Once the test messages send, the test comparison report compares each message until the test comes to conclusion.

 

The test compares the following statistics.

Content/Subject/From Details: These first statistic will depend on what you select to test in the A/B Split Test Set Up.

Recipients: The total number of recipients for each message.

Unique Clicks: The unique clicks each message accumulates.

Unique Opens: The unique opens each message accumulates.

Delivered: The number of successfully delivered mails for each message.

Unsubscribes: The number of unsubscribes each message accumulates.

Bounces: The number of bounces each message accumulates.

Clicks

The clicks report displays the percentage of unique clicks, ooclick-to-open rates and number of recipients who received both messages. Below it, the report separates the unique clicks and click-to-open rate for each A/B message sent, and the Winner.

Unique Clicks Accumulated: The total number of clicks accumulated by both messages.

Click-to-Open Rate: The total click-to-open rate accumulated by both messages

Recipients: The total number of recipients in both messages.

Message Filter

You can filter the messages by Message A, Message B, or Winner message. The details show which link was clicked, the total number of unique clicks, and the total number of clicks. The 'View Who Clicked' button opens a modal showing every contact who clicked on the message.

Opens

The opens report displays the percentage of unique opens, click-to-open rates and number of recipients who received both messages. Below it, the report separates the unique opens and click-to-open rate for each A/B message sent, as well as the Winner.

Unique Opens Accumulated: The total number of opens accumulated by both messages.

Click-to-Open Rate: The total click-to-open rate accumulated by both messages

Recipients: The total number of recipients in both messages.

Message Filter

You can filter the messages by Message A, Message B, or Winner message. The details show which contact opened the messages, the total number of open clicks, and the total number of clicks.

Translate »