Deployteq offers various options for A/B testing. Split Run allows you to evenly distribute email addresses across different mailings. This way, after sending, you can precisely see which mailing performed the best. Another method of A/B testing is Smart Run. With Smart Run, you send different mailings to small batches. After a predetermined time, Deployteq checks which variant performed the best. This winning variant is then sent to the rest of the recipients.

To utilize Smart Run, you must first purchase the Smart Run app via the Store.

Installation

In the Store, the Smart-Run app can be easily installed using the installation wizard. Click on the Smart-Run tile in the Store to get started.

Go through the installation wizard until you receive the notification that the Setup is complete.

Using Smart-Run

After installing the app, you will find an additional option in the dropdown menu labeled 'Quickmail type' within the Quickmail menu.

If you select the Smart-Run option here, you will see several new settings.

Below, we'll explain the various settings:


Select winner based on	This setting determines the criterion for determining the winner of your A/B test. The options are: Number of opens: The version with the most opens becomes the winner of the test and will then be sent to the rest of the target audience. Number of clicks: The version with the most clicks becomes the winner of the test and will then be sent to the rest of the target audience. Click to Open (clicks/opens): The version with the highest CTO (Click to Open) ratio becomes the winner of the test and will then be sent to the rest of the target audience. Highest conversion: The version with the highest conversion rate becomes the winner of the test and will then be sent to the rest of the target audience. You can read more about measuring email conversion rates here.
Sample size	This setting allows you to specify the percentage of your target audience to whom you want to send the test.
Wait (type)	This setting allows you to configure the type of waiting period (in minutes, hours, or days). During this waiting period, the winner is determined, and the best-performing content is then sent to the rest of the target audience.
Wait (amount)	This setting allows you to define the quantity of the previously specified type of waiting period. For example, 10 minutes, 4 hours, or 1 week.

Configure the remaining Quickmail settings as usual. You can find more information about this here: https://docs.deployteq.net/dug/getting-started-with-deployteq/how-do-i-schedule-a-mailing-or-sms/quickmail/how-do-i-test-a-quickmail

When you reach the option 'Choose an email,' after selecting an email, you will immediately have the option to choose another email. You can continue doing this until you have selected all the content you want to test.

Reports

In the Reporting menu under Quickmails, you will find an evaluation of how the deployment of the Smart-Run test set compares to the ultimate winner.