> ## Documentation Index
> Fetch the complete documentation index at: https://help.maestra.io/llms.txt
> Use this file to discover all available pages before exploring further.

# How to Set up Control Groups and A/B Tests for Campaigns

The guide can be used for all types of campaigns and channels. We’ll be using email campaigns to illustrate the steps you need to follow.

Before you begin, make sure you’re familiar with the guides on [bulk](/campaigns/email-campaigns/how-to-create-a-bulk-email-campaign) and [automated campaigns](/campaigns/email-campaigns/how-to-create-automated-email-campaign).

1. Go to the **Campaign** panel to enter a **Subject** and **Sender** and select a **Template**. After this, click "**Create A/B test**":

<img src="https://mintcdn.com/maestraio/8PKiDbR3rMJsCzSE/images/imported/00_ab_campaign.png?fit=max&auto=format&n=8PKiDbR3rMJsCzSE&q=85&s=a83b5f41767e1633f88edcba36ae4879" alt="00_ab_campaign" width="1798" height="990" data-path="images/imported/00_ab_campaign.png" />

Enter a **Subject** and **Sender** and select a **Template** for your second variant.

When it comes to A/B testing, you have lots of variables to choose from.

You can test the **Subject**:

<img src="https://mintcdn.com/maestraio/-w5Ud9QNiG7Y4nor/images/imported/01_ab_campaign.png?fit=max&auto=format&n=-w5Ud9QNiG7Y4nor&q=85&s=ad2036378e6576bb69b79fce088b92c6" alt="01_ab_campaign" width="1662" height="1304" data-path="images/imported/01_ab_campaign.png" />

Test the **Sender**:

<img src="https://mintcdn.com/maestraio/59KyfifOW7tLz5QR/images/imported/02_ab_campaign.png?fit=max&auto=format&n=59KyfifOW7tLz5QR&q=85&s=8544abd9eba39356e98017221c700cb6" alt="02_ab_campaign" width="1712" height="1286" data-path="images/imported/02_ab_campaign.png" />

Test the **Template**:

<img src="https://mintcdn.com/maestraio/59KyfifOW7tLz5QR/images/imported/03_ab_campaign.png?fit=max&auto=format&n=59KyfifOW7tLz5QR&q=85&s=3aff3ffa34a8c08a9c3bfe4b80131df5" alt="03_ab_campaign" width="1730" height="1450" data-path="images/imported/03_ab_campaign.png" />

Or you can combine Subject, Sender, and Template tests.

3. For a bulk campaign, select your Recipients.

4. Configure Test settings:

<img src="https://mintcdn.com/maestraio/nXS6QsINTx63g9ke/images/imported/04_ab_campaign.png?fit=max&auto=format&n=nXS6QsINTx63g9ke&q=85&s=752ee9b33fc00e383c83e0e6cc85df2b" alt="04_ab_campaign" width="1828" height="1286" data-path="images/imported/04_ab_campaign.png" />

## A/B test settings

There are 2 ways to run tests:

1. Campaign variations + a control group.
2. Campaign variations only.

To measure the effect and net profit of your campaign, select **Campaign** variations + control group. In this case, only the target action can be used as the assessment criterion.

The control group size is the same as the number of emails for this variation of your test.

When testing without a control group, the **Open rate** and **Click rate** options are also available as assessment criteria.

**Assessment criterion**. When it comes to choosing your assessment criterion, simply select what fits best depending on what you’re testing.

**For example**:

1. To test the **Subject** or **Sender**, select the **Open rate** as your criterion.
2. To test the **Template**, select the **Click rate** or **Target action** (e.g. order placement) as your criterion.

**Minimum expected uplift**: this is the minimum difference in percentage points for one variant to be considered more successful than another .

**Testing time**: this is the period during which the test will run and collect data. Once this time is out, the winning variant will be sent to the remaining audience.

A testing time is a parameter assigned individually to each customer. Thus, the total test duration time is a sum of the time to collect results from tested variations plus the testing time.

**How it works:** Subscribers from group A receive email variation A, subscribers from group B — variation B. Data is collected over the selected period. One the test period is over, the remaining subscribers will receive the successful variant.

### Bulk campaign without a control group: test settings

<img src="https://mintcdn.com/maestraio/5322-upQA3cGdluA/images/imported/06_ab_campaign.png?fit=max&auto=format&n=5322-upQA3cGdluA&q=85&s=afaa743cf32b84647da8992cd16b5751" alt="06_ab_campaign" width="1950" height="1336" data-path="images/imported/06_ab_campaign.png" />

### Bulk campaign with a control group: test settings

<img src="https://mintcdn.com/maestraio/nXS6QsINTx63g9ke/images/imported/05_ab_campaign.png?fit=max&auto=format&n=nXS6QsINTx63g9ke&q=85&s=118f13c94dd251004c89a8a4e4414d8b" alt="05_ab_campaign" width="1942" height="1442" data-path="images/imported/05_ab_campaign.png" />

For bulk campaigns, test settings are used to specify which percentage of recipients will take part in the test and which portion of the audience will receive the winning variation.

### Automated campaign without a control group: test settings

<img src="https://mintcdn.com/maestraio/hDwb_Ye73XB_-pfV/images/imported/09_ab_campaign.png?fit=max&auto=format&n=hDwb_Ye73XB_-pfV&q=85&s=eaef7870bfcc464ad03ab33165ae0046" alt="09_ab_campaign" width="1800" height="1070" data-path="images/imported/09_ab_campaign.png" />

### Automated campaign with a control group: test settings

1. Click "**Enable control group**":

<img src="https://mintcdn.com/maestraio/EeW0Po78IZGyB5gF/images/imported/12_ab_campaign.png?fit=max&auto=format&n=EeW0Po78IZGyB5gF&q=85&s=cf0e1d62183fa472e457b9759a52b1e9" alt="12_ab_campaign" width="1754" height="974" data-path="images/imported/12_ab_campaign.png" />

2. **Variant 1** will appear in **Message template area**:

<img src="https://mintcdn.com/maestraio/2_WUUqtXTQTrF_2i/images/imported/08_ab_campaign.png?fit=max&auto=format&n=2_WUUqtXTQTrF_2i&q=85&s=36519d7a7c02537d11dd429f388e66c2" alt="08_ab_campaign" width="1808" height="1024" data-path="images/imported/08_ab_campaign.png" />

3. Choose a **Target action** and other settings:

<img src="https://mintcdn.com/maestraio/hDwb_Ye73XB_-pfV/images/imported/10_ab_campaign.png?fit=max&auto=format&n=hDwb_Ye73XB_-pfV&q=85&s=e6c90547da5d32209433cb8a73765007" alt="10_ab_campaign" width="1796" height="1144" data-path="images/imported/10_ab_campaign.png" />

### You can also view additional parameters:

<img src="https://mintcdn.com/maestraio/hDwb_Ye73XB_-pfV/images/imported/11_ab_campaign.png?fit=max&auto=format&n=hDwb_Ye73XB_-pfV&q=85&s=4f26b5239a01415161f328864084ce7d" alt="11_ab_campaign" width="1790" height="1340" data-path="images/imported/11_ab_campaign.png" />

**Power** is the probability that we will be able to detect a difference (if there is any). The common practice is to use 80% as the default power of an A/B test.

The **confidence level** of the test is the confidence that we will not get a false positive result, with the default value in A/B tests being 95%.

## Test results

Once the test ends, the user(s) that created it receive a test report in their email inbox.
