Aweber – Split Testing Broadcasts


Naturally, some emails just get better responses than others. But what can you do to increase the open rates and effectiveness of your messages? Try creating a split test. What this does is allow you to test different subject lines and/or different body text to see which emails are getting the job done and which ones aren’t. Keep in mind that you should limit how many aspects of each message are varied to ensure you can tell why one message outperformed the other one. Ideally, there will be only one difference between the two messages.


Step 1: Login to Aweber website

The first thing you need to do is login to your Aweber account.


Step 2: Choose your list


To use this feature, your list must have at least 100 members. Less than that and the statistics wouldn’t be as meaningful so Aweber only allows you to split test if your list has 100 or more members.

Before setting up the Split Test, you need to ensure you are working with the correct list. Choose your list from the dropdown at the top left labeled Current List.




Step 3: Create your Broadcast message Split Test


Now that we know we’re working with the correct list and it has more than 100 members, the first thing to do is go to your “Broadcast” page by hovering over “Messages” and then clicking on “Broadcast”.



After clicking on “Broadcast”, you will see a list of all your Broadcast messages.


Click on the “Create A Split Test Broadcast” button at the top (above your lists).

Note: If you don’t see this button, make sure you have the proper list selected in the dropdown for Current List.



If you do not see this option, make sure you didn’t skip Step 2.


After clicking to create a split test, you will see the following screen. You need to enter a percentage in 2-4 boxes to tell Aweber how many messages you want created. If you enter 50 in the first box and 50 in the second box like the screenshot below, two broadcast messages will be created. If you enter 50, 10, 20 and 20, four messages will be created. Aweber will send the messages in groups of up to 4 to your list members.

I would start with 50/50 to keep it simple. After entering the percentages, click on “Create Split Test”.



Congratulations, your messages have been created!



Notice the Segment is different. One says Group 1 and the other says Group 2. That’s because we used 50/50 percentages.



Click the first Subject Name to edit that message and begin by entering the Subject for this Split Test Broadcast message.



If you use HTML email, enter and format the body of the message. Otherwise, scroll down to the “Plain Text Message” settings and enter the message.



Configure the broadcast message then click on “Save Message”.



Edit and save your other Broadcast message.


Upon saving the last one, you’ll see your “Pending Broadcasts”. Your messages will appear alphabetically based on Subject.



When you are ready for your message to be sent, click on the green Queue button. After both messages have been sent, wait an appropriate amount of time then come back here to evaluate your stats.


Michael Rockwell