Google Data

If you’re a regular blog reader, you know that we regularly emphasize the importance of testing changes to your ads to ensure they’re performing as well as they could be. The most effective way to do so is by running an A/B experiment to compare how one setting performs against a slight variation of that setting. To make it even easier for you to run A/B experiments, today we’re releasing a new AdSense experiments feature for your ad unit settings.

This new feature is available directly from your AdSense account and lets you quickly create, run and analyze A/B experiments for specific ad units -- all without needing to make any changes to your ad or page code. It works by comparing your original ad unit settings to a variation you choose, and ultimately tells you which one performs better. Here are just a few examples of the types of tests you can run:

• Compare the performance of text-only ads to ads that have both text and display enabled
• Determine how ads with a visible border perform compared to those that are ‘borderless’ (where the color of the border matches the background of the page)
• Analyze the effect of changing the color of ad text on ad performance 

Approximately 24 hours after you set up an experiment in your account, you’ll see a confidence score for the two ad units settings. This score indicates how likely the original or the variation is to be the better performing setting in the long term. Confidence scores may change as the experiment progresses, and we recommend waiting until one of the scores reaches at least 95% before choosing that setting as the winner. Once you chose the winning setting, the experiment ends and the setting is automatically applied to the specific ad unit. Please note that while an experiment is running, our system will automatically optimize the traffic split between the two ad unit settings. The better one setting performs, the more traffic it will receive, helping you maximize your revenue potential even during the experiment.