Regular readers of my blog will know that I am passionate about measurement as a critical component of managing and maximizing your marketing efforts. A solid measurement strategy ensures that you KNOW what works - rather than guessing. And a solid measurement strategy will generally incorporate the principles of testing and control.
Testing is a process whereby we create an objective for our campaign or initiative and then measure whether the objective is being reached based on the initiative's success against a control group. Testing enables us to confidently answer questions such as:
- Is our initiative or program working? Is it worth the investment we are making in it?
- Could it be working better than it is? Or could a different approach be more effective?
- What specifically is driving its success or failure?
How do you answer these questions? By implementing a continuous process of defining a question, creating a test, measuring the results, learning from the results, and then refining your initiative (including a new test).

Let's look at a simple example:
A translation company is considering mailing a follow-up package to prospects who contact their firm for a quote. The goal of the package is to convert prospects into customers. The package will be somewhat costly and time-consuming to create and mail, and the firm wants to be sure their investment will pay off.
Question: Is our initiative or program working?
Test: A random sample of prospects are excluded from the next mailing. The conversion rate of this group will be compared to the conversion rate of the contacted group.
Measurement: The conversion rate of the contacted group is higher than that of the excluded group.
Learning: The return of the marketing investment is sufficient to justify its continuation.
Refined Initiative: The welcome package is mailed to all prospects.
Having completed this test, the translation firm should also refine their test variables with each mailing, so that they can continuously improve their initiative. Examples of tests to consider could include:
- A lower cost package versus the current high-cost one
- An e-mail versus a mailed package
- The timing of the mailing (sooner vs. later)
- One customer segment's response versus another's
Each test will either reveal a more effective (in terms of cost, effort, etc.) way of executing initiative, or will serve to objectively prove the current initiative's effectiveness.