Did the AI Campaign Generate Additional Sales?

Distinguish attribution from incremental sales and compare the extra margin with all campaign costs.

Campaign planners place colored counters on regions of a map.
A comparison group helps distinguish people reached from purchases added.

A marketing AI model can choose an audience, a message or a send time based on prior behavior. If it picks customers who were already likely to order, the campaign report can look excellent even when the intervention made little difference. A decision about the next campaign needs a credible estimate of that difference.

Define who was eligible before the campaign began

A woman is intently focused on her computer screen in an office setting.
Comparing people who clicked with people who ignored an ad selects on a later event.

A system trained on campaign responders may learn that recent purchasers open email quickly. A useful test compares orders from equally eligible recent purchasers assigned either the email or a holdout. Fix the eligible population and assignment rule before delivery. Keep comparable treatment and holdout groups over the same dates, and count outcomes for everyone assigned, including people who never open the message. Otherwise purchasers who would have returned anyway can be mistaken for a campaign effect. Gordon and colleagues’ Facebook advertising experiments

Decide how a mid-campaign change will be evaluated

A person is sitting at a table with two tablets displaying graphs and charts, holding a stylus pen.
A budget shift changes both who sees an offer and which version receives credit.

Record creative, offer, spend and delivery by version. When possible, reserve a stable comparison while a learning system reallocates other traffic. An attractive dashboard segment found after examining many segments deserves a fresh test. In paid search, eBay's experiments illustrate how customers who already navigate to a retailer can complicate attributed returns. The eBay paid-search field experiments

Use contribution and include costs borne by the seller

A laptop computer and potted plant sit on a wooden table in a dimly lit room.
An incremental order may carry a discount, fulfillment cost or later return.

Estimate additional orders over the stated window, multiply by contribution per order after variable costs, and subtract campaign-specific costs once. Include unsubscribes and returns if they matter to the decision. Report uncertainty and the follow-up period. A positive early result says little about whether later full-price orders were simply pulled forward.

Try it with the evidence

Read a campaign's profit claim

Source notes. Fictional randomized test. Treatment and control each contain 2,000 customers. Treatment produces 130 orders and control 110. Contribution after discounts and variable fulfillment is $18 per order. The campaign itself costs $500. One order per customer at most.

Prompt. Compute absolute conversion lift and observed incremental contribution after campaign cost. Explain why crediting all 130 orders is misleading.

Check your reading

Conversion is 6.5% versus 5.5%, a one-percentage-point difference. The observed 20 additional orders contribute $360. After $500 in campaign cost the estimate is a $140 loss. The control indicates substantial purchasing without the campaign.

Illustrated field notes

Audience and creative choices

Find the audience definition and the evidence supporting the selected message.

A woman's profile is overlaid with a futuristic design.
Confirm that a tailored message still makes a supportable offer.
A computer monitor displaying a world map with graphs and charts, surrounded by a dark room.
Delivery records reveal which eligible people had a chance to respond.
A person is seated at a desk, engaged with a computer program or application displayed on the screen.
A response forecast cannot identify incremental orders by itself.
A computer workstation in an office or residential setting with a large monitor displaying a complex software interface.
Distribution and promotion can drive apparent content popularity.
A cartoon man sits at a desk, intently focused on his laptop screen, surrounded by various objects and graphs.
Search position and unpaid traffic can change during a campaign.
Campaign delivery and follow-up

Compare outcomes for all assigned customers across the same time window.

A smartphone with multiple chatbot interfaces on its screen.
A helpful conversation should end in a verifiable service outcome.
A man sits at a desk in front of two computer monitors, intently focused on his work.
Voice searches need the same offer, terms and measurement definitions.