Retail media

Retail media measurement needs a buyer-would-have-bought-anyway check.

Published May 29, 2026. Status: evergreen source page.

Retail media can connect ad exposure to store, app, and ecommerce purchases in a way many channels cannot. That makes it valuable. It also makes overclaiming easy when attributed sales are treated as incremental sales.

The practical question is not whether a retailer, marketplace, delivery platform, or commerce partner can observe purchases after exposure. The question is whether the campaign changed what shoppers bought, when they bought it, or where they bought it compared with a credible baseline.

The first distinction

Metric or claim	What it can show	What it cannot prove alone
Closed-loop attributed sales	Purchases matched to exposed or clicked shoppers inside the retailer's reporting window.	That the ad caused those purchases or that the same shoppers would not have bought anyway.
iROAS	Estimated incremental revenue divided by spend, if the incrementality method is disclosed and credible.	That the estimate is stable across products, seasons, audiences, bids, or offsite inventory.
New-to-brand sales	Purchases from shoppers not seen buying the brand in a defined lookback period.	That the shopper is truly new to the brand outside the retailer's observable environment.
Basket or category lift	Whether purchase value, units, or category behavior moved during the campaign window.	That the movement came from the media rather than price, promo, distribution, or seasonality.
Clean-room match	Whether advertiser and retailer data can be compared under controlled access rules.	That matching solved selection bias, missing identifiers, or a weak counterfactual.

The buyer-would-have-bought-anyway check

Retail media often targets shoppers with strong commercial signals: recent category visits, cart behavior, loyalty history, search intent, coupon use, or prior purchases. Those signals help campaigns perform. They also make naive exposed-versus-unexposed comparisons fragile.

Pre-period intent

Ask how treatment and control shoppers behaved before the campaign. Prior category purchases, search queries, product-page visits, cart additions, store visits, and loyalty status should not be wildly different unless the analysis accounts for them.

Offer and price overlap

Separate media from merchandising. A promotion, endcap, coupon, price drop, shipping change, or inventory improvement can produce sales that an ad report later captures as campaign value.

Audience eligibility

Name who could enter the campaign and who was excluded. If high-value buyers, lapsed buyers, loyalty members, or recent browsers are handled differently, the readout should say so.

Outcome window

Check whether the window matches the purchase cycle. A short window can miss delayed sales; a long window can absorb normal replenishment that would have happened anyway.

Minimum vendor disclosure

Ask for	Useful answer	Weak answer
Incrementality design	Randomized holdout, geo test, store test, switchback, or pre-stated matched design with clear assignment rules.	"We compare exposed shoppers to shoppers who were not exposed" without showing why they are comparable.
Unit of assignment	User, household, loyalty account, store, market, product group, or time period, with leakage controls named.	Assignment is described only as audience targeting or reporting segmentation.
Primary outcome	One outcome tied to the decision: incremental sales, margin, units, repeat purchase, category growth, or new buyer acquisition.	A readout switches between sales, clicks, add-to-cart, reach, and ROAS until one looks strongest.
Baseline behavior	Pre-period category buying, brand buying, store activity, and search or browse intent are balanced or adjusted.	The report starts at campaign launch and hides pre-campaign differences.
Uncertainty and exclusions	Intervals, sample sizes, match rates, outlier rules, and suppressed cells are visible enough for a decision.	A single point estimate is shown without power, variance, or population caveats.

When each test design fits

Design	Best retail media use	Main risk to inspect
User or household holdout	Onsite, app, email, loyalty, or addressable offsite media where eligible shoppers can be withheld cleanly.	Suppressed shoppers still receive the message through another campaign, device, household, or seller route.
Geo or store test	Market-level launches, local store pushes, regional offsite media, or shopper marketing that cannot be held out by person.	Treatment and control markets differ in pre-period trends, distribution, pricing, or competitive pressure.
Switchback	Alternating bidding, merchandising, or media conditions across pre-set time windows.	Carryover from one period affects the next period, especially for replenishment or delayed purchase categories.
Matched audience analysis	Directional readouts when randomization is unavailable and the stakes are modest.	The match is tuned after results are visible, or it matches demographics while ignoring purchase intent.
MMM calibration	Budget planning across retail media, trade, search, social, CTV, and promotions over longer horizons.	Retail media spend is correlated with promos, distribution, seasonality, or brand demand in ways the model cannot separate.

Readout language that stays inside the evidence

Overstated claim	Cleaner claim
"Retail media delivered $4.20 ROAS."	"The campaign attributed $4.20 in sales per ad dollar during the reporting window; incrementality depends on the holdout or comparison described below."
"The network proved incremental lift."	"The reported lift is credible if assignment, leakage, baseline balance, outcome capture, and uncertainty pass inspection."
"New-to-brand sales show acquisition."	"New-to-brand is defined inside this retailer and lookback window; broader brand acquisition needs additional evidence."
"Offsite media drove store sales."	"Matched store sales rose among the measured group; causal confidence depends on the comparison group and other retail changes during the window."

A simple score before scaling

Green: assignment is controlled, leakage is checked, pre-period behavior is balanced, uncertainty is visible, and the result clears a pre-set business threshold.
Yellow: the result is useful directionally, but selection, leakage, promotion overlap, sample size, or match coverage limits the decision.
Red: attributed sales, ROAS, or new-to-brand reporting is presented as causal proof without a credible counterfactual.

Takeaway

Retail media measurement is strongest when purchase visibility is paired with comparison discipline. Closed-loop reporting tells you what happened after exposure. Incrementality work asks the harder question: what changed because the exposure happened?