Measurement uncertainty

Uncertainty interval readout checklist

Published June 1, 2026. Updated June 1, 2026. Status: evergreen source page.

A point estimate is rarely the whole result. Poll margins, brand lift intervals, MMM ranges, and campaign lift readouts all need the same discipline: read the range of plausible values before deciding what the evidence can support.

Use this checklist when a report sounds precise but the decision depends on uncertainty: whether to scale spend, renew a package, call a brand study positive, compare two creatives, trust a poll movement, or translate a model result into budget language.

Start with the interval question

Do not ask only whether the estimate is positive. Ask what range of results remains plausible under the method, data, assumptions, and sample size.

Readout element	Question to ask	Weak shortcut
Point estimate	What is the reported lift, difference, contribution, or share?	Reading the single number as the result.
Interval width	How wide is the confidence interval, credible interval, margin, or modeled range?	Calling a noisy estimate meaningful because it points in the desired direction.
Decision threshold	Does the whole plausible range clear the business, editorial, or measurement hurdle?	Treating a result as useful because it barely clears zero.
Outcome meaning	Is the interval attached to the outcome that matters, or only to a proxy?	Letting precise recall, attention, or click estimates stand in for sales or belief change.
Comparison unit	Are intervals shown for the actual unit being compared: users, markets, stores, placements, creatives, or weeks?	Ranking slices that have different sample sizes and no comparable uncertainty.

Read the range before the headline

Positive point estimate, interval crosses zero

The estimate is compatible with benefit, no effect, and possibly harm. The careful sentence is directional or inconclusive, not a firm win.

Narrow interval, wrong outcome

A precise proxy can still answer the wrong question. A tight recall interval does not prove sales lift; a tight click-through interval does not prove incremental demand.

Wide interval, large upside

A large point estimate with a wide range may justify learning or a better-powered test, but it should not become a confident forecast.

Interval clears the decision hurdle

If the whole credible range is above the prewritten threshold and the design fits the question, stronger action language becomes more defensible.

No interval shown

The reader should treat the estimate as incomplete. Ask for sample size, model uncertainty, design effect, variance method, or a clear reason the interval is unavailable.

Common readout traps

Claim	What the interval may reveal	Cleaner wording
"The campaign lifted conversions by 8%."	If the interval runs from -2% to 19%, the data does not rule out no lift.	The estimate was positive, but the range is too wide for a confident lift claim.
"Awareness rose three points."	If the survey margin is larger than the movement, the change may be sampling noise.	The measured awareness difference is small relative to survey uncertainty.
"Channel A beat Channel B."	Overlapping intervals or different sample sizes may make the rank fragile.	Channel A had the higher estimate, but the comparison is not stable enough to rank with confidence.
"The model says this channel drove $1.2 million."	A modeled range may span several planning outcomes.	The model supports a broad contribution range, not a single planning value.
"The test was not significant, so it failed."	An underpowered test may be unable to distinguish a useful effect from no effect.	The test was inconclusive at this sample size and outcome window.

Minimum disclosure checklist

State the point estimate and the interval together.
Name the interval type: confidence interval, credible interval, margin of error, model range, bootstrap interval, or another method.
Show the sample size, eligible population, assignment unit, and outcome window behind the estimate.
State the prewritten decision threshold, such as minimum lift, margin hurdle, material percentage-point change, or renewal criterion.
Separate planned comparisons from exploratory slices.
Show whether adjustments, weighting, clustering, model priors, or multiple-comparison rules changed the interval.
Explain which decision the interval can support and which stronger claim remains unsupported.

Decision language

Evidence pattern	Supportable decision language	Do not say
Interval includes material loss, no effect, and material gain.	The result is inconclusive; improve design, sample size, outcome quality, or test duration.	The campaign worked because the point estimate was positive.
Interval is positive but below the commercial hurdle.	The measured effect may exist, but it may not clear the decision threshold.	The test proves the budget should scale.
Interval clears the hurdle and the design matches the decision.	The result supports the stated action within the tested population, period, and outcome definition.	The result will generalize to all future campaigns.
Intervals are missing for key slices.	The slice ranking is descriptive and should be treated as a hypothesis.	The top slice is the winner.
Interval is precise for a proxy outcome only.	The proxy result is clearer, but business impact still needs matching evidence.	The proxy proves sales, margin, or belief change.

When the interval is missing

Some useful reports arrive without full uncertainty math. That does not make them useless, but it does change the claim boundary. Ask for the denominator, sample, assignment unit, outcome maturity, and a reason the report cannot show uncertainty. Until those fields are visible, use descriptive language.

Ask for denominator

How many people, accounts, markets, impressions, stores, survey responses, or conversions support the estimate?

Ask for maturity

Which cohorts have completed the outcome window, and which are still waiting for delayed conversions or survey collection?

Ask for threshold

What change would be large enough to alter spend, creative, sourcing, wording, or renewal decisions?

Takeaway

An uncertainty interval is not a technical footnote. It is the boundary around the claim. If the interval is wide, missing, tied to the wrong outcome, or below the decision hurdle, the conclusion needs quieter language.