Evidence standard

Claim confidence rubric for media and measurement

Published May 30, 2026. Status: evergreen source page.

Most weak claims do not fail because every fact is false. They fail because the sentence asks for more confidence than the evidence can carry.

Use this rubric when a headline, research report, dashboard, vendor readout, brand study, or advertising result sounds persuasive. It gives teams a shared language for deciding whether a claim deserves strong confidence, modest confidence, or only a note for further checking.

The confidence ladder

Level	Evidence pattern	Supportable language	Do not say yet
5. Decision-grade	The primary evidence is inspectable, the denominator is clear, the comparison is fair, and the uncertainty or sensitivity range is visible.	"The evidence supports this decision within these limits."	That the result will hold in every audience, market, time period, or method.
4. Strong but bounded	The evidence trail is visible and the comparison is plausible, but some assumptions, caveats, or generalization limits remain.	"This is a strong read for this setting."	That the claim is settled outside the observed setting.
3. Directional	The evidence points in a direction, but at least one major piece is incomplete: denominator, source independence, counterfactual, uncertainty, or subgroup base.	"This suggests a pattern worth testing or monitoring."	That the claim proves cause, size, prevalence, or budget impact.
2. Weak signal	The claim relies on anecdotes, partial records, interested-party summaries, descriptive dashboards, or comparisons that may not be like-for-like.	"This is a lead, not a conclusion."	That the frame should drive a decision without more evidence.
1. Unsupported frame	The source trail is missing, the denominator is hidden, the comparison is loaded, or causal language is stronger than the design.	"The public evidence does not support this framing."	The original strong claim, even with softer wording.

Two-minute triage

1. Rewrite the claim

Turn the headline, slide title, or summary sentence into a plain testable sentence. Name the actor, population, metric, time window, and implied comparison.

2. Find the closest source

Prefer the original record, full table, method note, questionnaire, model document, experiment plan, or readout appendix. A summary can be useful, but it should not hide the source underneath it.

3. Name the missing baseline

Ask what would have happened anyway. For media claims, that may be a base rate, peer group, prior period, or complete record universe. For advertising claims, it may be a holdout, matched market, modeled counterfactual, or pre-period trend.

4. Downshift if limits are hidden

Move the confidence level down when the claim hides sample source, inclusion rules, field dates, uncertainty, outcome definitions, exclusions, or incentives that shape the result.

5. State the next evidence needed

A good review ends with the document, test, denominator, sensitivity check, or disconfirming fact that would most change confidence.

Media framing checks

Media confidence depends on whether the reader can inspect the source trail and compare the claim against a fair baseline. A story can be accurate at the sentence level and still overstate prevalence, novelty, motive, or certainty.

Claim type	Raise confidence when	Lower confidence when
Prevalence	The story shows counts, totals, time windows, and the population at risk.	It uses anecdotes or percent changes without starting levels.
Public-record finding	The record owner, inclusion rules, missing universe, and revision risk are visible.	A partial administrative record is treated as the full reality.
Source claim	Interested sources are identified and balanced against documents or independent context.	One side gets documents while another gets paraphrase or reaction labels.
Causal frame	Timing, documents, design, or direct evidence supports cause, motive, or impact.	Sequence, correlation, or quote volume is upgraded into proof.
Survey or poll frame	Population, sample source, wording, weighting, field dates, and uncertainty are available.	The headline treats a limited respondent group as a clean public verdict.

Advertising measurement checks

Measurement confidence depends on whether the method matches the decision. A report can describe observed performance accurately while still failing to show what the media changed.

Readout type	Raise confidence when	Lower confidence when
Lift test	Assignment, holdout protection, primary outcome, leakage checks, and uncertainty are stated before the result is read.	The exposed group could self-select or the holdout could be reached through another path.
MMM	Controls, priors, calibration, response curves, diagnostics, and uncertainty are visible.	Predictive fit is treated as proof that each channel estimate is causal.
Brand study	Exposed and control respondents are comparable, field dates are clear, and outcomes match the decision.	Survey recall or favorability movement is translated directly into sales impact.
Attribution report	The report is labeled as descriptive path evidence with clear identity, window, and channel limits.	Credit allocation is presented as incrementality.
Attention or viewability report	The metric is used as an exposure-quality diagnostic tied to a practical planning rule.	Attention is treated as proof of business impact by itself.

Language that matches confidence

Evidence level	Better wording	Risky wording
Decision-grade	"The test supports increasing spend within this audience and window."	"The channel is proven to work everywhere."
Strong but bounded	"The records support the claim for the reported period."	"This proves the broader trend."
Directional	"The pattern is consistent with lift, but the counterfactual is not fully established."	"The campaign drove the result."
Weak signal	"This should trigger a source request or test plan."	"The finding confirms the frame."
Unsupported frame	"The available evidence is not enough for the claim."	"The claim is true with caveats."

Use it with the rest of the library

For media claims, pair this rubric with the media claim audit worksheet, headline and source-mix framing checklist, public records and denominator checklist, and survey and poll claim checklist.

For measurement claims, pair it with the measurement method selector, incrementality test plan template, brand lift readout checklist, MMM causal validity checklist, and private marketplace measurement checklist.

Takeaway

The right goal is not permanent doubt. The right goal is calibrated confidence: strong language for strong evidence, careful language for directional evidence, and no settled frame when the source trail is too thin.