Evidence standard

Claim confidence rubric for media and measurement

Published July 3, 2026. Updated July 7, 2026. Status: evergreen source page.

Most weak claims do not fail because every fact is false. They fail because the sentence asks for more confidence than the evidence can carry.

Use this rubric when a headline, research report, dashboard, vendor readout, brand study, or advertising result sounds persuasive. It gives teams a shared language for deciding whether a claim deserves strong confidence, modest confidence, or only a note for further checking.

Picture the common meeting: a report says a campaign "drove" growth, a chart shows a sharp before-and-after increase, or a story says a pattern is spreading. The room wants a yes-or-no answer. The better first question is simpler: what confidence level has the claim earned, and what would lower it?

Evidence review desk with a central claim card surrounded by source, audience, comparison, caution, and search cards. — A confidence review puts the claim in the middle, then checks the source trail, denominator, comparison, uncertainty, and decision use before choosing strong or careful wording.

The confidence ladder

Confidence is not a mood. It is a ladder from "this is only a lead" to "this is strong enough for a bounded decision." Moving up the ladder requires more than a persuasive chart; it requires a visible source, a fair base, a relevant comparison, and language that does not outrun the method.

Five-step confidence ladder where sparse evidence cards at the lower levels become complete source, trend, denominator, and checklist packets at the top. — The ladder helps teams separate weak leads from decision-grade evidence. A claim can be useful at level 2 or 3, but the sentence should not sound like level 5 unless the evidence packet is complete.

Level	Evidence pattern	Supportable language	Do not say yet
5. Decision-grade	The primary evidence is inspectable, the denominator is clear, the comparison is fair, and the uncertainty or sensitivity range is visible.	"The evidence supports this decision within these limits."	That the result will hold in every audience, market, time period, or method.
4. Strong but bounded	The evidence trail is visible and the comparison is plausible, but some assumptions, caveats, or generalization limits remain.	"This is a strong read for this setting."	That the claim is settled outside the observed setting.
3. Directional	The evidence points in a direction, but at least one major piece is incomplete: denominator, source independence, counterfactual, uncertainty, or subgroup base.	"This suggests a pattern worth testing or monitoring."	That the claim proves cause, size, prevalence, or budget impact.
2. Weak signal	The claim relies on anecdotes, partial records, interested-party summaries, descriptive dashboards, or comparisons that may not be like-for-like.	"This is a lead, not a conclusion."	That the frame should drive a decision without more evidence.
1. Unsupported frame	The source trail is missing, the denominator is hidden, the comparison is loaded, or causal language is stronger than the design.	"The public evidence does not support this framing."	The original strong claim, even with softer wording.

Two-minute triage

A quick triage pass is useful when the team cannot run a full audit before a call. The goal is to slow down the strongest sentence long enough to see whether the source, baseline, and limits are visible.

Five-step review workflow moving from a draft claim through source folder, baseline scale, hidden-limit warning, and next evidence tray. — The triage workflow turns a persuasive sentence into five concrete checks: rewrite it plainly, find the closest source, name the baseline, expose hidden limits, and ask for the next evidence that would change confidence.

1. Rewrite the claim

Turn the headline, slide title, or summary sentence into a plain testable sentence. Name the actor, population, metric, time window, and implied comparison.

2. Find the closest source

Prefer the original record, full table, method note, questionnaire, model document, experiment plan, or readout appendix. A summary can be useful, but it should not hide the source underneath it.

3. Name the missing baseline

Ask what would have happened anyway. For media claims, that may be a base rate, peer group, prior period, or complete record universe. For advertising claims, it may be a holdout, matched market, modeled counterfactual, or pre-period trend.

4. Downshift if limits are hidden

Move the confidence level down when the claim hides sample source, inclusion rules, field dates, uncertainty, outcome definitions, exclusions, or incentives that shape the result.

5. State the next evidence needed

A good review ends with the document, test, denominator, sensitivity check, or disconfirming fact that would most change confidence.

Media framing checks

Media confidence depends on whether the reader can inspect the source trail and compare the claim against a fair baseline. A story can be accurate at the sentence level and still overstate prevalence, novelty, motive, or certainty.

Claim type	Raise confidence when	Lower confidence when
Prevalence	The story shows counts, totals, time windows, and the population at risk.	It uses anecdotes or percent changes without starting levels.
Public-record finding	The record owner, inclusion rules, missing universe, and revision risk are visible.	A partial administrative record is treated as the full reality.
Source claim	Interested sources are identified and balanced against documents or independent context.	One side gets documents while another gets paraphrase or reaction labels.
Causal frame	Timing, documents, design, or direct evidence supports cause, motive, or impact.	Sequence, correlation, or quote volume is upgraded into proof.
Survey or poll frame	Population, sample source, wording, weighting, field dates, and uncertainty are available.	The headline treats a limited respondent group as a clean public verdict.

Advertising measurement checks

Measurement confidence depends on whether the method matches the decision. A report can describe observed performance accurately while still failing to show what the media changed.

Readout type	Raise confidence when	Lower confidence when
Lift test	Assignment, holdout protection, primary outcome, leakage checks, and uncertainty are stated before the result is read.	The exposed group could self-select or the holdout could be reached through another path.
MMM	Controls, priors, calibration, response curves, diagnostics, and uncertainty are visible.	Predictive fit is treated as proof that each channel estimate is causal.
Brand study	Exposed and control respondents are comparable, field dates are clear, and outcomes match the decision.	Survey recall or favorability movement is translated directly into sales impact.
Attribution report	The report is labeled as descriptive path evidence with clear identity, window, and channel limits.	Credit allocation is presented as incrementality.
Attention or viewability report	The metric is used as an exposure-quality diagnostic tied to a practical planning rule.	Attention is treated as proof of business impact by itself.

Worked downgrade example

Downgrading a claim is not the same as rejecting the work. The reviewer preserves what the evidence can support, then removes the part that needs a stronger design or a cleaner denominator.

Review board showing a red overstated chart claim narrowed through evidence-limit checks into a green bounded evidence packet. — A practical confidence review turns broad claims into bounded ones. The final sentence should keep the observed signal while making clear what the source, comparison, and design did not prove.

Draft claim	Confidence problem	Better sentence	Next evidence request
"The campaign drove a 38% revenue increase."	The report shows exposed-path revenue, but it does not show what would have happened without the campaign.	"Revenue from tracked exposed paths was 38% higher than the selected baseline, but the readout is descriptive until a holdout or matched comparison is available."	Holdout, matched-market, or matched-customer comparison with the same outcome window.
"This trend is spreading quickly."	The story shows vivid examples, but not the full record universe, starting level, or comparable time periods.	"The examples show a pattern worth checking; prevalence is not established without the full denominator and prior-period counts."	Complete record pull, inclusion rules, and counts by period and subgroup.
"The brand study proves the media changed opinion."	Respondent balance, exposure leakage, question wording, and uncertainty are not visible in the summary.	"The survey suggests movement in the measured sample, but causal confidence depends on respondent balance, leakage checks, wording, and uncertainty."	Method note with exposed/control construction, field dates, question wording, base sizes, and interval estimates.

Language that matches confidence

Evidence level	Better wording	Risky wording
Decision-grade	"The test supports increasing spend within this audience and window."	"The channel is proven to work everywhere."
Strong but bounded	"The records support the claim for the reported period."	"This proves the broader trend."
Directional	"The pattern is consistent with lift, but the counterfactual is not fully established."	"The campaign drove the result."
Weak signal	"This should trigger a source request or test plan."	"The finding confirms the frame."
Unsupported frame	"The available evidence is not enough for the claim."	"The claim is true with caveats."

Use it with the rest of the library

For media claims, pair this rubric with the media claim audit worksheet, headline and source-mix framing checklist, public records and denominator checklist, and survey and poll claim checklist.

For measurement claims, pair it with the measurement method selector, incrementality test plan template, brand lift readout checklist, MMM causal validity checklist, and private marketplace measurement checklist.

Takeaway

The right goal is not permanent doubt. The right goal is calibrated confidence: strong language for strong evidence, careful language for directional evidence, and no settled frame when the source trail is too thin.

Keep reading

Choose the next guide

Move from the confidence level into the worksheet, wording matrix, or audit path that fits the claim.

Review recordCapture the evidence trailRecord the source, denominator, comparison, caveats, confidence level, and next request. Claim wordingMatch language to confidenceRewrite strong verbs, broad scope, and causal phrasing so they fit the evidence level. Public frameRun the full claim auditCheck source trails, denominators, comparison classes, missing context, and causal language.