Source quality

Source role and incentive map for media claims

Published May 31, 2026. Status: evergreen source page.

A source can be honest, useful, and still too interested, too far from the record, or too narrow for the claim it is being asked to support. The reader's job is to identify what role each source is playing before accepting the story's frame.

This map works for news stories, research reports, dashboards, vendor claims, and advertising measurement readouts. It does not label sources as good or bad. It separates access, expertise, incentive, and evidence so a reader can keep confidence proportional to the source trail.

The source role map

Start by assigning each quoted or cited source a role. The role tells you what the source can help establish and what extra checks the claim still needs.

Source role	Useful for	Ask before trusting	Weak use
Primary record owner	Showing what was filed, counted, published, logged, or formally decided.	Does the story show the record scope, date, definition, and denominator?	Using the record's existence as proof of the broadest interpretation.
Direct participant	Confirming firsthand experience, sequence, statements, and incentives.	Which parts are observed facts, memory, interpretation, or advocacy?	Treating one participant's account as the full population or final cause.
Affected party	Explaining lived impact, operational details, and missing practical context.	Is the experience representative, illustrative, or an outlier?	Letting the strongest anecdote stand in for the denominator.
Independent subject expert	Explaining mechanism, method, precedent, and uncertainty.	Is the expertise directly related to the claim, and is the evidence basis visible?	Using authority to replace the primary record or measurement method.
Research producer	Explaining sample, model, survey, or analysis choices.	Who funded the work, who owns the data, and what limitations are disclosed?	Treating a method-bearing report as broader proof than the method supports.
Sponsor or vendor	Clarifying product design, business logic, study objective, or reported metric definition.	Does the article separate sponsor interest from method evidence?	Letting the party with the strongest stake supply both claim and conclusion.
Trade group or advocacy organization	Finding stakeholder positions, policy arguments, member data, and issue framing.	Whose interests are represented, and what counter-source should be visible?	Presenting an organized position as neutral consensus.
Platform or data owner	Defining eligible inventory, users, impressions, outcomes, match rules, and reporting limits.	What cannot be independently observed, audited, or compared?	Converting platform-visible activity into causal impact language.
Anonymous or background source	Providing narrow factual leads, process context, or documents that can be checked another way.	Why is anonymity needed, and does the article corroborate the claim?	Letting unnamed interpretation carry motive, scale, or causal judgment.
Secondary analyst or commentator	Orienting readers, identifying patterns, and comparing public material.	Does the analysis link back to inspectable records and method notes?	Replacing the original record with a confident summary.

The incentive pass

Incentive is not a dismissal. It is context a reader needs before deciding whether a source is carrying facts, interpretation, or a desired outcome.

Financial incentive

The source benefits if a product, category, service, investment, or campaign is viewed favorably. Look for independent denominators, method notes, and outcome definitions.

Reputational incentive

The source benefits if a prior decision, forecast, investigation, strategy, or public position appears correct. Look for disconfirming context and error boundaries.

Political or advocacy incentive

The source benefits if readers accept a policy frame, moral frame, or urgency frame. Look for definitions, base rates, omitted groups, and response parity.

Access incentive

The source has documents, logs, data, or insider context other sources lack. Look for corroboration, narrow wording, and whether access is being upgraded into conclusion.

Method incentive

The source built the metric, model, survey, or dashboard being discussed. Look for validation, uncertainty, comparison rules, and where the method cannot observe the counterfactual.

What each role can support

Claim type	Strong source mix	Missing-context risk
Something happened	Primary record plus direct participant or official statement.	The event is real, but scale, representativeness, or cause is still unsupported.
A pattern is increasing	Time series, denominator, method note, and comparison period chosen before interpretation.	A convenient start date makes ordinary variation feel exceptional.
A group believes something	Survey disclosure with sample source, wording, field dates, weighting, and uncertainty.	A stakeholder quote or small sample is treated as public consensus.
A product or campaign worked	Decision-relevant outcome, comparison rule, exposure quality, holdout or model diagnostics, and uncertainty.	Selection, prior intent, attribution, or matched activity is promoted into lift.
A policy or business decision caused a result	Timeline, mechanism, counterfactual, denominator, and alternative explanations.	Timing is treated as causality because the source role fits the desired frame.
A report proves a category trend	Report method, data universe, sponsor role, base period, exclusions, and external benchmark.	Vendor or sponsor evidence is broadened beyond its own measured universe.

Quote-balance checks

Balance is not just counting quotes. A story can quote several people and still give one role more evidentiary weight than the record supports.

Check whether the central claim is supported by records while the response is only summarized, or the reverse.
Separate fact witnesses from interpretation sources before comparing quote length.
Look for verb differences: "said," "claimed," "admitted," "warned," and "conceded" can tilt the reader before evidence appears.
Notice whether caveats appear near the claim or only after the strongest frame is already established.
Ask whether the omitted source role is obvious: data owner, affected party, method expert, regulator, sponsor, vendor, or counterfactual comparison.

Advertising measurement readouts

The same role map applies when a campaign result is being used as evidence. A platform, vendor, agency, brand, publisher, and analyst can each be useful while still seeing only part of the evidence trail.

Measurement source	Can usually show	Still needs
Publisher or inventory owner	Placement IDs, context, creative delivery, eligible impressions, ad sizes, and page-level package logic.	Advertiser-side outcomes, comparison design, and independent lift evidence.
Ad server or platform	Served impressions, clicks, viewability fields, frequency, segments, and platform-visible conversions.	Outcome quality, unmatched users, cross-channel exposure, and incrementality.
Measurement vendor	Method note, match rule, model output, survey result, or attribution window.	Validation, uncertainty, leakage checks, and decision limits.
Advertiser or CRM owner	Lead status, sales stage, revenue fields, follow-up coverage, and duplicate handling.	Media exposure quality, audience selection, and counterfactual comparison.
Agency or analyst	Campaign interpretation, budget context, reporting structure, and next-action recommendation.	Clear separation between observed results, attributed activity, and causal claims.

Fast workflow

1. Name the claim.

Write the article, report, or readout claim as one sentence. Identify whether it is factual, comparative, causal, predictive, or normative.

2. List every source role.

For each quote, link, chart, report, dataset, and dashboard, assign one role from the map. Do not let the same source quietly play every role.

3. Mark the strongest incentive.

Financial, reputational, advocacy, access, and method incentives should be visible beside the claim they help support.

4. Find the missing role.

Ask which source role would most likely weaken, narrow, or clarify the frame. If that role is absent, confidence should drop.

5. Calibrate the language.

Use "shows," "suggests," "is consistent with," or "does not establish" according to the source trail, not according to how persuasive the narrative feels.

Use with

Pair this map with the source quality scorecard when evidence strength is unclear, the quote weight and response standard checklist when balance is the issue, the sponsored research and vendor report checklist when a report has an interested sponsor, and the campaign readout QA checklist when a measurement source is being asked to support a budget decision.