Source quality
Triangulate sources before accepting the frame.
A claim can have several citations and still lean on one narrow source trail. Triangulation asks whether the record, the method, the people closest to the event, the counter-source, and the comparison evidence point to the same bounded conclusion.
Use this checklist when a media story, research report, dashboard, or campaign readout feels well sourced but the sources may be repeating one another, carrying different kinds of evidence, or hiding the missing comparison. The goal is not to demand perfect agreement. The goal is to know which parts of the claim are confirmed, which parts are interpreted, and which parts still need a better source.
The triangulation pass
| Check | Ask for | Why it matters | Output |
|---|---|---|---|
| Exact claim | The one sentence the reader is being asked to believe. | Sources cannot be compared until the claim is specific enough to test. | Factual, comparative, causal, predictive, or normative. |
| Closest record | The document, dataset, filing, transcript, method note, or raw report nearest to the fact. | A secondary summary may be accurate, but it should not become the evidence trail by itself. | Primary source visible, missing, or unavailable. |
| Independent corroboration | A second source that did not depend on the same quote, release, dashboard, or interested report. | Repeated summaries from the same origin are not independent confirmation. | Independent, same-source loop, or unclear origin. |
| Counter-source | The record owner, affected party, method expert, data owner, or analyst most likely to narrow the claim. | The absent source role is often the one that would reduce confidence. | Included, requested, summarized, or missing. |
| Denominator | The population, opportunity base, sample base, record universe, time window, or eligible inventory. | A true numerator can still produce a false frame when the base is hidden. | Named, estimated, implied, or absent. |
| Comparison class | The peer group, prior period, historical range, holdout, matched market, or expected baseline. | Frames usually become persuasive by making one comparison easy and another comparison hard. | Pre-specified, reasonable after-the-fact, weak, or missing. |
| Method disclosure | Sampling, weighting, model inputs, match rules, exclusions, uncertainty, or data-quality controls. | Method-bearing sources can support method-limited claims, not unlimited conclusions. | Inspectable, partial, asserted, or absent. |
| Language boundary | The strongest verb and scope that all visible evidence can support. | Triangulation should change the sentence, not only add caveats. | Shows, suggests, is consistent with, or does not establish. |
Source distance ladder
Triangulation works best when each source is sorted by distance from the claim. A far source can still be useful, but it should not carry the weight of a close one.
| Distance | Examples | Can support | Needs beside it |
|---|---|---|---|
| Closest record | Public record, filed document, transcript, data table, method note, campaign log, or report export. | What was recorded, counted, disclosed, or reported under stated rules. | Denominator, date, scope, and definition notes. |
| Direct observer | Participant, affected party, operator, buyer, analyst, or person with firsthand operational knowledge. | Observed sequence, practical detail, missing context, or implementation reality. | Representative scope, corroboration, and role clarity. |
| Method expert | Survey, public-record, economics, analytics, measurement, legal, or technical specialist. | Whether the method can answer the claim being made. | Connection to the specific source material. |
| Interested source | Sponsor, vendor, advocacy group, platform, campaign owner, or party with direct reputational stake. | Definitions, intent, access, product rules, or stakeholder position. | Independent denominator, counter-source, and method limits. |
| Secondary analyst | Commentary, newsletter, trade analysis, benchmark summary, or synthesis article. | Pattern recognition, explanation, and comparison ideas. | Links back to inspectable records and method notes. |
Source independence score
Use this score after the first source pass and before the claim is written. Do not give extra credit for citations that repeat the same original release, dashboard, quote, or method note. The score is meant to set the strongest honest verb, not to create a decorative confidence label.
| Field | 2 points | 1 point | 0 points |
|---|---|---|---|
| Origin trail | Each major source can be traced to a distinct record, method, observer, or role. | Some sources are independent, but one important cluster shares the same origin. | Most citations repeat one release, dashboard, quote, or secondary write-up. |
| Closest record | The primary record or source-nearest export is visible with date, scope, and definitions. | The record is summarized and plausible, but the reader cannot inspect the full source trail. | The closest record is absent or replaced by commentary. |
| Denominator | The population, eligible base, sample, opportunity set, or outcome universe is named. | The denominator can be inferred but is not directly stated beside the claim. | The claim relies on a numerator or percentage with no usable base. |
| Counter-source | A source role likely to narrow the claim is included or its unavailable status is documented. | The counter-source is represented only through a brief reaction or partial summary. | No source with a reason to challenge the frame appears in the record. |
| Method inspection | Sampling, matching, exclusions, timing, uncertainty, or data-quality controls are inspectable. | Method limits are described but not tied to the specific evidence being used. | The method is asserted without enough detail to bound the claim. |
| Conflict handling | Conflicts are resolved by source proximity, definitions, and comparison rules. | Conflicts are disclosed, but the final language still leans on the more vivid version. | The story chooses a convenient source and treats the conflict as settled. |
| Total | Reader-safe conclusion | Typical verb boundary |
|---|---|---|
| 10-12 | The evidence trail is broad enough to support a bounded statement if the denominator and comparison are named. | "Shows" for directly observed facts; "is consistent with" for interpreted effects. |
| 6-9 | The evidence is useful, but at least one source role, denominator, or method field limits the conclusion. | "Suggests," "points to," or "supports a limited read." |
| 0-5 | The claim is still source-thin. Treat the page, report, or readout as a lead for more reporting rather than as proof. | "Raises a question," "reports," or "does not establish." |
When sources agree
Agreement is stronger when sources reach the same bounded conclusion from different origins. It is weaker when several citations trace back to the same interested release, the same dataset without the denominator, or the same untested interpretation.
Independent originTwo sources are stronger when they observed the claim through different records, methods, or roles. A public record plus a directly relevant method expert is usually stronger than three summaries of one report.
Same-source loopIf several articles, quotes, dashboards, or posts repeat one original claim, treat them as one source until the original record and method are visible.
Aligned limitsReal agreement should include the same caveat. If one source shows a narrow record and another writes a broad conclusion, the agreement may be only on the fact, not on the frame.
Shared blind spotSources can agree because they share the same missing data: unmatched outcomes, excluded cases, nonrespondents, unmeasured inventory, or unavailable control groups.
When sources conflict
| Conflict | First question | Better next source | Careful wording |
|---|---|---|---|
| Different counts | Are they counting the same universe, dates, eligibility rules, and revisions? | Record owner, table note, docket, release history, or data dictionary. | "The count depends on the record universe and release date." |
| Different rates | Are the numerator and denominator paired correctly? | Official table, subgroup base, population estimate, or opportunity base. | "The rate changes under a different denominator." |
| Different survey results | Do population, sample source, wording, field dates, weighting, and subgroup bases match? | Full survey disclosure and questionnaire. | "The results are not directly comparable without method alignment." |
| Different causal stories | Which source shows timing, mechanism, alternate explanations, and counterfactual? | Timeline, pre-period trend, matched comparison, or holdout evidence. | "The timing is consistent with the claim but does not establish cause." |
| Different campaign results | Which report separates delivery, exposure quality, outcome quality, attribution, and incrementality? | Campaign readout fields, holdout logs, match rules, and uncertainty intervals. | "The report shows observed or credited activity under this method." |
Advertising measurement use
Campaign evidence often fails triangulation because each party can see a different part of the path. The publication, platform, advertiser, agency, and vendor may all be telling the truth while none can alone prove causal impact.
| Source | Can usually verify | Cannot verify alone | Pair with |
|---|---|---|---|
| Publisher | Eligible pages, placement IDs, package logic, creative delivery, and reader context. | Advertiser-side outcomes or incremental lift. | Advertiser outcome data, test design, and reporting fields. |
| Ad server or platform | Served impressions, clicks, viewability fields, frequency, and platform-visible conversions. | Unmatched outcomes, cross-channel exposure, and true counterfactual. | Outcome-quality review and attribution-window checks. |
| Measurement vendor | Match rules, model outputs, survey differences, attribution windows, or lift estimates. | Whether the measured universe represents the whole decision. | Method disclosure, uncertainty, leakage checks, and calibration evidence. |
| Advertiser or CRM owner | Lead status, sales stage, revenue, duplicate handling, and follow-up coverage. | Media exposure quality or audience selection before exposure. | Placement records, audience eligibility, and comparison rules. |
| Agency or analyst | Budget context, report structure, decision threshold, and next-action recommendation. | The claim without source records, method notes, and outcome definitions. | All source trails, with the final verb matched to the weakest necessary link. |
Downgrade rules
- Downgrade when every source traces to the same release, dashboard, stakeholder quote, or report without an inspectable primary record.
- Downgrade when the counter-source is present only as a sentence of reaction while the central claim gets documents, charts, and expert interpretation.
- Downgrade when the source closest to the number cannot show the denominator, sample base, inclusion rule, or revision date.
- Downgrade when a method source can explain a metric but cannot observe the outcome the headline claims.
- Downgrade when a conflict is resolved by choosing the more vivid story rather than the closer record or cleaner comparison.
Worked downgrade example
A public article says a sponsorship program produced a 42 percent lift in qualified demand. The visible citations look full at first: a sponsor deck, a platform dashboard, an agency quote, and a short analyst comment all point in the same direction.
The source score changes the sentence. The deck, dashboard, and quote all trace to one campaign report. The closest outcome record is an export summary rather than the advertiser's lead-stage file. The denominator excludes unqualified leads, but the exclusion rule is not shown. The analyst can explain attribution windows, but cannot verify whether the lead definition changed during the campaign.
| Evidence field | Observed state | Score effect | Allowed wording |
|---|---|---|---|
| Origin trail | Three citations repeat one campaign report rather than independent records. | Counts as one source cluster. | "The campaign report says..." |
| Denominator | The qualified-lead base is not shown beside the 42 percent figure. | Prevents a broad demand-quality claim. | "Among reported qualified leads..." |
| Counter-source | No CRM owner, sales reviewer, or disconfirming account list is included. | Keeps the conclusion below proof language. | "The evidence does not establish incremental qualified demand." |
| Method inspection | Attribution-window logic is described, but match rules and late-arriving outcomes are not inspectable. | Supports a method-limited observation only. | "The readout is consistent with higher credited demand under this method." |
The reader-safe version is narrower and more useful: the available readout reports higher credited qualified demand under its attribution method, but it does not by itself prove incremental demand, stable lead quality, or a reusable sponsorship effect.
Meeting prompts
- Which part of the claim is directly observed, and which part is interpreted?
- What is the closest record, and who can independently confirm its scope?
- Are multiple citations actually independent, or do they come from the same origin?
- Which missing source role would most likely narrow the claim?
- What denominator or comparison would make the claim less dramatic?
- What final verb fits the weakest necessary source in the chain?
Takeaway
Triangulation is not a demand for every source to say the same thing. It is a way to keep each source in its proper lane: records establish what was recorded, method notes define how numbers were produced, participants add practical context, experts test interpretation, and counter-sources show what the frame has survived.
Choose the next source check before accepting the frame.
Use these routes when multiple citations still need a quick quality score, a fuller source trail, better reference records, or a claim-review lane before the final verb is chosen.