Survey evidence

Survey and poll claim checklist

Published May 30, 2026. Status: evergreen source page.

A survey can be useful evidence, but the headline often strips away the method. Before trusting a poll, brand study, customer survey, or reader research claim, check who was asked, how they were reached, what wording they saw, when they answered, and how much uncertainty remains.

This page is for media readers, editors, analysts, and marketers who need to keep survey evidence inside its limits. It does not assume that every poll is weak. It asks whether the disclosure is strong enough for the claim being made.

One-page source check

Question	Strong disclosure shows	Weakens confidence
Who sponsored and conducted it?	The sponsor, field organization, funding source, and any material interest are visible near the result.	The story says "a new poll finds" without naming who paid for or ran the work.
Who could be included?	The target population, geography, language, eligibility rules, and sample frame are clear.	A member panel, customer list, newsletter audience, or opt-in sample is framed as the general public.
How were people reached?	The mode and recruitment path are named: phone, address-based sample, probability panel, online panel, intercept, customer list, or mixed mode.	The source gives only the number of respondents and hides how they entered the survey.
When was it fielded?	Field dates are shown and interpreted alongside major events, campaign bursts, price changes, news cycles, or product changes.	The headline treats the result as current even though the field window is old or event-sensitive.
What exactly was asked?	Exact question wording, answer choices, order, screening rules, and topline results are available.	A paraphrase, chart title, or press summary replaces the actual question.
How was it weighted?	Weighting variables, subgroup bases, design effect or equivalent precision limits, and unweighted counts are disclosed when relevant.	Small subgroup differences are promoted without showing subgroup size or weighting sensitivity.
How uncertain is it?	Sample size, margin or interval, subgroup uncertainty, and non-sampling caveats are stated close to the claim.	A one- or two-point difference is written as a real lead, trend, or shift without uncertainty context.
What is the comparison?	The story compares the result with prior waves using the same method and wording, or clearly labels a looser comparison.	The article compares unlike polls, different modes, changed wording, or different populations as if they were identical.

Read results in order

1. Start with population

"Adults," "registered voters," "likely buyers," "customers," "readers," and "respondents who saw an ad" are different populations. A result can be valid for one group and misleading when promoted to another.

2. Read the exact wording

Small wording changes can alter answers, especially when the topic is unfamiliar, emotional, technical, or tied to social approval. Do not rely on the chart label when the question text is available.

3. Check timing before trend language

A poll fielded after a major event may measure immediate salience more than durable opinion. A brand survey fielded during a promotion may measure campaign context and offer context together.

4. Treat subgroup claims as fragile until bases are visible

Subgroups often carry the most interesting headline and the weakest precision. Ask for unweighted base sizes, intervals, and whether the subgroup was planned before results were inspected.

5. Separate survey movement from causal impact

A survey can show what respondents reported in a window. It does not prove what caused the answer unless the design preserves a credible comparison.

Poll-to-headline translation

If the report says	Careful wording	Overclaim to avoid
A candidate leads 48% to 46% with a three-point margin.	The race is close in this poll; the measured difference is not enough for a confident lead claim.	The candidate is ahead.
Support rose from 31% to 36% using the same method and question.	The poll shows a possible five-point increase; check uncertainty and field dates before calling it a durable shift.	Opinion surged.
Customers who answered a survey report high satisfaction.	Responding customers report high satisfaction; nonresponse and customer-list coverage remain important limits.	Customers are satisfied.
A small subgroup differs sharply from the full sample.	The subgroup result is directional until the base size, interval, and preplanned comparison are visible.	The subgroup has a clear separate view.
Exposed respondents remember the ad more often.	The study shows higher reported recall among the measured exposed group in this window.	The campaign changed the market.

Brand and reader research crossover

Brand lift studies, reader surveys, customer panels, and public opinion polls share the same disclosure problem: a persuasive summary can hide the population, question wording, recruitment path, weighting, and uncertainty. For advertising measurement, add one more layer: exposed and control respondents must be comparable before survey movement can be treated as campaign evidence.

Use survey evidence for the decision it can support. It can guide message testing, audience understanding, editorial framing, or a stronger experiment. It should not become proof of sales lift, public consensus, or long-term brand change unless the design and comparison can carry that claim.

Minimum citation packet

Sponsor, field organization, funding source, and disclosure of material interests.
Target population, geography, eligibility rules, field dates, language, and survey mode.
Sample source, recruitment path, completed interviews, subgroup bases, and weighting method.
Exact question wording, answer options, order effects that matter, and topline results.
Margin or interval for full-sample and subgroup claims, plus caveats for non-sampling error.
Comparison standard: same question over time, benchmark data, exposed/control balance, or a clearly labeled loose comparison.

Official references

AAPOR disclosure standards and the AAPOR Transparency Initiative are useful starting points for what public survey reports should disclose. Pew Research Center's U.S. survey methodology is a useful example of explaining sampling, weighting, question wording, and total survey error to readers.

Takeaway

The question is not whether a poll is persuasive. The question is whether the method is inspectable enough for the headline. Strong survey writing keeps population, wording, timing, weighting, uncertainty, and comparison close to the claim.