Trend framing

Before-and-after chart and trend claim checklist

Published May 30, 2026. Status: evergreen source page.

A before-and-after chart can be accurate and still make the wrong comparison feel obvious.

Use this checklist when a story, dashboard, campaign report, research deck, or public-data chart points to a jump, drop, record high, sudden turn, or post-launch change. The goal is to separate a real movement in the data from a causal story the chart has not earned.

Start with the chart's claim

Do not start by debating the design. First name the sentence the chart is asking the reader to believe.

Chart move	Question to ask	Careful first read
Before and after a launch	What else changed at the same time, and what would have happened without the launch?	The chart shows timing, not yet cause.
Sharp jump or drop	Is the movement a level shift, a return to normal, a data-definition change, or noise from a small base?	The movement needs a longer baseline and a denominator.
Record high or low	How long is the record, how volatile is the series, and was the comparison window chosen after the result?	A record can be meaningful or just a feature of a short or noisy series.
Percent change headline	What were the starting level, eligible population, and absolute change?	A large percentage from a small base can be directionally true but decision-poor.
Campaign-period improvement	Was there a holdout, matched market, model baseline, or preselected comparison?	Observed lift is not incremental lift until the counterfactual is visible.
Seasonal pattern	Does the chart compare the same season, same weekday mix, and same calendar effects?	The chart may be showing seasonality rather than a new effect.

Minimum source packet

Before accepting the trend language, ask for enough material to reproduce the chart and understand its limits.

Original series

The table, report, dashboard export, or public record closest to the plotted number, not only a screenshot or executive summary.

Definition notes

The numerator, denominator, eligibility rules, inclusion rules, missing population, revisions, and any method change during the charted period.

Full window

Enough pre-period and post-period data to see trend, volatility, seasonality, and whether the shown window was selected because it looked persuasive.

Event timeline

Launches, pricing changes, outages, news events, sales coverage changes, inventory shifts, data backfills, and concurrent campaigns that could explain the movement.

Comparison rule

The prior period, peer group, matched market, holdout, forecast, model baseline, or explicit statement that no credible comparison exists.

Uncertainty and stability

Confidence intervals, sensitivity ranges, sample sizes, minimum cell thresholds, revision history, or simple volatility checks when formal uncertainty is unavailable.

Trend-framing checks

Check	Raise confidence when	Lower confidence when
Window choice	The chart shows a preselected window or enough history to judge whether the movement is unusual.	The start date is placed at a convenient trough or peak.
Scale and axis	The axis, baseline, and units make the size of the change clear.	A truncated scale makes a modest change look dramatic, or a wide scale hides a material shift.
Denominator	Counts are paired with eligible population, rate base, or starting level.	The claim relies on percent change without showing the base.
Comparability	Definitions, data collection, geography, audience, and inclusion rules are stable across the period.	The series changes method in the middle of the story.
Seasonality	The comparison controls for recurring calendar patterns, weekday mix, holidays, or sales cycles.	A busy season is compared with a quiet season as if the campaign or story event caused the gap.
Counterfactual	A holdout, matched market, peer series, forecast, or model baseline was chosen before the result was known.	The chart compares only before with after and calls the difference impact.
Revision risk	The source states whether numbers are final, preliminary, backfilled, estimated, or subject to restatement.	The chart treats a first release or partial record as settled truth.

Before and after is not a counterfactual

The main weakness in before-and-after reasoning is not that the after period changed. It is that the chart does not show what the after period would have looked like without the event.

Evidence available	Supportable wording	Do not say yet
Only before and after values.	"The metric changed after the event."	"The event caused the change."
Longer trend without comparison group.	"The post-event period differs from the prior trend, subject to other changes in the period."	"The full difference is incremental impact."
Matched peer, market, or segment.	"The change is directionally stronger than a defined comparison, with matching limits."	"This is equivalent to randomized evidence."
Designed holdout or randomized test.	"The design estimates incremental effect for this audience, window, and outcome."	"The same effect will apply everywhere."
Model baseline calibrated with tests.	"Multiple evidence streams support the direction within stated assumptions."	"The model has proven exact contribution."

Common failure modes

Convenient start date

The chart starts at the low point or high point that makes the desired movement look largest.

Mixed definitions

The series changes eligibility, tracking method, geography, or inclusion rules while the chart presents one smooth line.

Seasonal comparison

A holiday, budget cycle, school year, sales period, or weekday mix explains more than the highlighted event.

Small-base drama

A large percentage change comes from a starting level too small to support the tone of the headline.

Concurrent shocks

Pricing, supply, news, promotion, sales coverage, inventory quality, or data backfill moves at the same time.

Attribution language

A descriptive line chart is promoted into a causal claim without a planned comparison.

Rewrite the claim

Weak wording	Cleaner wording	Evidence needed to go stronger
"The campaign drove a 30% increase."	"Observed outcomes were 30% higher during the campaign period."	Holdout, matched market, or credible baseline chosen before launch.
"The issue is suddenly exploding."	"Reported counts rose in the shown window; the rate base and longer trend need checking."	Full record, denominator, method notes, and a longer comparison period.
"This change proves the new strategy worked."	"The post-launch period improved, but other concurrent changes must be separated."	Controlled rollout, staggered timing, or matched comparison group.
"The chart shows a historic collapse."	"The series reached a low in this record; volatility and record length matter."	Longer history, uncertainty, peer comparison, and definition stability.
"The new channel lifted sales."	"Sales rose after the channel launched under this attribution window."	Incrementality test, geo design, or calibrated model with sensitivity checks.

Meeting questions

What exact sentence does the chart want us to believe?
What is the numerator, denominator, and starting level?
Why does the chart start and end where it does?
What else moved during the same period?
What would the after period have looked like without the event?
What comparison was chosen before results were visible?
What weaker wording would still be true if the causal story were removed?

Pair with

For media claims, pair this checklist with the media claim audit worksheet, public records and denominator checklist, survey and poll claim checklist, and claim confidence rubric.

For advertising measurement, pair it with the campaign readout QA checklist, comparison market and holdout planning guide, geo lift test design checklist, MMM readout QA checklist, and incrementality test plan template.

For official references and citation workflow, use the source library before turning a chart into a public claim or budget recommendation.