Lead generation measurement
The Lead-Gen Campaign That Counted Form Fillers As New Demand
A realistic lead-generation scenario showing how form fills can look like new demand when prior intent, source mix, and sales-acceptance quality are not balanced.
Archetype: Lead-generation campaign measuring attributed form fills and CRM matchbacks
Bias mechanism: The measured group is enriched for visitors who already had stronger buying intent before the campaign, so form fills and matched pipeline are treated as incremental demand.
Business model pressure
A lead-generation program earns budget by showing that contextual placements, paid traffic, or sponsored resources produce efficient form fills and later sales-qualified activity. The advertiser wants evidence that the program created demand, not only captured people who were already researching a solution.
Advertiser proof claim
A dashboard reports low cost per lead, strong CRM matchback, and attractive pipeline value from attributed form fills, but the counterfactual question is how many qualified opportunities would have appeared through direct, organic, referral, or sales-nurture paths anyway.
Statistical result
| Metric | Naive read | Stratified read | Modeled benchmark |
|---|---|---|---|
| Qualified-form-fill lift | 24.1 pts | 1.2 pts | 0.7 pts |
| Attributed qualified leads | 16,511 | 820 | 479 |
| Attributed pipeline value | $4,622,961 | $229,516 | $134,046 |
| Pipeline value after media cost | 8.81x | 0.44x | 0.26x |
The form-fill dashboard is 20.1x larger than the intent-balanced estimate in this worked example.
Readout audit questions
Use this pass before the case becomes a budget argument, buyer proof point, or channel lesson. The goal is to separate what the dashboard observed from what the campaign plausibly changed.
| Check | Question to ask | Evidence in this case | Safer claim boundary |
|---|---|---|---|
| Credited outcome | What is the report counting as campaign impact? | Separate attributed outcomes from incremental outcomes. In this case, the naive lift is 24.1 pts while the stratified read is 1.2 pts. | Treat path, click, form, survey, or matched-outcome reporting as descriptive until the counterfactual is visible. |
| Comparison group | Were treatment and control groups comparable before the campaign? | The measured group is enriched for visitors who already had stronger buying intent before the campaign, so form fills and matched pipeline are treated as incremental demand. | Ask for a protected holdout, balanced market, suppression test, or matched comparison before using causal verbs. |
| Budget threshold | Would the decision survive the adjusted read? | The naive read is 20.1x larger than the stratified estimate, and adjusted ROAS is 0.44x after media cost. | Use the result for diagnosis, repair, or test planning unless the adjusted evidence clears the decision threshold. |
| Next evidence | What would change the conclusion? | Look beyond form fills to lead quality, sales acceptance, source mix, and downstream outcome evidence. | Name the missing evidence request before turning one worked example into a general rule. |
For the next review, pair this case with Landing page and lead quality measurement checklist and the claim confidence rubric.
Proxy-quality decision logic
Before this case becomes proof that media created demand, read the form-fill result through lead quality and prior-intent balance. The useful question is whether the campaign changed qualified opportunity creation, not whether it touched people who were already ready to submit a form.
| Review point | Evidence to request | Decision consequence |
|---|---|---|
| Source mix | Form fills by traffic source, entry page, prior visits, account stage, named-account status, and whether the visit began from direct, organic, referral, paid, or sales-nurture paths. | If the measured group has more high-intent sources before the campaign touch, describe the result as captured interest until a comparable holdout or matched comparison is visible. |
| Lead qualification | Sales-accepted rate, disqualification reasons, meeting-booked rate, duplicate-lead rate, account ownership, and whether scoring rules changed during the campaign. | If form fills rise but accepted leads do not, keep the finding in funnel-quality language rather than demand-generation proof. |
| Counterfactual coverage | Suppressed accounts, held-back markets, comparable account cohorts, pre-period intent, and whether the comparison pool had a fair chance to convert through normal non-media paths. | If the counterfactual excludes comparable high-intent accounts, do not use incremental pipeline or ROAS language. |
| Downstream value | Opportunity creation, stage progression, deal quality, close rate, and pipeline value by cohort after removing already-open opportunities and existing sales motions. | If attributed pipeline is concentrated in accounts already active with sales, narrow the conclusion to assisted or accelerated activity. |
| Repair path | Locked eligibility rules, fixed lead-scoring criteria, a protected holdout, sales follow-up coverage, and a prewritten claim boundary before launch. | If renewal budget depends on new demand, require the repair path before treating form-fill efficiency as causal evidence. |
Worked downgrade
The headline version of this case says the campaign produced a 24.1 point qualified-form-fill lift and more than $4.6 million in attributed pipeline value. That sounds budget-ready until the lead file shows that the measured group was heavier in high-intent pages, returning visitors, named accounts, and prospects already inside a sales-nurture path.
After balancing by prior intent and treatment propensity, the estimated movement falls to 1.2 points, and the adjusted pipeline value is $229,516 against $525,000 of media cost. The modeled benchmark is even lower at 0.7 points. The campaign may still have helped with capture and follow-up, but the dashboard no longer supports a broad new-demand claim.
The safer readout sentence is: attributed form fillers had stronger downstream value, but the evidence does not prove that media created that demand because prior intent, source mix, and lead-quality rules were not comparable. The next action is to rerun the program with locked eligibility, sales-acceptance reporting, and a protected comparison before using pipeline or ROAS language.
The advertiser-facing story
The campaign appears efficient because the report starts with visitors who clicked through to a high-intent page, downloaded a gated asset, or submitted a contact form. Later CRM matching gives the attributed group a convincing pipeline story, especially when the report compares those form fillers with a broad pool of site visitors or accounts.
What broke
Form completion is not only an outcome. It is also a signal that the visitor had a problem, budget, urgency, or prior familiarity before the measured touch. If the control group includes people who never showed comparable intent, the readout turns lead qualification and pre-existing demand into media-caused lift.
Better design
Define the eligible audience before launch, hold back comparable accounts or markets, keep lead-scoring and sales-acceptance rules fixed, and report sales-qualified leads or opportunity value against that protected comparison. A useful readout should separate traffic, form conversion, lead quality, follow-up coverage, and incremental pipeline.
Propensity-strata audit
The adjusted estimate compares measured and comparison users within similar treatment-propensity strata. That does not prove incrementality, but it shows whether the apparent lead gain was carried by people who were already closer to a form fill before the campaign touch.
| Propensity stratum | Accounts or visitors | Measured-touch form-fill rate | Comparison form-fill rate | Within-stratum difference |
|---|---|---|---|---|
| 1 | 73 | 0.0% | 6.0% | -6.0 pts |
| 2 | 11,152 | 8.6% | 7.4% | 1.2 pts |
| 3 | 19,200 | 11.7% | 11.1% | 0.7 pts |
| 4 | 11,199 | 17.8% | 15.5% | 2.3 pts |
| 5 | 3,571 | 22.2% | 21.4% | 0.8 pts |
| 6 | 2,632 | 31.4% | 32.7% | -1.3 pts |
| 7 | 10,688 | 41.2% | 37.8% | 3.4 pts |
| 8 | 28,316 | 51.3% | 50.5% | 0.8 pts |
| 9 | 29,465 | 64.1% | 63.0% | 1.1 pts |
| 10 | 1,704 | 77.8% | 77.2% | 0.6 pts |
Takeaway
A strong lead-generation readout should not stop at attributed form fills or matched pipeline. It should show eligible accounts, prior-intent balance, source mix, sales-acceptance quality, downstream opportunity evidence, and how much of the result survives a protected or well-matched counterfactual.
Move from this case to the next review.
Use the case to tighten claim language, choose a better measurement method, and review the next campaign readout without treating a worked example as a rule.