Definition
MMDI estimates the percentage of observed period-over-period performance change attributable to measurement methodology changes rather than actual performance shifts.
The Measurement Gap
When ROAS drops 15% year-over-year, the instinctive response is to diagnose campaign performance. But during a period of accelerating measurement infrastructure change (new attribution models, cookie deprecation phases, consent rate shifts, platform API updates) a significant portion of that reported change may reflect the measurement system counting differently, not the campaigns performing differently. Legacy metrics like ROAS, CPA, and conversion rate are computed from whatever the current system reports. They have no mechanism to decompose a reported change into "real performance shift" versus "methodology artifact." A platform migrating from last-click to data-driven attribution will report different numbers for identical campaign performance. A consent rate decline will reduce observable conversions without any change in actual purchase behavior. An analytics platform upgrade that changes session definitions will alter reported engagement metrics retroactively. Without isolating methodology-driven change from performance-driven change, every year-over-year and quarter-over-quarter comparison made during a measurement transition period carries unknown distortion. Strategic decisions about channel investment, creative effectiveness, and market positioning are contaminated by measurement artifacts that masquerade as performance signals.
Decision Supported:
When reported performance changes between periods, how much of that change reflects actual marketing effectiveness versus the measurement system counting differently?
Formula
Plain language: Compare the reported performance change (using the current measurement system against the prior period's system) with the controlled performance change (using a consistent methodology across both periods). The ratio of the difference to the reported change reveals how much of the visible movement is a measurement artifact.
Notation:
MMDI = |Performance_delta_reported − Performance_delta_controlled| / |Performance_delta_reported| × 100
Variables:
| Variable | Definition | Unit |
|---|---|---|
| Performance_delta_reported | The period-over-period change as reported by comparing current system output against prior period output, even if methodology changed between periods | % or currency |
| Performance_delta_controlled | The period-over-period change measured using a consistent methodology across both periods, typically via overlap dual-measurement or holdback group | % or currency |
Proposed formula, pending validation pilots.