Measurement Methodology Discontinuity Index (MMDI)

GMI-MKTP-002Marketing Data PrivacyIntegration-Required

Definition

MMDI estimates the percentage of observed period-over-period performance change attributable to measurement methodology changes rather than actual performance shifts.

The Measurement Gap

When ROAS drops 15% year-over-year, the instinctive response is to diagnose campaign performance. But during a period of accelerating measurement infrastructure change (new attribution models, cookie deprecation phases, consent rate shifts, platform API updates) a significant portion of that reported change may reflect the measurement system counting differently, not the campaigns performing differently. Legacy metrics like ROAS, CPA, and conversion rate are computed from whatever the current system reports. They have no mechanism to decompose a reported change into "real performance shift" versus "methodology artifact." A platform migrating from last-click to data-driven attribution will report different numbers for identical campaign performance. A consent rate decline will reduce observable conversions without any change in actual purchase behavior. An analytics platform upgrade that changes session definitions will alter reported engagement metrics retroactively. Without isolating methodology-driven change from performance-driven change, every year-over-year and quarter-over-quarter comparison made during a measurement transition period carries unknown distortion. Strategic decisions about channel investment, creative effectiveness, and market positioning are contaminated by measurement artifacts that masquerade as performance signals.

Decision Supported:

When reported performance changes between periods, how much of that change reflects actual marketing effectiveness versus the measurement system counting differently?

Formula

Plain language: Compare the reported performance change (using the current measurement system against the prior period's system) with the controlled performance change (using a consistent methodology across both periods). The ratio of the difference to the reported change reveals how much of the visible movement is a measurement artifact.

Notation:

MMDI = |Performance_delta_reported − Performance_delta_controlled| / |Performance_delta_reported| × 100

Variables:

Variable Definition Unit
Performance_delta_reported The period-over-period change as reported by comparing current system output against prior period output, even if methodology changed between periods % or currency
Performance_delta_controlled The period-over-period change measured using a consistent methodology across both periods, typically via overlap dual-measurement or holdback group % or currency

Proposed formula, pending validation pilots.

At a Glance

Unit
Percentage
Trend Direction
Lower
Reporting Frequency
Quarterly
Category
Signal Degradation and Measurement Integrity
← Privacy Compliance Segregation Index (PCSI)Modeled Conversion Ratio (MCR) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment