Routing Quality Retention Rate (RQRR)

GMI-MLOPS-010MLOps / AI Platform OperationsIntegration-RequiredPattern O-30: Proxy-Objective Divergence

Definition

Blended production quality under the live routing policy as a fraction of the quality a reference policy (best-known model per task class) would have delivered on the same traffic.

The Measurement Gap

There is no metric that tells you the blended quality change caused by cost-driven routing shifts, which means quality erosion for savings has no signal until complaints.

Formula

RQRR = q_live / q_reference on matched traffic sample, reported with cost_delta

Proposed formula, pending validation pilots.

At a Glance

Category
Serving Economics and Coherence

Decision Supported

Whether cost-driven routing shifts are eroding quality, and how much quality each unit of routing savings actually costs.

← Guardrail Net Protection Yield (GNPY)Feature Parity Index (FPI) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment