Eval Workload Segregation Index (EWSI)

GMI-MLOPS-020MLOps / AI Platform OperationsPilot-ReadyPattern R-1: Segregation Index

Definition

The on-time completion rate of governance workloads (evals, red-team runs, documentation and monitoring jobs) relative to the on-time completion rate of revenue serving and training workloads, under GPU contention.

The Measurement Gap

There is no metric that tells you whether governance workloads receive their policy share of contended capacity, which means eval and red-team work is starved exactly when change volume peaks.

Formula

EWSI = OTR_governance / OTR_overall, computed only over contention periods

Proposed formula, pending validation pilots.

At a Glance

Category
Estate and Capacity Governance

Decision Supported

Whether the scheduler is silently starving governance work exactly when change volume peaks, and whether capacity policy needs a floor.

← Change Attribution Success Rate (CASR)Model Estate Utilization Rate (MEUR) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment