Skill Output Stability (SOS)

GMI-SOLO-017Solo AI OperationsInfrastructure-DependentPattern O-2: Model Drift / Currency

Definition

Behavioral stability of a codified skill across model versions, measured on a frozen input set. Only adjudicated regressions count against stability; accepted improvements reset the baseline.

The Measurement Gap

There is no metric for output drift of a codified skill across model versions (same skill, same input class, changed behavior after upgrade). The operator's procedure library silently re-interprets itself with every platform release.

Formula

SOS_k = 1 - ( regression_diff_points_k / total_diff_points_k ), per skill k, at each release

Proposed formula, pending validation pilots.

At a Glance

Unit
Ratio (0 to 1)
Trend Direction
Higher
Reporting Frequency
At every announced model or platform release
Category
Skill and Asset Lifecycle

Decision Supported

When a codified asset needs maintenance, and how much trust to place in it between maintenance passes.

← Asset Fix Ratio (AFR)Skill Payback Index (SPI) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment