Model Confidence Calibration Index (MCCI)

GMI-DEF-001Defense OperationsIntegration-RequiredPattern O-1: Confidence Calibration

Definition

The degree to which an AI system's stated confidence scores correspond to its actual accuracy, measured as the mean absolute deviation between predicted confidence bands and observed correctness rates.

Formula

MCCI = (1/B) x SUM |Ci - Ai| over confidence bins

Proposed formula, pending validation pilots.

At a Glance

Category
AI Calibration & Trust Integrity

Decision Supported

Should analysts trust this model's high-confidence outputs without independent verification, or has confidence decoupled from accuracy?

← Collateral Damage Estimation Accuracy (CDEA)Source Fusion Balance Index (SFBI) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment