Human-Automation Inspection Effectiveness Ratio (HAIER)

GMI-RAIL-006Rail TransportationResearch-Forward

Definition

The ratio of combined human plus automated inspection detection rate to the better of the two systems' independent detection rates, measuring whether the combination improves or degrades overall inspection effectiveness.

The Measurement Gap

When human inspectors know that vision systems screen first, they unconsciously defer to the automated assessment and inspect less thoroughly. The combined detection rate drops below what either system achieves independently, but neither system's metrics show the decline. Inspection compliance measures whether inspections happened, not whether inspector diligence changed. Vision system accuracy is measured against its own training data, not against an independent ground truth.

Decision Supported:

Is adding automated inspection actually improving total defect detection, or is it causing human inspectors to relax and creating a combined system worse than the best individual system?

Formula

Plain language: In a controlled sample where assets are inspected by both human and automated systems independently, measure each system's detection rate alone and the combined workflow's detection rate. Divide the combined rate by the higher of the two independent rates.

Notation:

HAIER = DR_combined / max(DR_human, DR_auto)

Variables:

Variable Description Unit
DR_combined Detection rate of the combined human + automated workflow Ratio
DR_human Detection rate of human inspection alone (controlled sample) Ratio
DR_auto Detection rate of automated inspection alone (controlled sample) Ratio
Total confirmed defects Ground truth defect count from comprehensive teardown or extended follow-up Count

Sign Convention: Above 1.0 = combination adds value. Below 1.0 = combination degrades performance. 1.0 = no interaction effect.

Proposed formula, pending validation pilots.

At a Glance

Unit
Ratio
Category
Automated Detection and Inspection Quality
← Environmental Inspection Confidence Index (EICI)Risk-Weighted Inspection Coverage Index (RWICI-RAIL) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment