Definition
Percentage of CV-assigned defect severity grades that match the severity grade a qualified structural inspector assigns to the same defect upon independent review, measured per severity tier. DSGA is foundational for the physical infrastructure inspection domain: every downstream maintenance decision depends on whether the CV model grades structural defects accurately enough to drive crew dispatch, repair scheduling, and monitoring decisions without human structural engineer review.
The Measurement Gap
Legacy drone inspection programs report binary detection: defect found or not found. They do not measure whether the CV model's severity grade matches a qualified inspector's assessment, creating a blind spot where the model could systematically misgrade Emergency defects as Monitor (dangerous deferrals) or Monitor defects as Emergency (wasteful emergency responses). Without per-tier grading accuracy data, organizations cannot determine which severity tiers the model is miscalibrated for and cannot set appropriate authority thresholds for autonomous grading decisions.
The Decision
Can maintenance planners trust the CV model's severity grades when deciding whether to dispatch an emergency crew, schedule routine repair, or log and monitor, or is the model systematically misgrading in ways that create either dangerous deferrals or wasteful emergency responses? The critical directional failure is when the model grades Emergency defects as lower severity tiers: even one missed structural emergency on a telecom tower can be catastrophic. DSGA per tier reveals exactly where the model's grading authority should be restricted.
Research Foundation
Computer vision defect classification accuracy varies significantly by severity tier, with models typically performing well on extreme cases (clearly cosmetic or clearly critical) but poorly on intermediate severity levels where grading depends on contextual engineering judgment (McKinsey Infrastructure AI Assessment, 2024). OSHA structural inspection compliance requires that severity assessments match qualified inspector judgment at rates exceeding 85% for safety-critical classifications (OSHA 29 CFR 1926 Subpart R: Telecommunications).
Formula
DSGA = Correct_or_adjacent_grades / Total_sampled_defects × 100
Per-tier breakdown:
DSGA(s) = Correct_grades_in_tier_s / Total_CV_grades_assigned_tier_s × 100
Variable Definitions (every variable resolved)
- Correct_or_adjacent_grades = CV-graded defects where the CV severity tier matches the inspector's tier exactly or is within one tier (count)
- Total_sampled_defects = all defects in the evaluation sample (count)
- s = severity tier (Cosmetic, Monitor, Schedule Repair, Emergency)
- DSGA(s) = per-tier accuracy revealing whether the model is miscalibrated at specific severity levels
Units: Percentage. 100% = perfect agreement between CV and inspector grading. Track per-tier to identify directional bias: the dangerous failure is when the model grades Emergency defects as Monitor.
Edge Cases
Inspector disagreement: use two independent inspectors and take the consensus grade; if inspectors disagree, exclude from the accuracy calculation and track inter-rater disagreement rate separately. Defects visible only in imagery (top of structure, inaccessible faces): inspector grades from the same imagery, not from a field visit. This tests classification accuracy, not detection. Ambiguous severity defects (surface corrosion where severity depends on depth): establish severity grading criteria before the evaluation, not after. Minimum sample: 50 defects per severity tier per measurement period; over-sample Monitor and Schedule Repair tiers where misgrading has the highest consequence.
These are proposed starting points: calibrate to your operational context during pilot: DSGA above 85% overall is workable. Below 70% for any individual severity tier warrants restricting the model's authority for that tier. If DSGA for the Emergency tier drops below 90%, require human structural engineer review of all CV-graded defects before any severity downgrade from Emergency to a lower tier.
Proposed formula, pending validation pilots.