Definition
Change in sanctions screening entity resolution detection rate across evasion technique categories over time: measuring whether coverage keeps pace with evolving adversarial tactics.
The Measurement Gap
The Measurement Gap
No metric tells you whether sanctions screening entity resolution is keeping pace with evolving evasion techniques. Hit rate (the number of sanctions matches divided by total transactions screened) is the standard performance metric, and it looks stable quarter over quarter. But a stable hit rate means nothing about coverage of actual sanctioned activity, because the denominator (total transactions) grows with business volume while the adversaries actively evolve their evasion techniques to avoid detection.
Sanctions evasion has become a sophisticated discipline. Transliteration variations (multiple valid romanizations of Cyrillic or Arabic names), shell company layering (sanctioned entities operating through nested corporate structures with no name overlap), name randomization (using agent names, aliases, or abbreviated forms), and beneficial ownership obfuscation all represent distinct evasion categories that require different entity resolution capabilities. A screening system may excel at catching exact name matches and transliteration variants while completely missing shell company structures, and the aggregate hit rate reveals nothing about this gap.
The coverage gap is not static. It actively widens as adversaries adapt. When a sanctions enforcement action reveals how a specific evasion technique was detected, adversaries shift to techniques the screening system handles less well. Without measuring detection rates by evasion technique category (which requires red-team testing with known test cases) there is no way to detect this arms race or know whether the screening system's effective coverage is expanding, stable, or silently eroding.
Decision Supported
Is the sanctions screening system's entity resolution capability keeping pace with evolving evasion techniques, or is effective coverage silently eroding?
Formula
Plain Language
Measure the change in detection rate for each evasion technique category between periods using standardized red-team test sets. Weight by the intelligence-reported prevalence of each technique. A positive aggregate means coverage is expanding; a negative aggregate means coverage is eroding.
Notation
ERCD = Σ(w_e × ΔDetectionRate_e) / Σ w_e
Variables
| Variable | Definition | Unit |
|---|---|---|
| w_e | Evasion technique category weight based on intelligence-reported prevalence | Ratio (0–1) |
| ΔDetectionRate_e | Change in detection rate for evasion category e between measurement periods | Percentage points |
| DetectionRate_e | Proportion of red-team test cases in evasion category e that the screening system correctly identifies | % |
Proposed formula, pending validation pilots.