Verification Vigilance Degradation Rate (VVDR)

GMI-HC-011HealthcareInfrastructure-DependentPattern O-9: Skill Atrophy

Definition

Change over time in the rate at which human verification catches robotic dispensing errors, measuring whether automation reliability is eroding the human safety net.

The Measurement Gap

The Decision That Legacy Metrics Cannot Support

Is the pharmacy team still catching the 0.5% of robotic dispensing errors, or has trust in the robot degraded their vigilance, meaning the actual error-to-patient rate is higher than the robot's mechanical error rate?

What Goes Unmeasured Today

Automated dispensing cabinets and robotic pharmacy systems have dramatically reduced medication dispensing errors. When a robotic system achieves 99.5% accuracy, the remaining 0.5% error rate depends on human verification to prevent errors from reaching patients. Healthcare organizations track robotic accuracy rates and medication error rates, but they do not separately track whether the human catch rate for robotic errors is changing over time.

This is the automation complacency problem documented extensively in aviation and manufacturing (Parasuraman & Manzey, 2010; Bainbridge, 1983). When a system is highly reliable, the humans tasked with verifying its output become less vigilant because errors are rare. Each verification step feels routine (the robot is almost always right) and the cognitive effort required to maintain independent assessment atrophies. A pharmacy technician who verified 500 robotic fills today and found zero errors is psychologically less prepared to catch error 501 tomorrow.

Legacy medication safety metrics (medication error rate, near-miss rate, adverse drug event rate) capture the end result but cannot distinguish between errors originating from the robot and errors originating from degraded human verification. If the robot's error rate remains constant at 0.5% but the human catch rate declines from 90% to 60%, the effective error-to-patient rate increases from 0.05% to 0.20%, a fourfold increase that is invisible in the robot's accuracy metric and diluted in aggregate medication error reporting.

The Invisible Failure Mode

Verification vigilance degrades gradually. The catch rate does not drop from 90% to 60% overnight. It erodes over months as automation reliability teaches the human verification step that independent checking is unnecessary. The erosion is invisible because nobody measures the catch rate separately from the overall error rate.

Formula

Primary Formula

VVDR = (Catch_Rate_current − Catch_Rate_baseline) / Catch_Rate_baseline

Variable Definitions

Variable Definition Unit
Catch_Rate_current Dispensing errors caught by human verification / total dispensing errors that occurred (current period) Ratio (0–1)
Catch_Rate_baseline Same ratio in baseline period (first 6 months post-automation or pre-automation rate) Ratio (0–1)
Dispensing errors that occurred Errors detected at any point: during verification, during administration, or after administration Count

Data Requirements

Data Element Source System Classification
Robotic dispensing events Automated dispensing cabinet logs NATIVE
Verification outcomes (confirmed correct, error caught) Pharmacy verification system NATIVE (if electronic) / MANUAL (if paper)
Errors discovered post-verification Medication error reporting system, near-miss reports NATIVE
Baseline verification catch rate Historical pharmacy QA data NATIVE (if tracked) / NOT CAPTURED (if not)

Edge Cases and Exclusions

The denominator (total errors that occurred) includes errors discovered after administration, requiring robust adverse event and near-miss reporting systems. If the robot's error rate improves over time, fewer errors present for catching: control for robot accuracy changes when interpreting VVDR. Segment by staff tenure, as new technicians lack baseline vigilance history. May require 6-month measurement windows at smaller pharmacies to accumulate sufficient error counts.

Proposed formula, pending validation pilots.

At a Glance

Category
Autonomous Pharmacy and Medication Safety
← Substitution Clinical Appropriateness Rate (SCAR)AEM Interval Compliance Alignment Rate (AICAR) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment