Definition
The extent to which adjudicator rulings on evidence standing remain independent of the AI's candidate value, measured by the difference in ruling distribution between proposal-visible and proposal-withheld conditions.
The Measurement Gap
There is no metric that tells you whether admissibility rulings would have been the same absent the AI's candidate proposal, which means the separation of proposal from grade holds in the record while collapsing in the reviewer's behavior.
Formula
RII = 1 - ( Σ_r | p_visible(r) - p_withheld(r) | ) / 2
Proposed formula, pending validation pilots.
At a Glance
Decision Supported
Whether evidence packages should be presented to adjudicators with or without the candidate value attached.