Definition
Availability of recoverable design rationale behind AI-assisted architecture decisions, measuring whether the trade-offs and rejected alternatives that build institutional memory are being captured.
The Measurement Gap
Measurement Gap and Decision
The Gap: When a human architect recommends an approach, the team asks "why?" and the conversation produces institutional memory -- trade-offs considered, alternatives rejected, assumptions made, conditions that would change the answer. When an AI makes the recommendation, teams accept the output without interrogating the reasoning, and whatever reasoning the AI provided disappears when the chat session closes.
The consequence is architectural amnesia. Six months after adoption, nobody remembers why the architecture was chosen, what alternatives existed, or under what conditions the choice should be reconsidered. No traditional metric captures this -- documentation completeness tools don't distinguish between architecture decisions with transparent rationale and those with opaque reasoning.
The Decision:
DRTS measures the percentage of AI-assisted architecture decisions where rejected alternatives, trade-offs, and invalidating assumptions are documented in a form that allows the decision to be revisited. When DRTS falls below threshold, the intervention is implementing mandatory decision templates with required fields for alternatives, trade-offs, assumptions, and AI constraints.
Formula
Formula:
DRTS = (1/N) x SUM [ (has_alternatives_i + has_tradeoffs_i + has_assumptions_i + has_constraints_i) / 4 ]
Where (each scored 0 or 1):
- has_alternatives_i: Decision documents at least 2 rejected alternatives with rationale
- has_tradeoffs_i: Decision documents trade-offs between chosen option and alternatives
- has_assumptions_i: Decision documents assumptions that would invalidate the choice
- has_constraints_i: Decision documents constraints and context given to the AI
- N = total AI-assisted architecture decisions in the measurement period
Worked Example:
Team made 4 AI-assisted architecture decisions in Q3:
Decision 1 (event-driven architecture): alternatives=1, tradeoffs=1, assumptions=0, constraints=0. Score: 2/4 = 0.50
Decision 2 (database selection): alternatives=1, tradeoffs=1, assumptions=1, constraints=1. Score: 4/4 = 1.00
Decision 3 (API gateway pattern): alternatives=0, tradeoffs=0, assumptions=0, constraints=0. Score: 0/4 = 0.00
Decision 4 (caching strategy): alternatives=1, tradeoffs=0, assumptions=0, constraints=1. Score: 2/4 = 0.50
DRTS = (1/4) x (0.50 + 1.00 + 0.00 + 0.50) = 0.50
Proposed formula, pending validation pilots.