Design Rationale Transparency Score (DRTS)

GMI-SWD-009Software DeliveryIntegration-RequiredPattern O-9: Skill Atrophy

Definition

Availability of recoverable design rationale behind AI-assisted architecture decisions, measuring whether the trade-offs and rejected alternatives that build institutional memory are being captured.

The Measurement Gap

Measurement Gap and Decision

The Gap: When a human architect recommends an approach, the team asks "why?" and the conversation produces institutional memory -- trade-offs considered, alternatives rejected, assumptions made, conditions that would change the answer. When an AI makes the recommendation, teams accept the output without interrogating the reasoning, and whatever reasoning the AI provided disappears when the chat session closes.

The consequence is architectural amnesia. Six months after adoption, nobody remembers why the architecture was chosen, what alternatives existed, or under what conditions the choice should be reconsidered. No traditional metric captures this -- documentation completeness tools don't distinguish between architecture decisions with transparent rationale and those with opaque reasoning.

The Decision:

DRTS measures the percentage of AI-assisted architecture decisions where rejected alternatives, trade-offs, and invalidating assumptions are documented in a form that allows the decision to be revisited. When DRTS falls below threshold, the intervention is implementing mandatory decision templates with required fields for alternatives, trade-offs, assumptions, and AI constraints.

Formula

Formula:

DRTS = (1/N) x SUM [ (has_alternatives_i + has_tradeoffs_i + has_assumptions_i + has_constraints_i) / 4 ]

Where (each scored 0 or 1):

  • has_alternatives_i: Decision documents at least 2 rejected alternatives with rationale
  • has_tradeoffs_i: Decision documents trade-offs between chosen option and alternatives
  • has_assumptions_i: Decision documents assumptions that would invalidate the choice
  • has_constraints_i: Decision documents constraints and context given to the AI
  • N = total AI-assisted architecture decisions in the measurement period

Worked Example:

Team made 4 AI-assisted architecture decisions in Q3:

Decision 1 (event-driven architecture): alternatives=1, tradeoffs=1, assumptions=0, constraints=0. Score: 2/4 = 0.50
Decision 2 (database selection): alternatives=1, tradeoffs=1, assumptions=1, constraints=1. Score: 4/4 = 1.00
Decision 3 (API gateway pattern): alternatives=0, tradeoffs=0, assumptions=0, constraints=0. Score: 0/4 = 0.00
Decision 4 (caching strategy): alternatives=1, tradeoffs=0, assumptions=0, constraints=1. Score: 2/4 = 0.50

DRTS = (1/4) x (0.50 + 1.00 + 0.00 + 0.50) = 0.50

Proposed formula, pending validation pilots.

At a Glance

Unit
Score
Trend Direction
Higher
Reporting Frequency
Quarterly
Category
Architecture and Design Governance
← Architecture-Team Fitness Score (ATFS)Debt Detection Coverage Ratio (DTDCR) →

Assess Your Organization

The AI-GPS Assessment evaluates your AI governance maturity and recommends KPIs like this one for your implementation roadmap.

Take the Free AI-GPS Assessment