From observed failures to evaluated changes Diagram

Diagnosis is a distinct activity

Rules screen all executions; model-assisted analysis concentrates effort on ambiguous behavior.
Assess achievement of intent, evidence supporting recorded decisions, tool appropriateness, and retrieval relevance.

Evaluation needs defined cases

Link trajectories with user feedback; select and annotate samples with criteria that can distinguish success from failure.
ATIF provides trajectory interchange for evaluation and training; deployments version the formats they support.

Compare before adoption

Run the current and proposed configuration against the same cases. Inspect outcomes and relevant tradeoffs.
A plausible fix is not a proven improvement. Evidence informs a human-owned deployment decision.