AI SRE · Intermediate · FICTIONAL ENVIRONMENT
RAG Quality Regression
Availability and latency remain green, but citations suddenly point to irrelevant procedures.
MISSIONRestore grounded answer quality after an ingestion rollout.
MISSION PROGRESS
0 / 4
PHASE 1
Open evidence sources. Build your incident picture.Investigate
INVESTIGATION JOURNAL
Outputs appear here as you inspect systems.Observed evidence
Evidence you inspect will appear here.
PHASE 2
This is not scored until you choose to check it.Form a root-cause hypothesis
PHASE 3
Controls unlock after an evidence-consistent hypothesis.Apply a mitigation
PHASE 4
Do not declare victory before verification.Verify recovery
Debrief
- AI quality can be a production reliability signal.
- Version and evaluate ingestion pipelines like code.
- A healthy vector database can still return low-quality context.