Missed bug analysis
For each bug that escaped review, finds which technique should have caught it and why it did not, then clusters the causes.
Sub-techniques
3
| ID | Name | Description |
|---|---|---|
V1066.001 | Root cause trace | Replay the review trace for the PR that introduced the bug. |
V1066.002 | Cause clustering | Cluster root causes to find the systematic gaps. |
V1066.003 | Eval set growth | Add each missed bug to an evaluation set for the reviewers. |
Craft it
- Link every bug fix to the PR that introduced the bug.
- Trace what each check and reviewer saw on that PR.
- Add the case to the eval set and re-run reviewers on it.
Reverse engineer it
Signs that a codebase already runs this technique, and where to read how it is configured.
- Postmortems that name the introducing PR, and tracing for review agents.
Open-source packages
3
- Langfuse langfuse/langfuse
- Arize Phoenix Arize-ai/phoenix
- BERTopic MaartenGr/BERTopic