Verification · Feedback and evaluation · Reviewer evaluation
Side-by-side comparison
Run two reviewer versions on the same set and compare.
How to build it
- Run two reviewer versions on the same set of labelled changes.
- Store each version's findings side by side in one results file.
- Merge a reviewer change only when the new version is not worse on recall or precision.
Signals in a repository
- A comparison config that names two reviewer versions.
- A results report that shows both versions for each case.
- A pull request template item that asks for a comparison run on reviewer changes.
In practice
No scanned repository runs a tool for this check. The steps above are the only guidance.