Awesome Reviewers

Verification · Testing · Sandboxed execution

Reproduce-then-verify

Reproduce a reported bug in the sandbox, apply the fix, and show the same command now passes.

How to build it

  1. Run the reported reproduction steps in an isolated sandbox before any fix is written.
  2. Apply the fix in the same sandbox and run the same command again.
  3. Attach both command outputs to the pull request.

Signals in a repository

  • Pull request comments that include reproduction output from a sandbox run.
  • Regression tests named after the bug that fail before the fix and pass after it.

In practice

No scanned repository runs a tool for this check. The steps above are the only guidance.