Developer feedback capture
Records how developers respond to findings (fixed, dismissed, argued) and the sentiment of replies, as the ground truth for every other loop.
Sub-techniques
2
| ID | Name | Description |
|---|---|---|
V1069.001 | Outcome tracking | Was the finding fixed in a later commit, dismissed or ignored. |
V1069.002 | Reply sentiment | Classify replies as agreeing, disputing or neutral. |
Craft it
- Store every finding with its later outcome.
- Sample disputed findings for human labelling.
- Feed labels to calibration and evaluation.
Reverse engineer it
Signs that a codebase already runs this technique, and where to read how it is configured.
- Reactions and replies on bot comments, collected by a webhook.
Open-source packages
3
- Argilla argilla-io/argilla
- Label Studio HumanSignal/label-studio
- VADER cjhutto/vaderSentiment