Awesome Reviewers checks + prompts

LLM application security review

Reviews code that calls models for the OWASP Top 10 for LLM applications: prompt injection, output handling, excessive agency, unbounded consumption.

V1039 technique
tactic Code review
not detectable from CI configuration

Sub-techniques

3

IDNameDescription
V1039.001Static review of LLM call sitesCheck how untrusted text reaches prompts and how outputs reach tools or HTML.
V1039.002Red-team probingSend adversarial prompts to a running application and score the responses.
V1039.003Runtime input and output scanningScan prompts and responses in production for injection and leakage.

Craft it

  1. List every place untrusted text enters a prompt and every place model output is executed or rendered.
  2. Run a red-team suite against those paths in CI.
  3. Cap tokens, tool calls and spend per request.

Reverse engineer it

Signs that a codebase already runs this technique, and where to read how it is configured.

  • promptfoo or garak config, prompt templates, and tool definitions in the repository.

Open-source packages

3