Static analysis
3 tools
| Tool | Kind | Command | Runs in | Found in |
|---|---|---|---|---|
codeql |
Security scanning | uses github/codeql-action/analyze |
ci | .github/workflows/ci.yml |
eslint |
Linting | eslint . --fix --ext .ts,.tsxeslint integration-tests --fixeslint scripts --fix |
local | package.json eslint.config.js |
tsc |
Type checking | tsc -b evals/tsconfig.json integration-tests/tsconfig.json memory-tests/tscon... |
ci, local | .github/workflows/ci.yml package.json Makefile |
Testing
4 tools
| Tool | Kind | Command | Runs in | Found in |
|---|---|---|---|---|
ci-matrix |
Version and platform matrix | test_linux (node-version: 3, shard: 2)test_mac (node-version: 3, shard: 2)test_windows (shard: 2) |
ci | .github/workflows/ci.yml |
unittest |
Unit and integration tests | unittest discover -s tools/caretaker-agent/cloudrun/triage-worker/tests -t to... |
ci | .github/workflows/tools-python-ci.yml |
vitest |
Unit and integration tests | vitest run --config evals/vitest.config.tsvitest run --config ./scripts/tests/vitest.config.tsvitest run sea/sea-launch.test.js |
ci, local | .github/workflows/chained_e2e.yml package.json .github/workflows/ci.yml .github/workflows/memory-nightly.yml |
pytestconfigured, not run |
Unit and integration tests | tools/caretaker-agent/cloudrun/pr-generator/pytest.ini |
Formatting and hygiene
1 tool
| Tool | Kind | Command | Runs in | Found in |
|---|---|---|---|---|
prettier |
Formatting | prettier --experimental-cli --write . |
local | Makefile package.json .prettierrc.json |
35 other commands the scanner could not classify
Commands from CI steps and task runners that look like checks but match no known tool. Some are checks, some are not.
Move-Item $TARBALL ../smoke-test-dir/New-Item -ItemType Directory -Force -Path ../smoke-test-dirOnce approved, the evaluation results will be posted here automatically.Set-Location ../smoke-test-dirWhere-Object { Test-Path $_ }cross-env GEMINI_SANDBOX=docker npm run build:sandboxcross-env GEMINI_SANDBOX=docker vitest run --root ./integration-testscross-env GEMINI_SANDBOX=false vitest run --root ./integration-testscross-env GEMINI_SANDBOX=podman vitest run --root ./integration-testscross-env NODE_OPTIONS=--max-old-space-size=8192 eslint . --cache --max-warnings 0cross-env RUN_EVALS=1 vitest run --config evals/vitest.config.tscross-env RUN_FLAKY_INTEGRATION=1 npm run test:integration:sandbox:nonecross-env UPDATE_MEMORY_BASELINES=true vitest run --root ./memory-testscross-env UPDATE_PERF_BASELINES=true vitest run --root ./perf-testscross-env VERBOSE=true KEEP_OUTPUT=true npm run test:integration:sandbox:nonenode scripts/check-lockfile.jsnode scripts/lint.jsnode scripts/lint.js --actionlintnode scripts/lint.js --check-github-actions-pinningnode scripts/lint.js --eslintnode scripts/lint.js --prettiernode scripts/lint.js --sensitive-keywordsnode scripts/lint.js --setupnode scripts/lint.js --shellchecknode scripts/lint.js --yamllintpython agent_prototypes/scripts/parse_gcli_logs_experiment.py --experiment_dir=experiments/adhoc/gcli_temp_exp --gcs-...rev-parse -q --verify $TARGET_TAG)security create-keychain -p $KEYCHAIN_PASSWORD build.keychainsecurity default-keychain -s build.keychainsecurity import certificate.p12 -k build.keychain -P $P12_PASSWORD -T /usr/bin/codesignsecurity set-key-partition-list -S apple-tool:,apple: -s -k $KEYCHAIN_PASSWORD build.keychainsecurity unlock-keychain -p $KEYCHAIN_PASSWORD build.keychaintsx ./scripts/eval-coverage-cli.tstsx ./scripts/generate-keybindings-doc.tstsx ./scripts/generate-settings-doc.ts
Review prompts
most discussed first