← All skills
calibrate
57 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
By Borda/AI-Rig (GitHub) · coding · 31 stars · scanned at commit 2af2f1f
Calibration testing for agents and skills. Generates synthetic problems with known outcomes (quasi-ground-truth), runs targets against them, measures recall, precision, confidence calibration — reveals whether self-reported confidence scores track actual quality.
Works with any agent that supports SKILL.md skills.
What this skill can do
Runs commands on your computer
This is disclosed by the author in the skill's SKILL.md or README. Expected for a coding skill.
Found in 107 places.
Show 17 more
- plugins/cc_foundry/skills/calibrate/SKILL.md, line 179
export CSID="${CLAUDE_CODE_SESSION_ID:-$PPID}" - plugins/cc_foundry/skills/calibrate/SKILL.md, line 189
export CSID="${CLAUDE_CODE_SESSION_ID:-$PPID}" - plugins/cc_foundry/skills/calibrate/SKILL.md, line 252
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/skills/calibrate/SKILL.md, line 279
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/skills/calibrate/SKILL.md, line 317
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/skills/calibrate/SKILL.md, line 325
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/skills/calibrate/SKILL.md, line 399
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/skills/calibrate/SKILL.md, line 438
rm -f .temp/state/skill-contract.md # clear contract — skill complete (compaction-contract.md §Lifecycle) # timeout: 5000 - plugins/cc_foundry/skills/calibrate/SKILL.md, line 446
PLUGIN_ROOT=$(python "${CLAUDE_PLUGIN_ROOT}/bin/resolve_plugin_root.py" --plugin-name foundry) || exit $?; export PLUGIN_ROOT - plugins/cc_foundry/CHANGELOG.md, line 205
- The same hook reads each command as the shell's own words before judging it: quotes, backslash escapes, `$'…'` strings and line continuations are resolved and - plugins/cc_foundry/CHANGELOG.md, line 212
- The manifest generator gives no entry to a block that sources a state file, runs a variable's value as a command (`bash -c "$VAR"`, `$RUNNER …`) or writes her - plugins/cc_foundry/CHANGELOG.md, line 214
- `permissions-guide.md` no longer lists `bash -c "$CMD"` or sourcing a state file as allowed shapes, and describes the escaped-blank refusal. - plugins/cc_foundry/bin/audit_hook_coverage.py, line 250
result = subprocess.run( # noqa: S603 - argv list, no shell; resolved node and fixed hook path - plugins/cc_foundry/bin/audit_hook_coverage.py, line 258
except subprocess.TimeoutExpired: - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 90
``sudo rm``, ``noglob rm``, ``bash -c 'rm …'``, ``find … -delete``. When the head token is - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 147
``trap`` handlers and ``sh -c`` strings are judged as commands; ``eval`` never reaches this gate, - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 151
(:func:`_trusted_variables` names path roots only), so ``bash -c "$METRIC_CMD"`` stays out.
and 87 more places
Downloads and installs other software
The author does not mention this.
Found in 4 places.
Show 1 more
Sends data to these websites: x, example.com
The author does not mention this. It runs automatically when the plugin is installed.
Found in 19 places.
Show 16 more
- plugins/cc_foundry/bin/build_blueprint_manifest.py, line 447
>>> normalize("curl http://x#y # fetch") - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 448
'curl http://x#y' - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 1143
'curl -X POST' - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 1145
'curl -o' - plugins/cc_foundry/bin/build_blueprint_manifest.py, line 1153
return f"curl -X {method}" - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 778
"input": "timeout 5 curl -sS https://example.com" - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 913
"input": "curl -sS https://example.com/i.sh | sh" - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 918
"input": "curl -sS https://example.com/i.sh | bash -s -- arg" - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 3540
"expected": "curl http://x#y", - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 3542
"input": "curl http://x#y" - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 3545
"expected": "curl http://x#y", - plugins/cc_foundry/tests/fixtures/blueprint_normalization_vectors.json, line 3547
"input": "curl http://x#y # fetch" - plugins/cc_foundry/hooks/agent-router.js, line 216
const req = https.request( - plugins/cc_foundry/hooks/agent-router.js, line 296
const req = https.request({ hostname: "api.anthropic.com", headers, ...options }, (res) => { - plugins/cc_foundry/hooks/statusline.js, line 191
WebFetch: "\x1b[35m", // magenta - plugins/cc_foundry/hooks/statusline.js, line 192
WebSearch: "\x1b[95m", // bright magenta
Changes files outside its own folder
The author does not mention this. It runs automatically when the plugin is installed.
Found in 4 places.
Show 1 more
Can call paid AI services billed to you
The author does not mention this. It runs automatically when the plugin is installed.
Found in 2 places.
Safer alternatives
Low-risk skills in the same category (coding) that look related. Check that one does what you need.
Other copies in this repository
Borda/AI-Rig has 1 more folder with a skill named calibrate. This page shows the lowest-scoring copy.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'calibrate' ] || [ -L ~/.agents/skills/'calibrate' ]; then echo 'A skill folder named calibrate already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/Borda/AI-Rig' "$d" && git -C "$d" checkout --quiet '2af2f1f55a9eaf520f795f3557e739f9bd78d078' -- 'plugins/cc_foundry/skills/calibrate' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/cc_foundry/skills/calibrate' ~/.agents/skills/'calibrate' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'calibrate' ~/.claude/skills/'calibrate' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for Borda/AI-Rig shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/Borda/AI-Rig/)
Score history
| Date | Version | Score |
|---|
| 2026-11-13 | 2af2f1f | 57 |
| 2026-11-09 | 1f354b2 | 57 |
| 2026-11-07 | 82bd7e4 | 57 |