← All skills
plugin-eval
59 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
By melodic-software/claude-code-plugins (GitHub) · coding · 30 stars · scanned at commit 677e798
Guided practice around `claude plugin eval`, which scores a plugin's eval suite: preflight, no-spend validation, a cost estimate, the run, its validity verdict, and the with-versus-without delta. Use when: planning how a headless `claude -p` session launches eval runs, an eval run's delta, arm scores or validity verdict is in question, including whether it can be shared (load this before answering), 'run my plugin evals', 'plugin eval', 'evaluate this plugin', 'eval my skill', 'does my skill ac…
Works with any agent that supports SKILL.md skills.
What this skill can do
Runs commands on your computer
This is disclosed by the author in the skill's SKILL.md or README. Expected for a coding skill.
Found in 30 places.
Show 17 more
- plugins/evals/skills/plugin-eval/SKILL.md, line 330
python3 "${CLAUDE_PLUGIN_ROOT}/skills/plugin-eval/scripts/noise-report.py" results.json --threshold <the run's --threshold> --interval-method <method> --grader- - plugins/evals/skills/plugin-eval/SKILL.md, line 403
python3 "${CLAUDE_PLUGIN_ROOT}/skills/plugin-eval/scripts/calibrate-judge.py" build --suite <eval-dir> --out <empty dir outside the repo> - plugins/evals/skills/plugin-eval/scripts/convert-evals-json.py, line 39
bash -c, xargs) but not - plugins/evals/skills/plugin-eval/scripts/convert-evals-json.py, line 485
{"answer": bash("bash -c '%s'" % command), "why": "run through bash -c"}, - plugins/evals/skills/plugin-eval/scripts/docker-links.py, line 67
os.execvp(sys.argv[2], sys.argv[2:]) - plugins/evals/skills/plugin-eval/scripts/docker-links.py, line 303
children: "list[subprocess.Popen[bytes]]" = [] - plugins/evals/skills/plugin-eval/scripts/docker-links.py, line 324
subprocess.Popen( - plugins/evals/skills/plugin-eval/scripts/test_calibrate_judge.py, line 58
return subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_calibrate_judge.py, line 133
proc = subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 76
return subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 126
checked = subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 385
checked = subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 570
"bash -c 'npm install -g ctx7@latest'", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 571
'bash -c "npm install -g ctx7@latest"', - plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 59
return subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 71
out = subprocess.run( - plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 143
proc = subprocess.Popen(
and 10 more places
Changes files outside its own folder
The author does not mention this.
Found in 13 places.
Show 10 more
- plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 120
result = self.wrapped('grep "^SigIgn:" /proc/self/status > "$HOME/sigign"') - plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 139
f'find "$HOME/.docker" -mindepth 1 -type l > "$HOME/links-{name}"' - plugins/evals/skills/plugin-eval/scripts/test_docker_links.py, line 140
f' && echo $$ > "$HOME/started-{name}"' - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 779
"mkdir: cannot create directory \u2018/usr/share/x\u2019: Read-only file system"), - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 784
" mkdir '/usr/lib/node_modules/x'"), - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 1467
([("Bash", {"command": "cp %s /etc/hosts" % lease})], None), - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 1553
"rm -f '%s' && echo removed $HOME" % spool, - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 1563
"rm -f '%s'; echo x > /etc/f" % spool, - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 1564
"rm -f '%s'; echo x>/etc/f" % spool, - plugins/evals/skills/plugin-eval/scripts/test_run_validity.py, line 1565
"rm -f '%s'; echo $(cat /etc/passwd)" % spool,
Sends data to these websites: xtomd.com
This is disclosed by the author in the skill's SKILL.md or README.
Found in 1 place.
Downloads and installs other software
The author does not mention this.
Found in 19 places.
Show 16 more
- plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 553
self.assertTrue(grade("expectation-2", "echo 'npm install -g ctx7@latest'")) - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 554
self.assertFalse(grade("expectation-2", "npm install -g ctx7@latest")) - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 555
self.assertFalse(grade("expectation-2", "cd /w && npm install -g ctx7@latest")) - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 560
"alpha", ["Does not run `npm install -g ctx7@latest` itself"] - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 568
"sudo npm install -g ctx7@latest", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 569
"env CI=1 npm install -g ctx7@latest", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 570
"bash -c 'npm install -g ctx7@latest'", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 571
'bash -c "npm install -g ctx7@latest"', - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 572
"time npm install -g ctx7@latest", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 573
"(npm install -g ctx7@latest)", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 574
"echo y | xargs npm install -g ctx7@latest", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 575
"/usr/bin/npm install -g ctx7@latest", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 580
"echo 'npm install -g ctx7@latest'", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 581
"cat notes.txt; grep 'npm install -g ctx7@latest' README.md", - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 583
'rg -n "npm install -g ctx7@latest" docs/', - plugins/evals/skills/plugin-eval/scripts/test_convert_evals_json.py, line 584
"git grep 'npm install -g ctx7@latest'",
Reads your saved credentials, such as SSH keys or .env files
This is disclosed by the author in the skill's SKILL.md or README.
Found in 4 places.
Show 1 more
Safer alternatives
Low-risk skills in the same category (coding) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'plugin-eval' ] || [ -L ~/.agents/skills/'plugin-eval' ]; then echo 'A skill folder named plugin-eval already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/melodic-software/claude-code-plugins' "$d" && git -C "$d" checkout --quiet '677e7988f432dacb5e2d4df2b124f96da8e8f9f3' -- 'plugins/evals/skills/plugin-eval' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/evals/skills/plugin-eval' ~/.agents/skills/'plugin-eval' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'plugin-eval' ~/.claude/skills/'plugin-eval' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for melodic-software/claude-code-plugins shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/melodic-software/claude-code-plugins/)
Score history
| Date | Version | Score |
|---|
| 2026-11-09 | 677e798 | 59 |
| 2026-11-07 | 81c7244 | 87 |