← All skills

eval

67 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By ariadoss/superskills (GitHub) · coding · 12 stars · scanned at commit c7ec8d7

Measure whether a change to AI behavior actually improved things, the way a code change is measured: binary quality dimensions, a grid-sampled synthetic eval set with negative controls and a generated response side, a hand-labeled answer key, a judge written like code, then judge calibration with toolkit/calibrate.py (TP/TN/FP/FN counts, TPR, TNR, accuracy, precision, and a harsh/lenient bias reading) before gating on thresholds set before the run. Use when the user changed AI behavior (prompt …

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 100 Low riskeval-rubric-designermohitagw15856/pm-claude-skills · 1,539 stars
• 85 Low riskeval-llm-judgeCalibre-Labs/reforge-ai-evals · 95 stars
• 80 Low riskeval-designerNickCrew/Claude-Cortex · 68 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'eval' ] || [ -L ~/.agents/skills/'eval' ]; then echo 'A skill folder named eval already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/ariadoss/superskills' "$d" && git -C "$d" checkout --quiet 'c7ec8d78e5dc37484c2cfe90ab04de163d97dd41' -- 'skills/eval' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/eval' ~/.agents/skills/'eval' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'eval' ~/.claude/skills/'eval' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for ariadoss/superskills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/ariadoss/superskills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/ariadoss/superskills/)

Score history