← All skills

OpenAI Evals Trace Grading

70 / 100 · Review before installing

Check before installing.

By PramodDutta/qaskills (GitHub) · coding · 248 stars · scanned at commit 8d6cf5f

Grade LLM and agent traces with OpenAI Evals - build datasets, configure string/python/model graders, run eval suites, and gate agent behavior changes in CI.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 100 Low riskllm-observability-evalsstanfish06/skillquarium · 12 stars
• 85 Low riskllm-evalskrzysztofsurdy/code-virtuoso · 27 stars
• 95 Low riskopenai-evalsmkurman/zorai · 327 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'openai-evals-trace-grading' ] || [ -L ~/.agents/skills/'openai-evals-trace-grading' ]; then echo 'A skill folder named openai-evals-trace-grading already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/PramodDutta/qaskills' "$d" && git -C "$d" checkout --quiet '8d6cf5f6db54e56d14bd0ea2c9cfe7a097fb07ee' -- 'seed-skills/openai-evals-trace-grading' && mkdir -p ~/.agents/skills && cp -R "$d"/'seed-skills/openai-evals-trace-grading' ~/.agents/skills/'openai-evals-trace-grading' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'openai-evals-trace-grading' ~/.claude/skills/'openai-evals-trace-grading' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for PramodDutta/qaskills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/PramodDutta/qaskills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/PramodDutta/qaskills/)

Score history