← All skills

01-graders-and-pipeline

80 / 100 · Low risk

Fine to try.

By agentscope-ai/OpenJudge (GitHub) · design · 1,101 stars · scanned at commit 03c4445

Build custom LLM evaluation pipelines using the OpenJudge framework. Covers selecting and configuring graders (LLM-based, function-based, agentic), running batch evaluations with GradingRunner, combining scores with aggregators, applying evaluation strategies (voting, average), auto-generating graders from data, and analyzing results (pairwise win rates, statistics, validation metrics). Use when the user wants to evaluate LLM outputs, compare multiple models, design scoring criteria, or build a…

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'01-graders-and-pipeline' ] || [ -L ~/.agents/skills/'01-graders-and-pipeline' ]; then echo 'A skill folder named 01-graders-and-pipeline already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/agentscope-ai/OpenJudge' "$d" && git -C "$d" checkout --quiet '03c444567d5bb10429b10f4d2ad9df493b0edcc9' -- 'skills/openjudge-core/01-graders-and-pipeline' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/openjudge-core/01-graders-and-pipeline' ~/.agents/skills/'01-graders-and-pipeline' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'01-graders-and-pipeline' ~/.claude/skills/'01-graders-and-pipeline' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for agentscope-ai/OpenJudge shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/agentscope-ai/OpenJudge.svg)](https://zalavijaysinh.github.io/skilltrust/repos/agentscope-ai/OpenJudge/)

Score history