← All skills

01-auto-arena

70 / 100 · Review before installing

Check before installing.

By agentscope-ai/OpenJudge (GitHub) · data · 1,101 stars · scanned at commit 03c4445

Automatically evaluate and compare multiple AI models or agents without pre-existing test data. Generates test queries from a task description, collects responses from all target endpoints, auto-generates evaluation rubrics, runs pairwise comparisons via a judge model, and produces win-rate rankings with reports and charts. Supports checkpoint resume, incremental endpoint addition, and judge model hot-swap. Use when the user asks to compare, benchmark, or rank multiple models or agents on a cus…

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (data) that look related. Check that one does what you need.

• 100 Low riskResumable CSV Cell Iterator with Auto-InterruptionECNU-ICALK/AutoSkill · 613 stars
• 80 Low riskarenachmonitor/chmonitor · 304 stars
• 100 Low riskauto-deletion-workflowonfire7777/universal-ai-skills-library · 17 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'01-auto-arena' ] || [ -L ~/.agents/skills/'01-auto-arena' ]; then echo 'A skill folder named 01-auto-arena already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/agentscope-ai/OpenJudge' "$d" && git -C "$d" checkout --quiet '03c444567d5bb10429b10f4d2ad9df493b0edcc9' -- 'skills/arena-eval/01-auto-arena' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/arena-eval/01-auto-arena' ~/.agents/skills/'01-auto-arena' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'01-auto-arena' ~/.claude/skills/'01-auto-arena' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for agentscope-ai/OpenJudge shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/agentscope-ai/OpenJudge.svg)](https://zalavijaysinh.github.io/skilltrust/repos/agentscope-ai/OpenJudge/)

Score history