← All skills

evaluating-llms-harness

65 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By hashgraph-online/awesome-codex-plugins (GitHub) · coding · 1,573 stars · scanned at commit 70b6a3a

Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 90 Low risklm-evaluation-harnessmkurman/zorai · 327 stars
• 80 Low riskevaluation-bigcode-evaluation-harnessdavila7/claude-code-templates · 33,523 stars
• 80 Low riskevaluating-code-modelsOrchestra-Research/AI-Research-SKILLs · 14,447 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'evaluating-llms-harness' ] || [ -L ~/.agents/skills/'evaluating-llms-harness' ]; then echo 'A skill folder named evaluating-llms-harness already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/hashgraph-online/awesome-codex-plugins' "$d" && git -C "$d" checkout --quiet '70b6a3a3a7c774671e45af646306e1448baf0511' -- 'plugins/KalarisLabs/research-agent-skills/skills/evaluating-llms-harness' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/KalarisLabs/research-agent-skills/skills/evaluating-llms-harness' ~/.agents/skills/'evaluating-llms-harness' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'evaluating-llms-harness' ~/.claude/skills/'evaluating-llms-harness' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for hashgraph-online/awesome-codex-plugins shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/hashgraph-online/awesome-codex-plugins.svg)](https://zalavijaysinh.github.io/skilltrust/repos/hashgraph-online/awesome-codex-plugins/)

Score history