← All skills

lighteval

95 / 100 · Low risk

Fine to try.

By mkurman/zorai (GitHub) · productivity · 327 stars · scanned at commit 8ea1fc3

All-in-one LLM evaluation toolkit (HuggingFace LightEval). 1000+ tasks with multi-backend support: Accelerate, vLLM, SGLang, Nanotron, TGI, LiteLLM, inference providers, and custom models. Sample-by-sample result exploration, custom task/metric creation. Used by HuggingFace's Leaderboard and Evals team. For pure GPT-style model eval, also consider lm-evaluation-harness.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'lighteval' ] || [ -L ~/.agents/skills/'lighteval' ]; then echo 'A skill folder named lighteval already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/mkurman/zorai' "$d" && git -C "$d" checkout --quiet '8ea1fc3ae126b6e103b8508bacd8f5aa60b6f4ad' -- 'skills/scientific-skills/lighteval' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/scientific-skills/lighteval' ~/.agents/skills/'lighteval' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'lighteval' ~/.claude/skills/'lighteval' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for mkurman/zorai shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/mkurman/zorai.svg)](https://zalavijaysinh.github.io/skilltrust/repos/mkurman/zorai/)

Score history