← All skills
evaluation-lm-evaluation-harness
65 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
By davila7/claude-code-templates (GitHub) · coding · 33,256 stars · scanned at commit a6e6f93
Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.
Works with any agent that supports SKILL.md skills.
What this skill can do
Downloads and installs other software
The author does not mention this.
Found in 3 places.
Runs commands on your computer
The author does not mention this. Expected for a coding skill.
Found in 27 places.
Show 17 more
- cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 68
--tasks mmlu,gsm8k,hellaswag,truthfulqa,arc_challenge - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 75
lm_eval --model hf \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 84
lm_eval --model hf \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 92
lm_eval --model hf \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 102
lm_eval --model hf \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 167
CHECKPOINT_DIR=$1 - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 199
os.system(f"./eval_checkpoint.sh checkpoints step-{step}") - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 216
os.system(f"lm_eval --model hf --model_args pretrained={checkpoint_path} ...") - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 259
meta-llama/Llama-2-7b-hf - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 271
TASKS="mmlu,gsm8k,hellaswag,truthfulqa" - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 346
pip install vllm - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 352
lm_eval --model vllm \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 364
lm_eval --model hf \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 397
lm_eval --model vllm \ - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 403
--num_fewshot 0 # Instead of 5 - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 408
--tasks mmlu_stem # Only STEM subjects - cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness/SKILL.md, line 415
--batch_size 1 # Or --batch_size auto
and 7 more places
Can call paid AI services billed to you
The author does not mention this.
Found in 2 places.
Connects to the internet
The author does not mention this.
Found in 1 place.
Safer alternatives
Low-risk skills in the same category (coding) that look related. Check that one does what you need.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'evaluation-lm-evaluation-harness' ] || [ -L ~/.agents/skills/'evaluation-lm-evaluation-harness' ]; then echo 'A skill folder named evaluation-lm-evaluation-harness already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/davila7/claude-code-templates' "$d" && git -C "$d" checkout --quiet 'a6e6f93e9a4baaa6ff337aee5505bf5c2bae4ce6' -- 'cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness' && mkdir -p ~/.agents/skills && cp -R "$d"/'cli-tool/components/skills/ai-research/evaluation-lm-evaluation-harness' ~/.agents/skills/'evaluation-lm-evaluation-harness' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'evaluation-lm-evaluation-harness' ~/.claude/skills/'evaluation-lm-evaluation-harness' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for davila7/claude-code-templates shows the score of its lowest-scoring skill.

[](https://zalavijaysinh.github.io/skilltrust/repos/davila7/claude-code-templates/)
Score history
| Date | Version | Score |
|---|
| 2026-11-10 | a6e6f93 | 65 |
| 2026-11-08 | b086f26 | 65 |
| 2026-11-07 | 395f30e | 45 |