← All skills

langsmith-evaluator

77 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By jackjin1997/ClawForge (GitHub) · coding · 13 stars · scanned at commit 896286f

Use this skill for ANY question about CREATING evaluators. Covers creating custom metrics, LLM as Judge evaluators, code-based evaluators, and uploading evaluation logic to LangSmith. Does NOT cover RUNNING evaluations.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 82 Low riskarize-evaluatorboshi-xixixi/TraeSkill · 283 stars
• 85 Low risklangsmithenuno/claude-command-and-control · 17 stars
• 80 Low risklangsmith-expertanubhavg-icpl/vibe · 13 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'langsmith-evaluator' ] || [ -L ~/.agents/skills/'langsmith-evaluator' ]; then echo 'A skill folder named langsmith-evaluator already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/jackjin1997/ClawForge' "$d" && git -C "$d" checkout --quiet '896286f3d171429c9e8553fae87ddae90c8265c8' -- 'skills/langsmith-evaluator' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/langsmith-evaluator' ~/.agents/skills/'langsmith-evaluator' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'langsmith-evaluator' ~/.claude/skills/'langsmith-evaluator' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for jackjin1997/ClawForge shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/jackjin1997/ClawForge.svg)](https://zalavijaysinh.github.io/skilltrust/repos/jackjin1997/ClawForge/)

Score history