arize-evaluator

82 / 100 · Low risk

Fine to try. Some of what it can do is expected: a coding skill usually runs build and test commands.

By anubhavg-icpl/vibe (GitHub) · coding · 13 stars · scanned at commit d51e7ac

Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.

Works with any agent that supports SKILL.md skills.

What this skill can do

Runs commands on your computer

This is disclosed by the author in the skill's SKILL.md or README. Expected for a coding skill.

Found in 87 places.

skills/ghcopilot-arize-evaluator/SKILL.md, line 103ax ai-integrations list --space SPACE
skills/ghcopilot-arize-evaluator/SKILL.md, line 118ax evaluators list --space SPACE
skills/ghcopilot-arize-evaluator/SKILL.md, line 191ax tasks list --space SPACE

Show 17 more

skills/ghcopilot-arize-evaluator/SKILL.md, line 272ax projects list --space SPACE -o json
skills/ghcopilot-arize-evaluator/SKILL.md, line 284ax spans export PROJECT --space SPACE -l 10 --days 30 --stdout
skills/ghcopilot-arize-evaluator/SKILL.md, line 300ax ai-integrations list --space SPACE -o json
skills/ghcopilot-arize-evaluator/SKILL.md, line 310ax evaluators create \
skills/ghcopilot-arize-evaluator/SKILL.md, line 345ax spans export PROJECT --space SPACE -l 5 --days 7 --stdout
skills/ghcopilot-arize-evaluator/SKILL.md, line 383ax tasks create \
skills/ghcopilot-arize-evaluator/SKILL.md, line 393ax tasks create \
skills/ghcopilot-arize-evaluator/SKILL.md, line 410ax spans export PROJECT --space SPACE -l 100 --days 1 --stdout # try last 24h first
skills/ghcopilot-arize-evaluator/SKILL.md, line 417ax tasks trigger-run TASK_ID \
skills/ghcopilot-arize-evaluator/SKILL.md, line 440ax datasets list --space SPACE
skills/ghcopilot-arize-evaluator/SKILL.md, line 453ax experiments export EXPERIMENT_NAME --dataset DATASET_NAME --space SPACE --stdout | python3 -c "import sys,json; runs=json.load(sys.stdin); print(json.dumps(r
skills/ghcopilot-arize-evaluator/SKILL.md, line 471ax experiments export EXPERIMENT_NAME --dataset DATASET_NAME --space SPACE --stdout | python3 -c "import sys,json; runs=json.load(sys.stdin); print(json.dumps(r
skills/ghcopilot-arize-evaluator/SKILL.md, line 480ax datasets export DATASET_NAME --space SPACE --stdout | python3 -c "import sys,json; ex=json.load(sys.stdin); print(json.dumps(ex[0], indent=2))"
skills/ghcopilot-arize-evaluator/SKILL.md, line 486ax tasks create \
skills/ghcopilot-arize-evaluator/SKILL.md, line 498ax tasks trigger-run TASK_ID \
skills/ghcopilot-arize-evaluator/SKILL.md, line 551--template 'Judge this: {input} → {output}'
skills/ghcopilot-arize-evaluator/SKILL.md, line 595ax ai-integrations list --space SPACE -o json

and 67 more places

Downloads and installs other software

The author does not mention this. It runs automatically when the plugin is installed.

Found in 13 places.

skills/ghcopilot-arize-evaluator/references/ax-setup.md, line 132. Install: `uv tool install arize-ax-cli` (preferred), `pipx install arize-ax-cli`, or `pip install arize-ax-cli`
skills/ghcopilot-arize-evaluator/references/ax-setup.md, line 193. Install: `pip install arize-ax-cli`
skills/ghcopilot-arize-evaluator/references/ax-setup.md, line 24Upgrade: `uv tool install --force --reinstall arize-ax-cli`, `pipx upgrade arize-ax-cli`, or `pip install --upgrade arize-ax-cli`

Show 10 more

.claude/settings.json, line 166"Bash(npx @claude-flow*)",
.claude/settings.json, line 167"Bash(npx claude-flow*)",
.mcp.json, line 4"command": "npx",
hooks/cmods/README.md, line 96npx eslint --fix "$FILE" 2>/dev/null
hooks/cmods/post-edit-format.sh, line 29npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true
hooks/cmods/post-edit-format.sh, line 32npx biome format --write "$FILE" 2>/dev/null && FORMATTED=true
hooks/cmods/post-edit-format.sh, line 80npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true
hooks/cmods/post-edit-format.sh, line 86npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true
hooks/cmods/pre-commit-lint.sh, line 38echo "$files" | xargs npx eslint --max-warnings 0 2>/dev/null
hooks/hooks.json, line 106"command": "#!/bin/bash\n# Run TypeScript check after editing TS files\ninput=$(cat)\nfile_path=$(echo \"$input\" | jq -r '.tool_input.file_path // \"\"')\n\nif

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'arize-evaluator' ] || [ -L ~/.agents/skills/'arize-evaluator' ]; then echo 'A skill folder named arize-evaluator already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/anubhavg-icpl/vibe' "$d" && git -C "$d" checkout --quiet 'd51e7ac9a34111cd2e63daed83c2198f91570050' -- 'skills/ghcopilot-arize-evaluator' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/ghcopilot-arize-evaluator' ~/.agents/skills/'arize-evaluator' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'arize-evaluator' ~/.claude/skills/'arize-evaluator' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for anubhavg-icpl/vibe shows the score of its lowest-scoring skill.

SkillTrust badge for anubhavg-icpl/vibe

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/anubhavg-icpl/vibe.svg)](https://zalavijaysinh.github.io/skilltrust/repos/anubhavg-icpl/vibe/)

Score history

Date	Version	Score
2026-11-08	`d51e7ac`	82