← All skills
arize-experiment
82 / 100 · Low risk
Fine to try. Some of what it can do is expected: a coding skill usually runs build and test commands.
By anubhavg-icpl/vibe (GitHub) · coding · 13 stars · scanned at commit d51e7ac
Creates, runs, and analyzes Arize experiments for evaluating and comparing model performance. Covers experiment CRUD, exporting runs, comparing results, and evaluation workflows using the ax CLI. Use when the user mentions create experiment, run experiment, compare models, model performance, evaluate AI, experiment results, benchmark, A/B test models, or measure accuracy.
Works with any agent that supports SKILL.md skills.
What this skill can do
Runs commands on your computer
This is disclosed by the author in the skill's SKILL.md or README. Expected for a coding skill.
Found in 79 places.
Show 17 more
- skills/ghcopilot-arize-experiment/SKILL.md, line 145
ax experiments create --name "gpt-4o-baseline" --dataset DATASET_NAME --space SPACE --file runs.json - skills/ghcopilot-arize-experiment/SKILL.md, line 165
echo '[{"example_id": "ex_001", "output": "Paris"}]' | ax experiments create --name "my-experiment" --dataset DATASET_NAME --space SPACE --file - - skills/ghcopilot-arize-experiment/SKILL.md, line 185
ax experiments delete NAME_OR_ID - skills/ghcopilot-arize-experiment/SKILL.md, line 239
ax datasets list --space SPACE - skills/ghcopilot-arize-experiment/SKILL.md, line 244
ax datasets export DATASET_NAME --space SPACE - skills/ghcopilot-arize-experiment/SKILL.md, line 249
ax datasets export DATASET_NAME --space SPACE --stdout | python3 infer.py > runs.json - skills/ghcopilot-arize-experiment/SKILL.md, line 321
python3 -c "import json; runs=json.load(open('runs.json')); print(f'{len(runs)} runs'); print(json.dumps(runs[0], indent=2))" - skills/ghcopilot-arize-experiment/SKILL.md, line 326
ax experiments create --name "gpt-4o-baseline" --dataset DATASET_NAME --space SPACE --file runs.json - skills/ghcopilot-arize-experiment/SKILL.md, line 334
ax experiments export "experiment-a" --dataset DATASET_NAME --space SPACE --stdout > a.json - skills/ghcopilot-arize-experiment/SKILL.md, line 340
jq '[.[] | .evaluations.correctness.score] | add / length' a.json - skills/ghcopilot-arize-experiment/SKILL.md, line 347
jq -s '.[0] as $a | .[1][] | . as $run | - skills/ghcopilot-arize-experiment/SKILL.md, line 357
jq '[.[] | .evaluations.correctness.label] | group_by(.) | map({label: .[0], count: length})' a.json - skills/ghcopilot-arize-experiment/SKILL.md, line 361
jq -s ' - skills/ghcopilot-arize-experiment/SKILL.md, line 381
ax experiments export EXPERIMENT_NAME --dataset DATASET_NAME --space SPACE --stdout | jq 'length' - .claude/settings.json, line 9
"command": "sh -c 'exec node \"${CLAUDE_PROJECT_DIR:-.}/.claude/helpers/hook-handler.cjs\" pre-bash'", - .claude/settings.json, line 19
"command": "sh -c 'exec node \"${CLAUDE_PROJECT_DIR:-.}/.claude/helpers/hook-handler.cjs\" pre-edit'", - .claude/settings.json, line 31
"command": "sh -c 'exec node \"${CLAUDE_PROJECT_DIR:-.}/.claude/helpers/hook-handler.cjs\" post-edit'",
and 59 more places
Downloads and installs other software
The author does not mention this. It runs automatically when the plugin is installed.
Found in 14 places.
Show 11 more
- skills/ghcopilot-arize-experiment/references/ax-setup.md, line 24
Upgrade: `uv tool install --force --reinstall arize-ax-cli`, `pipx upgrade arize-ax-cli`, or `pip install --upgrade arize-ax-cli` - .claude/settings.json, line 166
"Bash(npx @claude-flow*)", - .claude/settings.json, line 167
"Bash(npx claude-flow*)", - .mcp.json, line 4
"command": "npx", - hooks/cmods/README.md, line 96
npx eslint --fix "$FILE" 2>/dev/null - hooks/cmods/post-edit-format.sh, line 29
npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true - hooks/cmods/post-edit-format.sh, line 32
npx biome format --write "$FILE" 2>/dev/null && FORMATTED=true - hooks/cmods/post-edit-format.sh, line 80
npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true - hooks/cmods/post-edit-format.sh, line 86
npx prettier --write "$FILE" 2>/dev/null && FORMATTED=true - hooks/cmods/pre-commit-lint.sh, line 38
echo "$files" | xargs npx eslint --max-warnings 0 2>/dev/null - hooks/hooks.json, line 106
"command": "#!/bin/bash\n# Run TypeScript check after editing TS files\ninput=$(cat)\nfile_path=$(echo \"$input\" | jq -r '.tool_input.file_path // \"\"')\n\nif
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'arize-experiment' ] || [ -L ~/.agents/skills/'arize-experiment' ]; then echo 'A skill folder named arize-experiment already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/anubhavg-icpl/vibe' "$d" && git -C "$d" checkout --quiet 'd51e7ac9a34111cd2e63daed83c2198f91570050' -- 'skills/ghcopilot-arize-experiment' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/ghcopilot-arize-experiment' ~/.agents/skills/'arize-experiment' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'arize-experiment' ~/.claude/skills/'arize-experiment' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for anubhavg-icpl/vibe shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/anubhavg-icpl/vibe/)
Score history
| Date | Version | Score |
|---|
| 2026-11-08 | d51e7ac | 82 |