launching-evals

82 / 100 · Low risk

Fine to try. Some of what it can do is expected: a coding skill usually runs build and test commands.

By NVIDIA/Model-Optimizer (GitHub) · coding · 5,579 stars · scanned at commit 6713c5a

Run, monitor, analyze, and debug LLM evaluations via nemo-evaluator-launcher. Covers running evaluations, checking status and live progress, debugging failed runs, exporting artifacts and logs, and analyzing results. ALWAYS triggers on mentions of running evaluations, checking progress, debugging failed evals, analyzing or analysing runs or results, run directories or artifact paths on clusters, Slurm job issues, invocation IDs, or inspecting logs (client logs, server logs, SSH to cluster, tail…

Works with any agent that supports SKILL.md skills.

What this skill can do

Runs commands on your computer

This is disclosed by the author in the skill's SKILL.md or README. It runs automatically when the plugin is installed. Expected for a coding skill.

Found in 3 places.

plugins/modelopt/skills/launching-evals/SKILL.md, line 18uv run nemo-evaluator-launcher run --config <path.yaml>
plugins/modelopt/.claude-plugin/plugin.json, line 22"command": "uvx",
plugins/modelopt/.mcp.json, line 3"command": "uvx",

Downloads and installs other software

The author does not mention this. It runs automatically when the plugin is installed.

Found in 5 places.

plugins/modelopt/skills/launching-evals/SKILL.md, line 67- **HF cache requirement**: For configs with `HF_HUB_OFFLINE=1`, models must be pre-downloaded to the HF cache on each cluster before launching. **Before runnin
plugins/modelopt/skills/launching-evals/SKILL.md, line 70- **Auto-export git workaround**: The export container (`python:3.12-slim`) lacks `git`. When installing the launcher from a git URL, set `auto_export.launcher_
plugins/modelopt/skills/launching-evals/references/debug-failed-runs.md, line 102python3 -m venv .venv && source .venv/bin/activate && pip install -U huggingface_hub

Show 2 more

plugins/modelopt/.claude-plugin/plugin.json, line 22"command": "uvx",
plugins/modelopt/.mcp.json, line 3"command": "uvx",

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'launching-evals' ] || [ -L ~/.agents/skills/'launching-evals' ]; then echo 'A skill folder named launching-evals already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/NVIDIA/Model-Optimizer' "$d" && git -C "$d" checkout --quiet '6713c5a679fab80fdd9b688df01845f545c307b1' -- 'plugins/modelopt/skills/launching-evals' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/modelopt/skills/launching-evals' ~/.agents/skills/'launching-evals' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'launching-evals' ~/.claude/skills/'launching-evals' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for NVIDIA/Model-Optimizer shows the score of its lowest-scoring skill.

SkillTrust badge for NVIDIA/Model-Optimizer

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/NVIDIA/Model-Optimizer.svg)](https://zalavijaysinh.github.io/skilltrust/repos/NVIDIA/Model-Optimizer/)

Score history

Date	Version	Score
2026-11-10	`6713c5a`	82