← All skills

set-up-ab-testing

100 / 100 · Low risk

Fine to try.

By ContextJet-ai/awesome-llm-observability (GitHub) · security · 48 stars · scanned at commit 5c10e28

Use this to test an LLM change (new prompt, new model, new retrieval) on real traffic before rolling it out to everyone. Trigger on "A/B test my prompt", "roll out a new model safely", "compare two prompts in production", "canary this change", "does this actually improve things for real users". Measure impact on real users, gated, before a full switch.

Works with any agent that supports SKILL.md skills.

What this skill can do

We found nothing in the files we read that matches our rules. That does not prove the skill is safe: see the limits of static scanning.

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'set-up-ab-testing' ] || [ -L ~/.agents/skills/'set-up-ab-testing' ]; then echo 'A skill folder named set-up-ab-testing already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/ContextJet-ai/awesome-llm-observability' "$d" && git -C "$d" checkout --quiet '5c10e286ca717b1dd556df7242957fee1efd9d4a' -- 'skills/set-up-ab-testing' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/set-up-ab-testing' ~/.agents/skills/'set-up-ab-testing' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'set-up-ab-testing' ~/.claude/skills/'set-up-ab-testing' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for ContextJet-ai/awesome-llm-observability shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/ContextJet-ai/awesome-llm-observability.svg)](https://zalavijaysinh.github.io/skilltrust/repos/ContextJet-ai/awesome-llm-observability/)

Score history