← All skills

phack-eval-harness

95 / 100 · Low risk

Fine to try.

By brycewang-stanford/Auto-Empirical-Research-Skills (GitHub) · research · 5,016 stars · scanned at commit 8684584

Run and score the agent p-hacking benchmark. Composes prompt cells across research framing and significance pressure, drives an agent through them, and scores each run into a P-Hacking Intensity index decomposed into selection, search breadth, estimate inflation, inference gap, pre-registration departure and disclosure. Use when benchmarking whether an AI agent p-hacks, comparing models or tool stacks on statistical integrity, scoring a single agent analysis run, or designing an evaluation of s…

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'phack-eval-harness' ] || [ -L ~/.agents/skills/'phack-eval-harness' ]; then echo 'A skill folder named phack-eval-harness already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/brycewang-stanford/Auto-Empirical-Research-Skills' "$d" && git -C "$d" checkout --quiet '8684584e7d1127940f018157d2c579974fae8f79' -- 'skills/73-brycewang-p-hacking-skills/skills/08-eval-harness' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/73-brycewang-p-hacking-skills/skills/08-eval-harness' ~/.agents/skills/'phack-eval-harness' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'phack-eval-harness' ~/.claude/skills/'phack-eval-harness' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for brycewang-stanford/Auto-Empirical-Research-Skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/brycewang-stanford/Auto-Empirical-Research-Skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/brycewang-stanford/Auto-Empirical-Research-Skills/)

Score history