← All skills

scraping-skills

75 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a research skill usually looks things up on the internet.

By brycewang-stanford/Auto-Empirical-Research-Skills (GitHub) · research · 5,016 stars · scanned at commit 8684584

6 web scraping & data collection skills. Trigger: collecting web data, finding datasets, API access for research. Design: ethical scraping methods with rate limiting and data quality checks.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'scraping-skills' ] || [ -L ~/.agents/skills/'scraping-skills' ]; then echo 'A skill folder named scraping-skills already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/brycewang-stanford/Auto-Empirical-Research-Skills' "$d" && git -C "$d" checkout --quiet '8684584e7d1127940f018157d2c579974fae8f79' -- 'skills/43-wentorai-research-plugins/skills/tools/scraping' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/43-wentorai-research-plugins/skills/tools/scraping' ~/.agents/skills/'scraping-skills' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'scraping-skills' ~/.claude/skills/'scraping-skills' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for brycewang-stanford/Auto-Empirical-Research-Skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/brycewang-stanford/Auto-Empirical-Research-Skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/brycewang-stanford/Auto-Empirical-Research-Skills/)

Score history