SkillTrust

← All skills

web-scraping

100 / 100 · Low risk

Fine to try.

By bighardperson/computer-science-skills-collection (GitHub) · coding · 69 stars · scanned at commit e9f99fd

Extract structured information from websites using web_fetch for simple pages and browser automation for dynamic sites, login-gated flows, pagination, infinite scroll, or pages that require clicking/searching/filtering. Use when the user asks to scrape a site, collect listings, gather fields from many pages, monitor website changes, or turn webpage content into structured summaries/JSON/CSV.

Works with any agent that supports SKILL.md skills.

What this skill can do

We found nothing in the files we read that matches our rules. That does not prove the skill is safe: see the limits of static scanning.

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'web-scraping' ] || [ -L ~/.agents/skills/'web-scraping' ]; then echo 'A skill folder named web-scraping already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/bighardperson/computer-science-skills-collection' "$d" && git -C "$d" checkout --quiet 'e9f99fd7fed597ab4bb6864a5968d29e1db4fb42' -- 'skills/web-scraping' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/web-scraping' ~/.agents/skills/'web-scraping' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'web-scraping' ~/.claude/skills/'web-scraping' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for bighardperson/computer-science-skills-collection shows the score of its lowest-scoring skill.

SkillTrust badge for bighardperson/computer-science-skills-collection

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/bighardperson/computer-science-skills-collection.svg)](https://zalavijaysinh.github.io/skilltrust/repos/bighardperson/computer-science-skills-collection/)

Score history

DateVersionScore
2026-11-15e9f99fd100