web-scraper
70 / 100 · Review before installing
Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.
Web scraping and content comprehension agent — multi-strategy extraction with cascade fallback, news detection, boilerplate removal, structured metadata, and LLM entity extraction
What this skill can do
Downloads and installs other software
Connects to the internet
Can call paid AI services billed to you
Runs commands on your computer
Safer alternatives
- 80 Low riskfirecrawl-scraper
- 90 Low riskweb-scraper
- 100 Low riskPeriodic Web Scraper with Redis Storage
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'web-scraper' ] || [ -L ~/.agents/skills/'web-scraper' ]; then echo 'A skill folder named web-scraper already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/bighardperson/computer-science-skills-collection' "$d" && git -C "$d" checkout --quiet 'e9f99fd7fed597ab4bb6864a5968d29e1db4fb42' -- 'skills/web-scraper' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/web-scraper' ~/.agents/skills/'web-scraper' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'web-scraper' ~/.claude/skills/'web-scraper' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
[](https://zalavijaysinh.github.io/skilltrust/repos/bighardperson/computer-science-skills-collection/)
Score history
| Date | Version | Score |
|---|---|---|
| 2026-11-15 | e9f99fd | 70 |
Also found in
- infometa/workbuddyskills/skills/web-scraper