← All skills

web-scraper

75 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By LeoYeAI/agent-master-skills (GitHub) · coding · 2,186 stars · scanned at commit 8f88f9a

Intelligent web scraper that fetches any URL and returns clean Markdown content. Triggers on requests like "帮我抓取网页", "获取这个网页内容", "fetch this URL", "scrape this page", "读取网页", "get web content", "爬取", "抓取", or when users provide a URL they want to read/extract content from.

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 94 Low riskweb-search-scraper-api-skillbrowser-act/skills · 6,341 stars
• 90 Low riskweb-fetchDicklesworthstone/pi_agent_rust · 1,977 stars
• 92 Low riskweb-data-extractionnimadorostkar/Claude-Skills-collection · 34 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'web-scraper' ] || [ -L ~/.agents/skills/'web-scraper' ]; then echo 'A skill folder named web-scraper already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/LeoYeAI/agent-master-skills' "$d" && git -C "$d" checkout --quiet '8f88f9a0dd5a1075d4f0c7626f9d960844d57575' -- 'skills/web-scraper-pro' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills/web-scraper-pro' ~/.agents/skills/'web-scraper' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'web-scraper' ~/.claude/skills/'web-scraper' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for LeoYeAI/agent-master-skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/LeoYeAI/agent-master-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/LeoYeAI/agent-master-skills/)

Score history