← All skills

headless-web-scraping

82 / 100 · Low risk

Fine to try. Some of what it can do is expected: a data skill usually connects to databases or online services with your credentials.

By roohe/agentic-super-skills (GitHub) · data · 10 stars · scanned at commit f483e54

Extract data from web pages using the scrapling Python library — select the appropriate fetcher tier (HTTP, stealth Chromium, or full browser automation) based on target site defenses, configure headless browsing, and extract structured data with CSS selectors. Use when WebFetch is insufficient for JS-rendered pages, anti-bot-protected sites, or structured multi-element extraction requiring DOM traversal.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'headless-web-scraping' ] || [ -L ~/.agents/skills/'headless-web-scraping' ]; then echo 'A skill folder named headless-web-scraping already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/roohe/agentic-super-skills' "$d" && git -C "$d" checkout --quiet 'f483e54f3ad5f202a77d45f2e57f8d970b71195f' -- 'skills_library/headless-web-scraping' && mkdir -p ~/.agents/skills && cp -R "$d"/'skills_library/headless-web-scraping' ~/.agents/skills/'headless-web-scraping' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'headless-web-scraping' ~/.claude/skills/'headless-web-scraping' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for roohe/agentic-super-skills shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/roohe/agentic-super-skills.svg)](https://zalavijaysinh.github.io/skilltrust/repos/roohe/agentic-super-skills/)

Score history