← All skills

firecrawl-crawl

95 / 100 · Low risk

Fine to try.

By rifuki/dotfiles (GitHub) · writing · 12 stars · scanned at commit 444b343

Bulk extract content from an entire website or site section. Use this skill when the user wants to crawl a site, extract all pages from a docs section, bulk-scrape multiple pages following links, or says "crawl", "get all the pages", "extract everything under /docs", "bulk extract", or needs content from many pages on the same site. Handles depth limits, path filtering, and concurrent extraction.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'firecrawl-crawl' ] || [ -L ~/.agents/skills/'firecrawl-crawl' ]; then echo 'A skill folder named firecrawl-crawl already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/rifuki/dotfiles' "$d" && git -C "$d" checkout --quiet '444b3433d7f135ac5dc5bf3794196b7c5ccab918' -- 'shared/.agents/skills/firecrawl-crawl' && mkdir -p ~/.agents/skills && cp -R "$d"/'shared/.agents/skills/firecrawl-crawl' ~/.agents/skills/'firecrawl-crawl' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'firecrawl-crawl' ~/.claude/skills/'firecrawl-crawl' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for rifuki/dotfiles shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/rifuki/dotfiles.svg)](https://zalavijaysinh.github.io/skilltrust/repos/rifuki/dotfiles/)

Score history