← All skills

tavily-crawl

75 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By EthanYoQ/Skill-hub (GitHub) · coding · 11 stars · scanned at commit 1e73907

Crawl websites and extract content from multiple pages via the Tavily CLI. Use this skill when the user wants to crawl a site, download documentation, extract an entire docs section, bulk-extract pages, save a site as local markdown files, or says "crawl", "get all the pages", "download the docs", "extract everything under /docs", "bulk extract", or needs content from many pages on the same domain. Supports depth/breadth control, path filtering, semantic instructions, and saving each page as a …

Works with any agent that supports SKILL.md skills.

What this skill can do

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

• 95 Low riskfirecrawl-crawlhashgraph-online/awesome-codex-plugins · 1,573 stars
• 95 Low riskwebcrawler-deep-crawlbrowser-act/skills · 6,350 stars
• 92 Low riskcf-crawldavila7/claude-code-templates · 33,523 stars

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'tavily-crawl' ] || [ -L ~/.agents/skills/'tavily-crawl' ]; then echo 'A skill folder named tavily-crawl already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/EthanYoQ/Skill-hub' "$d" && git -C "$d" checkout --quiet '1e7390741dffd3d5041fca4ebc056071ee3ba137' -- 'archives/user-installed-skills/tavily-crawl/43d44e3856574444/tavily-crawl' && mkdir -p ~/.agents/skills && cp -R "$d"/'archives/user-installed-skills/tavily-crawl/43d44e3856574444/tavily-crawl' ~/.agents/skills/'tavily-crawl' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'tavily-crawl' ~/.claude/skills/'tavily-crawl' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for EthanYoQ/Skill-hub shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/EthanYoQ/Skill-hub.svg)](https://zalavijaysinh.github.io/skilltrust/repos/EthanYoQ/Skill-hub/)

Score history