← All skills

site-crawl

95 / 100 · Low risk

Fine to try.

By beyonai/ByClaw (GitHub) · writing · 60 stars · scanned at commit 97eef80

Use when the user asks to crawl a product documentation site or a batch of pages for a product report. Do not use for one known URL; use the normal single-page collection route instead.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'site-crawl' ] || [ -L ~/.agents/skills/'site-crawl' ]; then echo 'A skill folder named site-crawl already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/beyonai/ByClaw' "$d" && git -C "$d" checkout --quiet '97eef801b981038485ccf5774c9a6c4c946e796c' -- 'middleware/builtin/skills/knowledge-collection/references/site-crawl' && mkdir -p ~/.agents/skills && cp -R "$d"/'middleware/builtin/skills/knowledge-collection/references/site-crawl' ~/.agents/skills/'site-crawl' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'site-crawl' ~/.claude/skills/'site-crawl' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for beyonai/ByClaw shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/beyonai/ByClaw.svg)](https://zalavijaysinh.github.io/skilltrust/repos/beyonai/ByClaw/)

Score history