← All skills
crawlberg
84 / 100 · Low risk
Fine to try. Some of what it can do is expected: a coding skill usually runs build and test commands.
By xberg-io/crawlberg (GitHub) · coding · 196 stars · scanned at commit 68904f5
Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.
Works with any agent that supports SKILL.md skills.
What this skill can do
Downloads and installs other software
This is disclosed by the author in the skill's SKILL.md or README.
Found in 16 places.
Show 13 more
- plugin/scripts/mcp-launch.sh, line 53
if npm_bin="$(cd "$scratch" && npx -y --package "$NPM_PKG@latest" --call "command -v ${BINARY_NAME%.exe}" 2>/dev/null)" && runs_ok "$npm_bin"; then - plugin/scripts/mcp-launch.sh, line 62
if want uvx && have uvx; then - plugin/scripts/mcp-launch.sh, line 63
log "probing uvx --from $PYPI_PKG $BINARY_NAME ..." - plugin/scripts/mcp-launch.sh, line 64
if uvx --from "$PYPI_PKG" "$BINARY_NAME" --version >/dev/null 2>&1; then - plugin/scripts/mcp-launch.sh, line 65
log "launching via uvx --from $PYPI_PKG $BINARY_NAME" - plugin/scripts/mcp-launch.sh, line 66
exec uvx --from "$PYPI_PKG" "$BINARY_NAME" "$@" - plugin/scripts/mcp-launch.sh, line 68
log "uvx $PYPI_PKG not available (no CLI entry point yet); falling through" - plugin/scripts/mcp-launch.sh, line 72
log "installing via 'brew install xberg-io/tap/crawlberg' ..." - plugin/scripts/mcp-launch.sh, line 73
if brew install xberg-io/tap/crawlberg >&2; then - plugin/scripts/mcp-launch.sh, line 78
log "brew install reported success but crawlberg is not on PATH; falling through" - plugin/scripts/mcp-launch.sh, line 80
log "brew install failed; falling through" - plugin/scripts/mcp-launch.sh, line 181
brew install xberg-io/tap/crawlberg - plugin/scripts/mcp-launch.sh, line 182
cargo install crawlberg-cli --features all
Runs commands on your computer
This is disclosed by the author in the skill's SKILL.md or README. It runs automatically when the plugin is installed. Expected for a coding skill.
Found in 11 places.
Show 8 more
- plugin/.ai-rulez/skills/crawlberg/SKILL.md, line 132
crawlberg crawl https://example.com \ - plugin/.ai-rulez/skills/crawlberg/SKILL.md, line 147
crawlberg map https://example.com --limit 500 --search docs --format markdown - plugin/.ai-rulez/skills/crawlberg/SKILL.md, line 157
crawlberg interact https://example.com \ - plugin/.claude-plugin/plugin.json, line 21
"command": "${CLAUDE_PLUGIN_ROOT}/scripts/mcp-launch.sh", - plugin/.cursor-plugin/plugin.json, line 23
"command": "./scripts/mcp-launch.sh", - plugin/.mcp.json, line 4
"command": "./scripts/mcp-launch.sh", - plugin/gemini-extension.json, line 8
"command": "${extensionPath}/scripts/mcp-launch.sh", - plugin/mcp.json, line 6
"command": "./scripts/mcp-launch.sh",
Connects to the internet
The author does not mention this.
Found in 2 places.
Other copies in this repository
xberg-io/crawlberg has 3 more folders with a skill named crawlberg. This page shows the lowest-scoring copy.
Install
Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.
if [ -e ~/.agents/skills/'crawlberg' ] || [ -L ~/.agents/skills/'crawlberg' ]; then echo 'A skill folder named crawlberg already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/xberg-io/crawlberg' "$d" && git -C "$d" checkout --quiet '68904f524aefe8a4dc684888eef5b0724f07b57a' -- 'plugin/.ai-rulez/skills/crawlberg' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugin/.ai-rulez/skills/crawlberg' ~/.agents/skills/'crawlberg' && rm -rf "$d"; fi
Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'crawlberg' ~/.claude/skills/'crawlberg' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.
Badge for your README
The badge for xberg-io/crawlberg shows the score of its lowest-scoring skill.
[](https://zalavijaysinh.github.io/skilltrust/repos/xberg-io/crawlberg/)
Score history
| Date | Version | Score |
|---|
| 2026-11-09 | 68904f5 | 84 |