crawlberg-mapping-urls

77 / 100 · Review before installing

Check before installing. Some of what it can do is expected: a coding skill usually runs build and test commands.

By xberg-io/crawlberg (GitHub) · coding · 196 stars · scanned at commit 68904f5

Use when the user wants the list of URLs on a site rather than the page content — sitemap analysis, link planning, or seeding another tool. Covers `crawlberg map URL` with `--limit`, `--search`, robots, output, and how it differs from a full crawl.

Works with any agent that supports SKILL.md skills.

What this skill can do

Runs commands on your computer

This is disclosed by the author in the skill's SKILL.md or README. It runs automatically when the plugin is installed. Expected for a coding skill.

Found in 9 places.

plugin/.ai-rulez/skills/crawlberg-mapping-urls/SKILL.md, line 22crawlberg map https://example.com --limit 500 --search docs --format markdown
plugin/.ai-rulez/skills/crawlberg-mapping-urls/SKILL.md, line 74crawlberg map https://example.com --format json | jq -r '.urls[].url'
plugin/.ai-rulez/skills/crawlberg-mapping-urls/SKILL.md, line 82crawlberg map https://example.com --search /docs/ --format markdown > urls.txt

Show 6 more

plugin/.ai-rulez/skills/crawlberg-mapping-urls/SKILL.md, line 90crawlberg map https://unknown.example --respect-robots-txt --limit 200
plugin/.claude-plugin/plugin.json, line 21"command": "${CLAUDE_PLUGIN_ROOT}/scripts/mcp-launch.sh",
plugin/.cursor-plugin/plugin.json, line 23"command": "./scripts/mcp-launch.sh",
plugin/.mcp.json, line 4"command": "./scripts/mcp-launch.sh",
plugin/gemini-extension.json, line 8"command": "${extensionPath}/scripts/mcp-launch.sh",
plugin/mcp.json, line 6"command": "./scripts/mcp-launch.sh",

Downloads and installs other software

The author does not mention this.

Found in 14 places.

plugin/scripts/mcp-launch.sh, line 15auto | npx | uvx | brew | download) ;;
plugin/scripts/mcp-launch.sh, line 53if npm_bin="$(cd "$scratch" && npx -y --package "$NPM_PKG@latest" --call "command -v ${BINARY_NAME%.exe}" 2>/dev/null)" && runs_ok "$npm_bin"; then
plugin/scripts/mcp-launch.sh, line 62if want uvx && have uvx; then

Show 11 more

plugin/scripts/mcp-launch.sh, line 63log "probing uvx --from $PYPI_PKG $BINARY_NAME ..."
plugin/scripts/mcp-launch.sh, line 64if uvx --from "$PYPI_PKG" "$BINARY_NAME" --version >/dev/null 2>&1; then
plugin/scripts/mcp-launch.sh, line 65log "launching via uvx --from $PYPI_PKG $BINARY_NAME"
plugin/scripts/mcp-launch.sh, line 66exec uvx --from "$PYPI_PKG" "$BINARY_NAME" "$@"
plugin/scripts/mcp-launch.sh, line 68log "uvx $PYPI_PKG not available (no CLI entry point yet); falling through"
plugin/scripts/mcp-launch.sh, line 72log "installing via 'brew install xberg-io/tap/crawlberg' ..."
plugin/scripts/mcp-launch.sh, line 73if brew install xberg-io/tap/crawlberg >&2; then
plugin/scripts/mcp-launch.sh, line 78log "brew install reported success but crawlberg is not on PATH; falling through"
plugin/scripts/mcp-launch.sh, line 80log "brew install failed; falling through"
plugin/scripts/mcp-launch.sh, line 181brew install xberg-io/tap/crawlberg
plugin/scripts/mcp-launch.sh, line 182cargo install crawlberg-cli --features all

Connects to the internet

The author does not mention this.

Found in 2 places.

plugin/scripts/mcp-launch.sh, line 124fetch() { curl -fsSL --retry 3 -o "$2" "$1"; }
plugin/scripts/mcp-launch.sh, line 126fetch() { wget -q -O "$2" "$1"; }

Safer alternatives

Low-risk skills in the same category (coding) that look related. Check that one does what you need.

Other copies in this repository

xberg-io/crawlberg has 3 more folders with a skill named crawlberg-mapping-urls. This page shows the lowest-scoring copy.

plugin/.hermes/package/src/crawlberg_hermes_plugin/skills/crawlberg-mapping-urls 77/100 · Review before installing
skills/crawlberg-mapping-urls 97/100 · Low risk
plugin/.cursor-plugin/skills/crawlberg-mapping-urls 97/100 · Low risk

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'crawlberg-mapping-urls' ] || [ -L ~/.agents/skills/'crawlberg-mapping-urls' ]; then echo 'A skill folder named crawlberg-mapping-urls already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/xberg-io/crawlberg' "$d" && git -C "$d" checkout --quiet '68904f524aefe8a4dc684888eef5b0724f07b57a' -- 'plugin/.ai-rulez/skills/crawlberg-mapping-urls' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugin/.ai-rulez/skills/crawlberg-mapping-urls' ~/.agents/skills/'crawlberg-mapping-urls' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'crawlberg-mapping-urls' ~/.claude/skills/'crawlberg-mapping-urls' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for xberg-io/crawlberg shows the score of its lowest-scoring skill.

SkillTrust badge for xberg-io/crawlberg

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/xberg-io/crawlberg.svg)](https://zalavijaysinh.github.io/skilltrust/repos/xberg-io/crawlberg/)

Score history

Date	Version	Score
2026-11-09	`68904f5`	77