← All skills

crawlberg

89 / 100 · Low risk

Fine to try. Some of what it can do is expected: a coding skill usually runs build and test commands.

By hashgraph-online/awesome-codex-plugins (GitHub) · coding · 1,563 stars · scanned at commit 6d2e63f

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

Works with any agent that supports SKILL.md skills.

What this skill can do

Install

Paste this into your terminal. It downloads exactly the version we scanned, not whatever is newest.

if [ -e ~/.agents/skills/'crawlberg' ] || [ -L ~/.agents/skills/'crawlberg' ]; then echo 'A skill folder named crawlberg already exists — not replacing it' >&2; false; else d=$(mktemp -d) && git clone --quiet --filter=blob:none --no-checkout 'https://github.com/hashgraph-online/awesome-codex-plugins' "$d" && git -C "$d" checkout --quiet '6d2e63f73f845eb5dd94c1debba627d4b6e32fba' -- 'plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/crawlberg' && mkdir -p ~/.agents/skills && cp -R "$d"/'plugins/kreuzberg-dev/plugins/plugins/crawlberg/skills/crawlberg' ~/.agents/skills/'crawlberg' && rm -rf "$d"; fi

Codex reads ~/.agents/skills directly. For Claude Code, Cursor, Copilot, Gemini CLI, Antigravity or OpenCode, also link it. For Claude Code: ln -s ~/.agents/skills/'crawlberg' ~/.claude/skills/'crawlberg' (other agents: ~/.cursor/skills, ~/.copilot/skills, ~/.gemini/skills, ~/.gemini/config/skills, ~/.config/opencode/skills). Or install through the finder skill, which does both.

Badge for your README

The badge for hashgraph-online/awesome-codex-plugins shows the score of its lowest-scoring skill.

[![SkillTrust](https://zalavijaysinh.github.io/skilltrust/badges/hashgraph-online/awesome-codex-plugins.svg)](https://zalavijaysinh.github.io/skilltrust/repos/hashgraph-online/awesome-codex-plugins/)

Score history