crawlberg

xberg-io/crawlberg

SkillLoads cleanly

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across…

Scores
out of 100 · grade A

2026-08-13

Works

40% of the score

100/100

Loads cleanly: valid frontmatter, required fields present, no dangling references.

Maintained

25% of the score

100/100

no commits in the last 12 weeks

Adopted

20% of the score

30/100

153 stars on the source repo.

Documented

15% of the score

81/100

1,461 words with worked examples.

Loads cleanly. Every structural check Claude Code needs to register this passed. Last commit today.

Install

npx skills add xberg-io/crawlberg/crawlberg

What it says it does

Crawl, scrape, and convert websites to Markdown using the local crawlberg CLI and its MCP server. Use when the user wants to fetch a page, follow links across a domain, enumerate URLs, or drive a real browser. Covers installation, the subcommands (scrape, crawl, map, interact, batch-scrape, batch-crawl, download, citations, version, mcp, serve), output formats (JSON + Markdown), browser fallback, and when to prefer the MCP server over shelling out.

Every number above came out of reading the file and its repository. Nothing is a judgement call, nothing is a model’s opinion, and nothing can be paid for. The full method is published. Source last committed 2026-08-13.

Also in xberg-io/crawlberg

Other artifacts published from the same repository.
Artifact	What the check found	Type	Reach	Last commit
automating-the-browserxberg-io/crawlberg	clean	Skill	153 stars	today
headless-fallbackxberg-io/crawlberg	clean	Skill	153 stars	today
dev-cyclexberg-io/crawlberg	clean	Skill	153 stars	today
crawling-a-sitexberg-io/crawlberg	Missing files	Skill	153 stars	today
mapping-urlsxberg-io/crawlberg	Missing files	Skill	153 stars	today
serving-the-apixberg-io/crawlberg	Missing files	Skill	153 stars	today

Other research skills

Browse all

Same category, same type, ranked by score.
Artifact	What the check found	Category	Reach	Last commit
nextflow-developmentanthropics/knowledge-work-plugins	clean	Research	1,966 installs	today
single-cell-rna-qcanthropics/knowledge-work-plugins	clean	Research	1,995 installs	today
last30daysmvanhorn/last30days-skill	clean	Research	33,782 installs	today
scvi-toolsanthropics/knowledge-work-plugins	clean	Research	1,958 installs	today
plugin-creatoropenai/codex	clean	Research	112k stars	today
churn-preventioncoreyhaines31/marketingskills	clean	Research	92,159 installs	today

Put this measurement in your README

A badge carrying how many listings this index holds from the repository and how many pass every static structural check. It reads from this index every time somebody loads your page, so it changes when the measurement changes and there is nothing to keep up to date. Free, no account, and the value is not something you or we can set by hand.

[![SkillWorks](https://toolproof.kynth.studio/badge/skillworks/xberg-io/crawlberg.svg)](https://skillworks.kynth.studio/?q=xberg-io%2Fcrawlberg)

Would rather not hotlink us? Every badge is also served in shields.io’s endpoint schema, so shields renders the image and your readers never talk to our domain:

Published by Toolproof, the masthead over this index and eight others. The method behind the number is at toolproof.kynth.studio/methodology, and the whole thing is readable as JSON with no key at /api.