Distributism logoDistributism

Search & Knowledge

Crawl4AI MCP

Crawl4AI MCP enables AI-powered web crawling with intelligent content extraction. Crawl websites at scale, extract structured data, convert pages to clean markdown, and generate RAG-ready content. Supports JavaScript rendering, proxy rotation, and anti-bot bypass for reliable data collection.

Stars

42.0k

Installs

310.0k

License

Apache-2.0

Kind

MCP

Trust evidence

Verified

Verified MCP — curated catalog entry with reviewed setup metadata.

  • Stars: 42.0k · catalog
  • Freshness: Updated 2026-02-05
  • Used in 0 known stacks (editorial graph may still apply)

Prerequisites

  • · Host app that loads MCP config (Cursor, Claude Desktop, etc.)
  • · Python 3 + pip

Reference command

{
  "mcpServers": {
    "crawl4ai": {
      "command": "python",
      "args": ["-m", "crawl4ai.mcp_server"]
    }
  }
}

Often stacked with