md-webcrawl-mcp

What is this MCP

This is a Python-based Model Context Protocol (MCP) implementation designed as a web crawler for extracting and saving website content in markdown format.

How to use this MCP

The MCP can be installed via FastMCP and configured through environment variables. It provides commands like extract_content and scan_linked_content for crawling websites and creating content indexes.

What this MCP can be used for

This MCP is useful for content extraction, website structure mapping, batch processing of URLs, and creating searchable markdown archives of web content.