MCP-Crawl4AI

Project Roadmap

Development timeline and future plans for MCP-Crawl4AI

Project Roadmap

This roadmap outlines the development trajectory for MCP-Crawl4AI. Timelines and features may evolve based on community feedback and priorities.

MCP-Crawl4AI follows a structured development approach with clear milestones. Below is the current roadmap including completed milestones and planned future work.

Version 0.1.0 -- Initial Release

April 2025
First public release with custom MCP SDK implementation

Key Features:

  • Basic MCP server with custom SDK implementation
  • Initial scrape/crawl capabilities
  • STDIO and HTTP/SSE transport support
  • Configuration via config.yaml
  • Initial documentation

Version 0.2.0 -- FastMCP v3 Rewrite

March 2026
Complete rewrite using FastMCP v3 and crawl4ai AsyncWebCrawler

Key Features:

  • Rewrote server with FastMCP v3
  • Lifespan-managed AsyncWebCrawler singleton
  • Canonical tool surface: scrape, crawl, close_session, get_artifact
  • 2 resources: config://server, crawl4ai://version
  • Dependencies reduced from 30+ to 2 (fastmcp, crawl4ai)
  • Python 3.13+ requirement
  • Tool annotations for MCP clients

Future Enhancements

TBD
Planned improvements and new capabilities

Key Features:

  • LLM-based extraction strategy support
  • Expanded resource types
  • Advanced caching options
  • Additional deep crawl strategies beyond BFS
  • Plugin system for custom extraction and processing

Community Contributions

MCP-Crawl4AI is an open-source project, and we welcome contributions from the community. Here are some ways you can contribute:

  • Feature Development: Implement new features or enhance existing ones
  • Bug Fixes: Help identify and fix bugs
  • Documentation: Improve documentation, add examples, and clarify usage
  • Testing: Write unit tests and integration tests
  • Feedback: Provide feedback on features, usability, and performance

For more information on how to contribute, please see our Contributing Guide.

Feature Requests

We maintain a backlog of feature requests and ideas for future development. If you have a feature request, please open an issue on our GitHub repository with the "feature request" label.

Want to prioritize specific features or collaborate on development? Reach out to us on GitHub.

Found an issue with this page? Submit a GitHub issue

On this page