Web Crawler

Configurable web crawler that extracts structured content from websites while respecting robots.txt rules and offering customizable settings for depth, delay, and concurrency.

Report

Similar MCPs

View All

Integrates with Google Workspace to enable file management in Drive and data manipulation in Sheets, facilitating document-centric tasks and data analysis within the Google ecosystem.

Integrates with Huntress endpoint protection services to manage cybersecurity operations, threat analysis, and automated reporting.

Fetches website content using Python and MCP, enabling web scraping and content analysis tasks

Interact with Neo4j graph databases to query, analyze, and manipulate data.

MatterAI MCP server for Cursor, Windsurf, and other AI clients that enhances your development workflow. MatterAI provides AI Code Reviews within your IDE as well as Github. Includes features like: - Code review tools - Get comprehensive code reviews for individual files or full git diffs - Implementation planning - Generate detailed implementation plans for AI agents - Pull request generation - Create pull requests with auto-generated titles and descriptions

Integrates with Govee smart lighting devices to enable natural language control of brightness, color, and power settings for home automation and ambient lighting scenarios.

  • tmp_val__name__