🚀 Production-ready MCP server for web search and content extraction
Core Features:
- Web search via local SearxNG instance with 70+ configurable engines
- Advanced web content extraction using Mozilla Readability
- Browser simulation with rotating user agents and realistic headers
- Rate limiting and responsible scraping practices (8 calls per session)
- Comprehensive error handling and detailed logging
- LM Studio integration with full MCP protocol compliance
Technical Highlights:
- JavaScript execution support via JSDOM for dynamic content
- Multi-layer content extraction with fallback strategies
- Retry logic for transient HTTP errors
- Binary content detection and proper handling
- Real-time log monitoring utility included
Author: Jay Leon (@manull)
License: MIT
Repository: https://github.com/manooll/webfetch-mcp
