Search: crawling
Search MCP servers and agent skills by name, description, category or topic — 6 results.
exa-labs/exa-mcp-server
A Model Context Protocol (MCP) server lets AI assistants like Claude use the Exa AI Search API for web searches. This setup allows AI models to get real-time web information in a safe and controlled way.
just-every/mcp-read-website-fast
Fast, token-efficient web content extraction for AI agents - converts websites to clean Markdown while preserving links. Features Mozilla Readability, smart caching, polite crawling with robots.txt support, and concurrent fetching.
olostep/olostep-mcp-server
Web scraping, crawling, and search API. Extract content in Markdown/JSON, batch process 10k URLs, and get AI-powered answers with citations.
Rererr/amenbo
Japanese-web-native web fetching optimized for low target-site impact and token efficiency. Outline-first progressive disclosure, Shift_JIS/EUC-JP mojibake handling, PDF/CSV extraction, and polite crawling (robots.txt, rate limits, honest User-Agent). Install via `npx -y amenbo`.
andyliszewski/webcrawl-mcp
Local-first web scraping, search, and crawling. Static pages extracted locally via trafilatura; optional Firecrawl fallback only when JS rendering is needed. Four tools: scrape, search (DuckDuckGo), map, crawl.