Brainfish AI open-sources Webcrawl, a keyless crawling API and MCP server

Brainfish AI has released Webcrawl, an open-source web crawling API and MCP server that lets agents such as Claude Code, Cursor and Codex search, scrape, map, crawl and monitor sites without an API key or account. The project is MIT licensed, and the same TypeScript engine runs both locally and in the hosted webcrawl.app cloud. A single command, npx webcrawl setup, registers the @webcrawl/mcp server and installs the webcrawl-anything Agent Skill; npx skills add brainfish-ai/webcrawl-anything installs all eight skills, including ticket, job, deal and real-estate watchers. Brainfish says the local version runs out of the box with zero keys using a built-in TLS-impersonated fetcher, document and media parsers, a BM25 plus semantic ranker and vertical extractors, and that users can move to the cloud with one command when they need managed browsers or sub-50ms global cache hits.

Generated from reports · updated 1 h ago

Not enough continuous observations yet to draw a trend.