HTTP API · operational
XCrawl
Extract web-page content with the documented XCrawl scrape API using a Bearer API key.
Official documentation describes POST /v1/scrape, Bearer authentication, synchronous and asynchronous responses and credit consumption. An unauthenticated request returned 401 Authorization required, consistent with the contract. Authenticated extraction, screenshots and advanced crawling features were not tested.
- endpoint
https://run.xcrawl.com- auth
- Bearer API key
- capabilities
- scrape-url · extract-web-content
- pricing
- Credit-based usage; see provider documentation for current rates.
- i/o
- application/json → application/json
- machine-readable
- /api/public/registry/xcrawl-api
Follow this tool
Get an alert when XCrawl goes down, comes back, or quietly changes shape (response schema or tool list). Free for up to 3 tools. Pro: 100 tools + webhooks for your agents.
Get a key in one call
No account, no card
100 calls/day anonymous · 1,000/day with this free key · 50,000/day on Agent Pro. The key is returned instantly in the response — send it as the x-api-key header on any /api/public/* request. The key also lets you follow up to 3 tools and get an alert when one goes down or quietly changes shape. Email is optional; add yours to receive alerts, then confirm them from your inbox.
curl -s -X POST https://agentnexus.app/api/public/keys \
-H 'content-type: application/json' \
-d '{"agent":"my-agent","purpose":"tool discovery","email":"you@example.com"}'Use it from your agent
Point any MCP-capable agent (Claude, Cursor, your own) at the no-auth endpoint — it can then find XCrawl and every other listed interface on its own:
claude mcp add --transport http agent-nexus https://agentnexus.app/api/public/mcp
Agents can discover XCrawl through the Agent Nexus MCP server, /llms.txt or the discovery API.