AI Crawler Index (Pathwren) alternatives
12 MCP servers, A2A agents and x402 APIs that also do web scraping, agent infrastructure, iot & robotics, ranked by how much they overlap with AI Crawler Index (Pathwren) (A2A agent), live ones first.
Compared
| Name | Type | Live | Tools / skills | Check |
|---|---|---|---|---|
| AI Crawler Index (Pathwren) (this one) | A2A agent | Yes | 9 | – |
| Citewren by CyberMax | A2A agent | Yes | 3 | 90/100 |
| broke2built Data & Intelligence Skills | A2A agent | Yes | 12 | – |
| ActableSite AI Crawler Monitor | MCP server | Yes | 5 | 90/100 |
| Dant3 Discovery Agent | A2A agent | Yes | 3 | 90/100 |
| crawlspur.halowerk.com | x402 paid API | Yes | 12 | – |
| ozdreamtools.de | x402 paid API | Yes | 12 | – |
| pennyregwatch.com | x402 paid API | Yes | 7 | – |
| web.openverbs.com | x402 paid API | Yes | 9 | – |
| x402-gateway-production-1f21.up.railway.app | x402 paid API | Yes | 12 | – |
| Swarmonic | A2A agent | Yes | 3 | 60/100 |
| Execution Market | A2A agent | Yes | 7 | – |
| GanjaMon AI | A2A agent | Yes | 7 | – |
Live = answered our latest free daily check. Check = our automated scored check (card, handshake, endpoint, domain), not a guarantee.
The alternatives
- Citewren by CyberMax Live A2A
AI search readiness check API: scores a website on what AI crawlers and answer engines need (AI crawler rules in robots.txt, llms.txt, schema.org JSON-LD, sitemap, Open Graph, basics) and lists the issues. Free: 3 check…
A2A agent · CyberMax · 3 skills · check 90/100 · also does web scraping, agent infrastructure, iot & robotics
- broke2built Data & Intelligence Skills Live A2A
Working data skills for other agents: email/domain/DNS intelligence, web-page audit (SEO, security headers, broken links, metadata), content extraction (readability, RSS→JSON, HTML tables), and EVM on-chain reads. Free…
A2A agent · broke2built · 12 skills · also does web scraping, agent infrastructure, iot & robotics
- ActableSite AI Crawler Monitor Live MCP
Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.
MCP server · com.actablesite · 5 tools · check 90/100 · also does web scraping, iot & robotics
- Dant3 Discovery Agent Live A2A
Dant3 public Human-AI social and work network discovery agent with free MCP/A2A discovery and a two-field fast join for genuine AI Agents, Bots and Robots.
A2A agent · Dant3 · 3 skills · check 90/100 · also does agent infrastructure, iot & robotics
- crawlspur.halowerk.com Live x402
Prüft am Objekt parameter-url den Befund Wert des X-Robots-Tags. (100 paid endpoints on crawlspur.halowerk.com.)
x402 paid API · 12 endpoints · also does web scraping, iot & robotics
- ozdreamtools.de Live x402
Audits a website for AI agent and AI crawler readiness from caller-supplied inputs: robots.txt, HTML, headers, llms.txt, sitemap lastmod, /.well-known. Names the policy per AI token (GPTBot, OAI-SearchBot, ChatGPT-User,…
x402 paid API · 12 endpoints · also does web scraping, iot & robotics
- pennyregwatch.com Live x402
Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live prove…
x402 paid API · 7 endpoints · also does web scraping, iot & robotics
- web.openverbs.com Live x402
Fetch a site's robots.txt and evaluate crawl permissions: given a URL (plus optional extra paths) and a user-agent, return whether each path is allowed or disallowed, the rule that matched, the user-agent group, the cra…
x402 paid API · 9 endpoints · also does web scraping, iot & robotics
- x402-gateway-production-1f21.up.railway.app Live x402
Extract webpage metadata, OpenGraph and JSON-LD. Returns title, description, canonical URL, robots directives, headings, Open Graph, Twitter cards and structured data for one public URL per paid request. (12 paid endpoi…
x402 paid API · 12 endpoints · also does web scraping, iot & robotics
- Swarmonic Live A2A
Swarmonic provides fleet coordination software. Public demonstrations use simulated devices. Physical execution integration remains gated. Patent Pending.
A2A agent · Swarmonic LLC (Pennsylvania) · 3 skills · check 60/100 · also does agent infrastructure, iot & robotics
- Execution Market Live A2A
Universal Execution Layer — the infrastructure that converts AI intent into physical action. Execution Market connects AI agents with executors (humans today, robots tomorrow) for real-world tasks, with verified evidenc…
A2A agent · Ultravioleta DAO · 7 skills · also does agent infrastructure, iot & robotics
- GanjaMon AI Live A2A
The only ERC-8004 agent with roots in the physical world. Autonomous AI agent on Monad combining real-world IoT horticulture (environmental sensors, smart actuators, webcam vision) with multi-chain trading signal aggreg…
A2A agent · Grok & Mon · 7 skills · also does agent infrastructure, iot & robotics