Pay-per-Crawl Launches Across Ten Web Stacks

Summary

ForgeMesh says its Pay-per-Crawl access gate is now available across WordPress, Drupal, Laravel, Next.js, Node, Cloudflare, nginx, Caddy, Traefik and Python, with a Go edition also covering Caddy and Traefik integrations and PHP packages covering Laravel and Drupal. The gate behaves consistently across editions: humans and reverse-DNS-verified search engines receive free access, while AI crawlers, SEO crawlers and scripts receive HTTP 402 payment instructions using an x402 v2 header, a v1 body and an MPP challenge. After an agent pays USDC on Base, the page is served when the settlement transaction hash is returned. Site owners keep 100% of the payment in their own wallets; the system requires no ForgeMesh account, API key or custody, and any facilitator URL can be used, with PayAI as the default. The editions share an 85-agent crawler catalog and discovery files at `/.well-known/x402.json`, `llms.txt` and `agents.txt`, and are distributed through npm, PyPI, Packagist, drupal.org and GitHub. ForgeMesh reports that each edition passed its own tests and a 37-to-44-check HTTP matrix, then completed two real $0.01 Base mainnet settlements before release, for ten settlements in one day. Porting exposed and fixed two security issues: spoofed forwarded IP addresses could bypass the gate, and loosely matched free paths could allow unintended URLs; the releases now use the right-most proxy hop and exact, normalized path rules. The post also documents stack-specific constraints, including Drupal cache ordering, Laravel middleware registration and Traefik's need for a pure-Go keccak implementation. Edge editions allow static assets free by default. A separate Pro service costs $4.99 per month for up to five sites and adds a dashboard, monitoring, alerts, crawler intelligence and directory placement, but the gate itself is complete without it. ForgeMesh contrasts the system with Cloudflare Pay Per Crawl, which it describes as card billing for enrolled AI companies with Cloudflare as merchant of record, while its own approach sends direct wallet payments from x402 or MPP agents.