AgentReady Audits Whether AI Assistants Can Read Your Website

Summary

AgentReady is an audit tool for determining whether AI assistants can directly read a specified webpage. It makes one real GET request per crawler using each crawler’s published user-agent and compares what the crawler receives with what a browser would receive; a substantially matching response is marked as served. The audit uses seven weighted checks and orders recommended fixes by the points they could recover. It can generate a self-contained SVG showing the grade and measurement date, with a link back to the report, and can also copy an embed code or report link. The audit makes six HTTP requests to the supplied URL and checks `/robots.txt`, `/llms.txt`, `/llms-full.txt`, `/sitemap.xml`, and `/.well-known/security.txt`, applying a 12-second timeout to each request. It examines only the submitted page, so other pages may have different results. AgentReady deliberately does not run JavaScript, reflecting crawlers that cannot see text added only after hydration. The service treats blocking AI crawlers as a publisher’s strategic choice rather than an automatic failure: the score measures reachability, not whether wider access is desirable. Finally, it describes the result as a snapshot rather than ongoing monitoring because bot-defense rules and edge-network responses can change by time and location. A single 403 may therefore be temporary and should be checked again before site changes are made.