shiichan

What Score Would Your Site Get From AI Agents? Meet Cloudflare's Agent Readiness Score

Hey everyone, Shii-chan here! Today I want to talk about a fun tool that grades how friendly your website is to AI agents. So exciting!

Cloudflare Blog blog.cloudflare.com

What was announced?

This one comes from the Cloudflare Blog. Cloudflare launched a new tool called isitagentready.com that checks whether your site is usable by AI agents, then gives you a score and concrete tips to improve.

They also added a new dataset to Cloudflare Radar that tracks how widely agent standards are being adopted across the web.

Why it matters

The web today still isn't very agent-ready. According to Cloudflare, only 78% of sites have a robots.txt file, just 4% support Content Signals, and only 3.9% support Markdown content negotiation.

As the web shifts from being built purely for humans toward something agents can read too, having a ruler to measure "how ready is my own site?" is a big deal.

What changes

Just enter your site's URL and you get scores across four dimensions:

  • Discoverability: robots.txt, sitemap.xml, Link Headers
  • Content: support for Markdown for Agents
  • Bot Access Control: Content Signals, AI bot rules in robots.txt, Web Bot Auth
  • Capabilities: Agent Skills, API Catalog, OAuth server discovery, MCP Server Cards

The scoring is inspired by Google Lighthouse, so instead of a plain pass/fail it tells you exactly what to fix. It also checks commerce standards like x402 and the Universal Commerce Protocol, though those are informational and don't count toward your score.

Dive Deep

Here's the fun part: Cloudflare rebuilt its own Developer Documentation as a model of agent-friendly design.

  • Serving an /index.md fallback for each URL via Cloudflare Rules
  • Splitting llms.txt per directory so it doesn't overflow the context window

With tricks like these, they cut tokens by 31% and sped up responses by 66% compared to competing documentation sites.

The checker itself is built to be used by agents too, and it's published as an MCP server. On the OAuth side, Cloudflare Access Managed OAuth supports the flow. You can also view results from the "Agent Readiness" tab in Cloudflare Radar's URL Scanner.

Wrap-up

  • Cloudflare launched isitagentready.com, which grades how agent-ready your site is
  • It scores four dimensions (Discoverability / Content / Bot Access Control / Capabilities) and shows what to improve
  • Adoption is still early: robots.txt at 78%, Content Signals at 4%, Markdown delivery at 3.9%
  • Cloudflare's own developer docs became a showcase, with 31% fewer tokens and 66% faster responses

If you build websites and want to get ready for the age of agents, or you're curious about "agent optimization" as the new SEO, this one's for you!