More Than Half Your Site's Traffic Isn't Human Anymore! Cloudflare Makes 'Agent Readiness' Visible

Hey there, it's Shii! Today I'm sharing some news I found on the Cloudflare Blog that gave me a bit of a jolt. Apparently, less than half of the traffic hitting websites now comes from humans. So let's find out who makes up that "other half," and take a look at the new tools Cloudflare built for it!

Cloudflare Blog blog.cloudflare.com

What was announced?

What Cloudflare announced on its Blog is the integration of "Agent Readiness" into the dashboard, along with a new concept called AEO (Answer Engine Optimization).

Right at the top of the post, Cloudflare reveals that "fewer than half of all HTML page requests now come from a human." The rest come from machines. Not all of them are AI agents acting on someone's behalf, but that share keeps growing.

In other words, just as site owners used to think about how to get found by search engines (SEO), they now also need to think about how to get found, read, and recommended by AI agents, a shift in the times this announcement is really about. This launch is also apparently one of several agent-focused efforts Cloudflare is rolling out on the same day, part of a broader push toward a web where agents play a much bigger role.

Why it matters

Until now, websites have mostly been evaluated through a human lens: search rankings, page load speed, how easy the UI is to use. All of these are things a human looks at and interacts with directly.

But AI agents behave completely differently. They sometimes don't execute JavaScript, they try to understand a site's structure through robots.txt and sitemaps, and rather than "reading" a page, they tend to "extract" information from it. It's apparently common for a site that looks great to humans to be nearly unreadable or unreachable for an agent.

On top of that, AI agents are increasingly the ones choosing which site to look at or which service to use, on a user's behalf. If an agent never even notices your site exists, you don't even get a seat at the comparison table, and that's exactly why Cloudflare says Agent Readiness and AEO matter now.

What changes

With Agent Readiness and AEO, site owners can finally get a numeric answer to two questions that used to be pure guesswork:

• Can agents find, read, and interact with your site? (Agent Readiness)
• Are AI assistants actually recommending your site? (AEO)

Instead of a vague sense of "I hope we're ready for the AI era," you can now open the Cloudflare dashboard and get a concrete diagnosis along with a list of things to fix, and that's the biggest change here.

Dive Deep

Let's go a bit deeper into how this actually works!

Agent Readiness

Agent Readiness diagnoses whether AI agents can actually discover, read, and interact with your site. The checks are grouped into four tiers by how much effort they take:

• Quick Wins: crawler-readable robots.txt, an XML sitemap, AI-crawler rules, and clean Markdown delivery
• Technical Groundwork: Content Signals metadata, an API catalog, link headers, and instructions for agent login
• Advanced Integration: OAuth discovery, the Model Context Protocol (MCP), Agent2Agent cards, a skills index, Web Bot Auth, and WebMCP
• Commerce (informational only for now): x402 status codes, the Agent Commerce Protocol, Universal Commerce Protocol, and Agent Payments Protocol

Results are shown on a scale from "Not Ready" up through a fully agent-native rating.

AEO (Answer Engine Optimization)

AEO measures how often AI assistants like ChatGPT or Claude actually recommend your site. It's scored across five dimensions:

• Citation Rate: the share of category-related answers that cite your site
• Prominence: how visibly and substantively your site is featured within an answer
• Mention Rate: the gap between how often your brand name is mentioned versus how often it's actually cited, revealing awareness gaps
• Share of Voice: your citation share relative to competitors
• Industry Fit Score: whether AI actually places your site alongside your real market competitors

To compute these scores, Cloudflare queries Claude and GPT with realistic category-style prompts and pre-computes benchmarks per category. It uses Cloudflare AI Gateway to sample across multiple models, and Workers AI to analyze the responses, an interesting example of Cloudflare using its own AI products to build this diagnostic feature.

What you can do from the dashboard

• The Overview tab runs an Agent Readiness scan and links directly to the items you should fix
• AEO Visibility is currently early access, available on request
• AI Operator Activity shows crawl volume, referral traffic, and error patterns broken down by AI operator (crawler or agent)

Wrap-up

• Cloudflare announced the integration of "Agent Readiness" into its dashboard, along with a new concept called AEO (Answer Engine Optimization)
• The backdrop is a striking fact: fewer than half of HTML page requests now come from humans
• Agent Readiness diagnoses your site's agent-friendliness across four tiers, while AEO visualizes how often AI assistants recommend you across five metrics like Citation Rate and Share of Voice
• You can run the diagnostic from the dashboard's Overview tab, and request early access to AEO Visibility

If you've been wondering how your site or service looks to AI agents, or you're ready to start thinking about "AEO" as the next chapter after SEO, this one's worth a look!