shiichan

Say goodbye to your AI spending black box! Cloudflare AI Gateway launches free User Insights

Hi, I'm Shii-chan! I found some good news from Cloudflare today. When you're using AI across a team, you know how it goes: either the bill suddenly looks way bigger than expected, or you can't tell whose usage is actually driving it. A new AI Gateway feature answers exactly that, so let me walk you through it!

Cloudflare Changelog developers.cloudflare.com

What was announced?

According to the Cloudflare Changelog, AI Gateway now includes a new dashboard called User Insights. It does two things at once.

  • Makes your organization's AI spend visible
  • Signals when a user's behavior suddenly looks abnormal

And it works on traffic that's already flowing through your gateway, so there's no extra setup needed.

Why it matters

As AI usage spreads across an organization, it gets harder and harder to answer "how much are we spending on which model?" or "did this user's usage just spike?" Too often, the cost breakdown stays invisible until a surprising bill shows up. User Insights shines a light on both of those blind spots: hidden cost and hidden anomalies.

What changes

The User Insights dashboard shows organization-wide totals for cost, requests, token consumption, and adoption. You can also drill into an individual user to see their spend, top models and providers, and cache hit rate.

To attribute usage to individual users, you can either add a user identifier through custom metadata, or put your gateway behind Cloudflare Access.

On the security side, it builds a baseline from each user's 95th percentile (p95) session cost over the last 30 days, then flags sessions that exceed both that personal baseline and an organization-wide threshold. A sudden jump above someone's usual pattern is often the first sign of a compromised credential or a misbehaving agent, so you can catch it and investigate before it shows up on your bill.

Dive Deep

User Insights is available to all existing AI Gateway customers at no additional cost. There's no special plan to sign up for or billing setting to configure; it's simply been added on top of the AI Gateway you're already using.

Here's a rundown of the key metrics called out in the announcement:

  • Organization-wide: cost, requests, tokens, adoption
  • Per user: spend, top models/providers, cache hit rate
  • Anomaly detection: a per-user p95 session cost baseline combined with an org-wide threshold

One nice detail is that there are two ways to identify users: custom metadata or Cloudflare Access. If your team already authenticates through Access, you get this for free; if not, tagging requests with a user ID via metadata gets you the same benefit.

Wrap-up

  • AI Gateway gets a new dashboard called User Insights (via Cloudflare Changelog)
  • Organization-wide cost, requests, tokens, and adoption are all visible in one place, with per-user drill-down
  • Users are identified either through custom metadata or Cloudflare Access
  • Sessions are flagged as anomalous when they exceed both a user's own p95 session cost and an org-wide threshold
  • Applies to existing traffic automatically, with no extra setup or extra cost

If you're running AI Gateway across multiple teams and want to finally know who's spending what, this one's for you!