Transform Logpush logs with SQL before delivery: Transformers is now GA
Hi, it's Shii-chan! Today I have news about running SQL on your Logpush logs before they are delivered, and it just went GA!
Cloudflare Changelog
developers.cloudflare.com
What was announced?
Cloudflare's Changelog announced that Logpush Transformers is now generally available.
It works on supported Logpush datasets across the Free, Pro, Business, and Enterprise plans.
Why it matters
When you ship logs elsewhere, you often don't want every field, or you want to remove sensitive data first. With Transformers, you can process each batch with SQL right before Logpush delivers it.
What changes
With SQL you can:
- Filter records
- Reshape fields
- Redact sensitive values
- Compute new fields
- Add metadata
You no longer have to post-process on the destination side. You can deliver just the logs you need, in the shape you need. That's great for teams who care about how logs are handled for security and compliance!
Dive Deep
Here are the practical details.
- You create and preview Transformers in Transformer Studio or through the Cloudflare API
- You can attach them to account-scoped or zone-scoped Logpush jobs that use NDJSON output
- When you save, Cloudflare validates the query against the dataset schema
Pricing works like this:
- Each account includes 1 GB of transformation input per month
- Additional input costs $0.04 per GB
Supported SQL, limits, and examples are covered in the Transformers page of the Cloudflare docs.
Wrap-up
- Logpush Transformers is GA on all plans
- Use SQL to filter, reshape, redact, compute fields, and add metadata
- Create and preview in Transformer Studio or the API, then attach to NDJSON jobs
- 1 GB of input per month is included, then $0.04 per GB
This is a good fit for log pipeline owners and security folks who want to strip sensitive values before logs leave Cloudflare!
