JA EN
shiichan

AWS for Fluent Bit 3.0.0 Is Here: OTel Support, Faster JSON Parsing, and Amazon Linux 2023

AWS What's New ★★★★ View Markdown
#aws#devops#infrastructure

Hi everyone, it's Shii-chan! If you work with container logging, there's a big update for you!

AWS What's New aws.amazon.com

What was announced?

In AWS What's New, AWS announced version 3.0.0 of AWS for Fluent Bit.

It is based on Fluent Bit 4.1.1 and Amazon Linux 2023. It lets Amazon ECS and Amazon EKS customers collect, process, and route container logs without changing application code, and this release makes that pipeline more capable.

The destinations mentioned are:

  • Amazon CloudWatch Logs
  • Amazon Data Firehose
  • Amazon Kinesis Data Streams
  • Amazon S3

The story so far

The main point of this release is that upgrading both the Fluent Bit version and the base image brings the latest Fluent Bit features, performance improvements, and security enhancements together.

What changes

These are the new features and improvements called out in the announcement:

  • OpenTelemetry support: ingest and forward OTLP logs, metrics, and traces, with AWS SigV4 authentication
  • Performance: faster JSON parsing, so more logs are processed per vCPU with lower latency
  • Security: TLS minimum version and cipher controls let you enforce your TLS policy on outputs from AWS for Fluent Bit

Dive Deep

Upgrading works differently on ECS and EKS:

  • Amazon ECS: update the FireLens log-router container image in your task definition to the 3.0.0 tag from the Amazon ECR Public Gallery
  • Amazon EKS: update the Helm release, or set the DaemonSet image to the 3.0.0 version

The announcement was also updated later to clarify the scope of the OpenTelemetry support. Check the announcement and the release notes for exactly what is covered before you rely on it.

The image is available in the Amazon ECR Public Gallery and in an Amazon ECR repository, and the release notes are on the v3.0.0 release of the aws-for-fluent-bit repository on GitHub.

Wrap-up

  • AWS for Fluent Bit 3.0.0 is based on Fluent Bit 4.1.1 and Amazon Linux 2023
  • It ingests and forwards OTLP logs, metrics, and traces, with AWS SigV4 authentication
  • Faster JSON parsing means more logs per vCPU with lower latency
  • TLS minimum version and cipher controls are available
  • Upgrade by changing the image tag on ECS, or the Helm release or DaemonSet image on EKS

If you run logging on ECS or EKS and are thinking about OpenTelemetry or tighter TLS policy, this update is for you!

Related posts