JA EN
shiichan

Flink 2.3 Fixes CDC Ordering Glitches! Amazon Managed Service for Apache Flink Gets an Upgrade

AWS What's New ★★★★ View Markdown
#aws#infrastructure

Hey, it's Shiichan! Today's update is for the streaming data crowd — Amazon Managed Service for Apache Flink now supports a new Flink version.

AWS What's New aws.amazon.com

What was announced?

This is from AWS What's New. Amazon Managed Service for Apache Flink now supports Apache Flink 2.3, an update that boosts both application stability and data correctness.

What changes

Here's what's in this release:

  • Adaptive partition selection: improves backpressure handling under uneven load, so applications run more smoothly
  • CDC pipeline improvements: better handling of out-of-order updates in change data capture (CDC) pipelines, improving data correctness
  • New SQL functions: make it easier to convert between changelog streams and standard streams

Dive Deep

Getting started is simple — create a new application directly on Flink 2.3, or use an in-place version upgrade to move a compatible existing application straight to the Flink 2.3 runtime. No rebuild required, which makes upgrading a lot easier. The full list of changes is in the Apache Flink 2.3 release notes.

Apache Flink 2.3 is available in every AWS Region where Amazon Managed Service for Apache Flink is offered.

Wrap-up

  • Amazon Managed Service for Apache Flink now supports Apache Flink 2.3
  • Adaptive partition selection improves backpressure handling
  • Better handling of out-of-order CDC updates improves data correctness
  • New SQL functions ease conversion between changelog and standard streams
  • Migrate via a new application or an in-place upgrade, available in every supported Region

If you're running streaming pipelines on Flink, this update is worth checking out.

Related posts