shiichan

AWS Glue Schema Registry just landed in ten more regions!

Hi, it's Shii! Today I found an update from AWS Glue that's a bit understated but really useful if you work with streaming data. Let me walk you through it!

AWS What's New aws.amazon.com

What was announced?

Over on AWS What's New, AWS announced that AWS Glue Schema Registry is now available in ten more AWS Regions.

The newly supported regions are:

  • Asia Pacific (New Zealand)
  • Asia Pacific (Thailand)
  • Asia Pacific (Hyderabad)
  • Asia Pacific (Osaka)
  • Asia Pacific (Malaysia)
  • Asia Pacific (Melbourne)
  • Mexico (Central)
  • Israel (Tel Aviv)
  • Asia Pacific (Taipei)
  • Canada West (Calgary)

Teams running streaming data infrastructure in these regions can now use the Schema Registry directly.

The story so far

AWS Glue Schema Registry is a serverless, free feature of AWS Glue that acts as a centralized repository for managing data format and structure between decoupled applications. Using schemas registered in Apache Avro, JSON, or Protobuf, it lets you validate and control how your streaming data evolves over time.

Until now, though, this feature simply wasn't available in the ten regions added today. That meant teams building streaming pipelines in places like Osaka or Calgary couldn't take advantage of this centralized management, and instead had to write their own data validation logic or keep coordinating schema expectations across teams by hand.

What changes

With this expansion, teams running streaming systems in these ten regions can now:

  • Cut down on custom data validation logic
  • Reduce the coordination overhead of aligning schemas across teams
  • Improve the quality of their streaming data
  • Reduce downstream application failures caused by schema mismatches

For teams that previously had to route through another region just to use Schema Registry, this is a welcome update: you can now adopt it right in the region you're already operating in.

Dive Deep

AWS Glue Schema Registry integrates with C# and Java applications through Apache-licensed serializers and deserializers. It works with:

  • Apache Kafka / Amazon Managed Streaming for Apache Kafka (MSK)
  • Amazon Kinesis Data Streams
  • Apache Flink / Amazon Managed Service for Apache Flink
  • AWS Lambda

Since it's a serverless, free feature, you can adopt it without worrying about extra infrastructure or cost. You can find getting-started details in the AWS Glue Schema Registry documentation, and the full list of supported regions is available in the AWS Regional Services List.

Wrap-up

  • AWS Glue Schema Registry now supports Asia Pacific (New Zealand, Thailand, Hyderabad, Osaka, Malaysia, Melbourne, Taipei), Mexico (Central), Israel (Tel Aviv), and Canada West (Calgary)
  • It centrally manages Avro, JSON, and Protobuf schemas so you can validate and control streaming data evolution
  • It integrates with Kafka/MSK, Kinesis Data Streams, Flink, and Lambda, and it's serverless and free to use

If you're building streaming data infrastructure in any of these regions and want easier schema management, this understated update is worth checking out!