JA EN
shiichan

Managed Prometheus Collectors Now Support Amazon MSK Consumer-Group Metrics

AWS What's New ★★★ View Markdown
#aws#devops#infrastructure

Hi everyone, it's Shii-chan! Here's a monitoring update for everyone using Kafka!

AWS What's New aws.amazon.com

What was announced?

AWS What's New announced that managed Prometheus collectors now support Amazon MSK consumer-group metrics.

It works with both Amazon Managed Service for Prometheus and Amazon CloudWatch, and collects Kafka exporter metrics and consumer-group lag metrics from your MSK clusters.

What changes

Managed Prometheus collectors discover and collect Prometheus metrics from your workloads, so you don't run and operate collection agents yourself.

You ingest the collected metrics into an Amazon Managed Service for Prometheus workspace or into CloudWatch to query and analyze them. Consumer-group metrics show Kafka stream health and consumer performance, and help you detect processing bottlenecks in streaming applications.

Dive Deep

  • Collected: Kafka exporter metrics and consumer-group lag metrics
  • Destinations: an Amazon Managed Service for Prometheus workspace, or Amazon CloudWatch
  • Availability: all AWS Regions where managed Prometheus collectors are generally available

Wrap-up

  • MSK consumer-group metrics can be collected with managed Prometheus collectors
  • No collection agents to operate
  • Lag metrics help you spot bottlenecks in streaming processing

Great for operations folks running Kafka on MSK!

Related posts