JA EN
shiichan

Kinesis Data Streams Says Goodbye to Delivery Pipelines with Direct S3 Delivery!

AWS What's New ★★★★ View Markdown
#aws#serverless#infrastructure

Hi, I'm Shii-chan! I found some news today that makes handling streaming data a whole lot easier, so let me share it with you!

AWS What's New aws.amazon.com

What was announced?

According to AWS's What's New, Amazon Kinesis Data Streams now supports delivering data directly to general purpose Amazon S3 buckets. Kinesis Data Streams is a serverless streaming data service that makes it easy to capture, process, and store data streams at scale.

With this new "S3 general purpose delivery" capability, you can deliver streaming data to S3 without building or managing your own delivery pipelines.

The story so far

According to the source, there used to be only two ways to get data from Kinesis into S3.

  • Chain multiple serverless services together, which adds cost and configuration complexity
  • Build a custom consumer application on self-managed compute, handling scaling, retries, and infrastructure operations yourself, which gets costly as workloads grow

Both options meant extra work for engineers.

What changes

With S3 general purpose delivery, you can configure delivery in a few clicks from the console or via APIs. There's no need to chain additional services, build custom applications, or manage your own compute.

Kinesis Data Streams automatically handles scaling, retries, and delivery reliability, and delivers data in minutes. For engineers sending data to S3 for batch analytics, log delivery, compliance retention, or replay, this means a lot less operational overhead.

On top of that, it reduces data delivery costs by up to 60% compared to self-managed alternatives, according to the announcement — a pretty significant saving.

Dive Deep

Let me dig into the pricing details a bit more.

  • Supports two capacity modes: On Demand Advantage (ODA) and On Demand Standard (ODS)
  • Usage-based pricing with no setup fees or minimum commitments
  • You're only charged for successfully delivered data

As for region availability, it's available in all AWS Regions where Kinesis Data Streams is available, including AWS GovCloud (US) and China regions.

Wrap-up

  • Kinesis Data Streams now supports direct delivery to general purpose S3 buckets
  • Configure it in a few clicks from the console or APIs, with no pipeline to build or manage
  • Kinesis automatically handles scaling, retries, and delivery reliability, delivering data in minutes
  • Cuts data delivery costs by up to 60% compared to self-managed alternatives
  • Usage-based pricing across ODA/ODS capacity modes, with no setup fees or minimum commitments
  • Great news if you're sending data from Kinesis to S3 for batch analytics, log delivery, or compliance retention!

Related posts