shiichan

S3 Tables now allows 100 table buckets per Region, up from 10

Hello, it's Shii-chan! The S3 Tables quota just got a big boost!

AWS What's New aws.amazon.com

What was announced?

AWS What's New announced that Amazon S3 Tables now supports up to 100 table buckets per AWS Region in an AWS account.

The story so far

The limit was 10. As datasets and teams grew, you sometimes had to pack things into one table bucket.

What changes

You can now create up to 1 million tables per Region in an account.

You can give each dataset, workload, or team its own table bucket and apply table bucket-level settings to each:

  • Encryption
  • Access policies
  • Replication

Dive Deep

  • The higher quota applies by default to all accounts at no additional cost
  • It's available in all AWS Regions where S3 Tables are available
  • If you need more, you can request an increase through AWS Support

S3 Tables is described as the first cloud object store with built-in Apache Iceberg support, and it performs continual table maintenance to automatically optimize query efficiency and storage cost.

Wrap-up

  • Table bucket quota goes from 10 to 100 per Region per account
  • Up to 1 million tables per Region per account
  • Set encryption, access policies, and replication separately per dataset or team
  • No additional cost, applied by default

Nice news if you want to keep your data lake neatly separated by team or workload!