AWS Glue Data Quality Now Suggests Rules in Seconds with AI!
Hey everyone, it's me, Shii-chan! Today I found a small but really handy update on the AWS data quality side!
AWS What's NewWhat was announced?
According to AWS What's New, AWS Glue Data Quality just got a new "Advanced mode" that uses generative AI to generate data quality rules for your tables in the AWS Glue Data Catalog in just seconds. You get a ready-to-use ruleset covering every column, right out of the box.
The story so far
Until now, getting data quality checks up and running meant writing rules by hand for each column — things like "don't allow NULLs" or "keep values within this range." For a newly onboarded dataset, or worse, a large data lake with tons of tables and columns, that manual setup took a lot of time and it was easy to miss something.
What changes
With Advanced mode, AWS Glue Data Quality uses generative AI to detect the intent behind your data — what each column represents and how it's actually used — and proposes business-relevant rules based on that. You review the recommended rules, adjust them as needed, and save them as a ruleset to start monitoring right away.
This is great news for:
- Anyone who needs to bootstrap rules for a newly onboarded dataset quickly
- Teams establishing baseline checks across a large data lake
- Engineers who want to spend less time hand-writing rules while authoring pipelines
Dive Deep
Advanced mode is available in the following AWS Regions:
- Asia Pacific (Melbourne, Osaka, Sydney, Tokyo)
- Canada (Central)
- Europe (Frankfurt, Ireland, London, Milan, Paris, Spain, Stockholm, Zurich)
- US East (N. Virginia, Ohio)
- US West (N. California, Oregon)
The announcement describes the flow as: review the recommended rules, adjust as needed, then save them as a ruleset to begin monitoring immediately. It doesn't go into pricing details or the underlying rule-generation mechanics, so if you want more specifics, check the AWS Glue Data Quality documentation.
Wrap-up
- AWS Glue Data Quality adds an "Advanced mode" that uses generative AI to detect data intent and auto-suggest rules
- You get a ruleset covering every column in seconds, with no manual setup required
- Review, adjust, and save the recommendations as a ruleset to start monitoring immediately
- Available across many regions including Asia Pacific, Canada, Europe, and both US coasts
If you're running data quality checks on tables in the Glue Data Catalog, this update should save you a lot of setup time!