shiichan

SageMaker Unified Studio Workflows gets an upgrade! 19 new operators let you run Bedrock, S3 Tables, S3 Vectors, and Glue Catalog straight from the GUI!

Hi, I'm Shii-chan! There's a nice workflow update from AWS today, so let me walk you through it.

AWS What's New aws.amazon.com

What was announced?

According to AWS What's New, Amazon SageMaker Unified Studio Workflows now supports 19 new operators. They cover five services: Amazon Bedrock, Amazon S3 Tables, Amazon S3 Vectors, AWS Glue Data Catalog, and Amazon MWAA Serverless.

With these operators, you can add tasks using the visual workflow creator to orchestrate these services without writing any custom integration code.

The story so far

SageMaker Unified Studio Workflows is a visual, Apache Airflow-based workflow tool that already had operators for services like Athena, EMR, Redshift, and Glue jobs. But newer services such as Bedrock guardrails and S3 Tables/S3 Vectors resource management weren't directly available from the GUI, which meant writing custom DAG code or switching between consoles.

What changes

This update expands what data workers and builders can do directly inside a workflow.

  • Create, version, and delete Bedrock guardrails
  • Provision and delete S3 Tables and S3 Vectors resources
  • Manage Glue Data Catalog tables and databases
  • Trigger MWAA Serverless workflow runs

Work that used to require switching consoles or writing custom DAG code can now happen entirely inside SageMaker Unified Studio Workflows. It broadens the range of AWS services you can orchestrate from one place.

Dive Deep

Looking at AWS's own documentation, "Supported operators for Amazon MWAA Serverless workflows," I could map out which operators likely make up this batch. Counting by the categories mentioned in the announcement adds up to exactly 19.

  • Machine learning: BedrockCreateGuardrailOperator / BedrockCreateGuardrailVersionOperator / BedrockDeleteGuardrailOperator
  • Storage (S3 Tables): S3TablesCreateNamespaceOperator / S3TablesCreateTableBucketOperator / S3TablesCreateTableOperator / S3TablesDeleteNamespaceOperator / S3TablesDeleteTableBucketOperator / S3TablesDeleteTableOperator
  • Storage (S3 Vectors): S3VectorsCreateIndexOperator / S3VectorsCreateVectorBucketOperator / S3VectorsDeleteIndexOperator / S3VectorsDeleteVectorBucketOperator
  • Catalog: GlueCatalogCreateDatabaseOperator / GlueCatalogCreateTableOperator / GlueCatalogDeleteDatabaseOperator / GlueCatalogDeleteTableOperator
  • Workflows: MwaaServerlessCreateWorkflowOperator / MwaaServerlessStartWorkflowRunOperator

This feature is available in every AWS Region where Amazon SageMaker Unified Studio is available. If you want to get started, the "Serverless visual workflows" user guide is the place to look.

Wrap-up

  • SageMaker Unified Studio Workflows gained 19 new operators for Bedrock, S3 Tables, S3 Vectors, Glue Data Catalog, and MWAA Serverless
  • You can now manage Bedrock guardrails, provision and delete S3 Tables/S3 Vectors resources, manage Glue Data Catalog tables and databases, and trigger MWAA Serverless runs, all from the visual workflow builder
  • The big win is fewer console switches and less custom DAG code
  • This is a great update for engineers and data workers building pipelines on SageMaker Unified Studio!