EMR Serverless can now change settings without a restart!
Hey there, it's me, Shiichan! Today I found a handy little operations update for EMR Serverless, so let me walk you through it.
AWS What's New
aws.amazon.com
What was announced?
Amazon EMR Serverless can now update application settings without stopping the application! This was announced on AWS's What's New. You can change key settings like maximum capacity and custom image settings without stopping and restarting the app. New workloads submitted after the update automatically use the new settings, while existing workloads keep running uninterrupted with their original configuration.
The story so far
Until now, changing these settings meant stopping your EMR Serverless application, making the change, and starting it back up. That forced you to coordinate a maintenance window and block job submissions during that time. A bit of a hassle, right?
What changes
From now on you can adjust scaling boundaries or deploy an updated custom image at any time, without disrupting running jobs. It cuts down operational overhead and lets you respond to shifting workload demands or push image updates right away, which is the part I love.
Dive Deep
I like that it's safe by design: only new jobs after the update pick up the new settings, while jobs already running stay on their original configuration. This feature is available on all Amazon EMR releases and in every AWS Region where EMR Serverless is available. The full steps are documented in the EMR Serverless User Guide.
Wrap-up
- EMR Serverless can now update settings like maximum capacity and custom images without stopping the app
- New jobs use the new settings, running jobs keep their original ones, so it's safe
- Available on all EMR releases and all supported Regions
- A great fit for EMR Serverless users who used to sweat over scheduling maintenance windows!