Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

AWS details a reusable CDK construct using CloudFormation custom resources to deregister and re-register SageMaker AI endpoint auto scaling, allowing endpoint and scaling updates in one deployment.

By AIWI EditorialReviewed by Chayanika DivekarAI-assisted summary · human-reviewed1 min readPublished Oct 23, 2026

Single source1 source

Reality Check

Availability: Shipping now
Hype-o-meter: Mostly substance
Who it's for: Developers · MLOps Engineers
Do this now: Review the post to implement the reusable CDK construct for your SageMaker endpoint deployments.
Claims check: Claims are limited to a technical workaround described in a how-to post.
Corroboration: Single source · 1 source

Key Takeaways

Updating a SageMaker endpoint with Application Auto Scaling registered causes CloudFormation and CDK deployments to fail
A reusable CDK construct with custom resources handles deregistration and re-registration automatically
Enables updating the endpoint and its scaling in a single deployment

The AWS Machine Learning Blog describes a method for managing SageMaker AI endpoint updates when Application Auto Scaling is registered. According to the post, attempting to update such an endpoint causes AWS CloudFormation and AWS CDK deployments to fail.

To address this, the post walks through building a reusable AWS CDK construct that uses CloudFormation custom resources. The construct automatically deregisters and then re-registers auto scaling, allowing both the endpoint and its scaling configuration to be updated within a single deployment.

Who should care

Developers and MLOps teams deploying SageMaker AI endpoints with AWS CDK and Application Auto Scaling are the primary audience for this walkthrough.

Was this helpful?

Sources & Further Reading

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK — AWS Machine Learning Blog · Oct 23, 2026

Frequently Asked Questions

Why do SageMaker endpoint updates fail with auto scaling registered?

The post states that updating a SageMaker AI endpoint with Application Auto Scaling registered makes CloudFormation and CDK deployments fail.

What does the CDK construct do?

It uses CloudFormation custom resources to automatically deregister and re-register auto scaling so the endpoint and scaling can be updated in one deployment.

Build real-time voice applications with vLLM-Omni on SageMaker AI – Part 1 — Sep 28, 2026
Run interactive IDEs on Amazon EKS with SageMaker AI to power up your AI workflows — Aug 10, 2026
Deploying quantized models on Amazon SageMaker AI with Unsloth — Jul 10, 2026
Developers can now access SageMaker Studio through the new AWS experience — Oct 19, 2026

#cloud #mlops #developer-tools #inference #apis

Reality Check

Key Takeaways

Who should care

Sources & Further Reading

Frequently Asked Questions

Related Articles