iCreatAI News
Skip to content
AWS Machine Learning Blog· Lauren Eterno·· 23 days agoAI score22

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

Orchestrating SageMaker AI endpoint auto scaling with AWS CDK

AI summary

Updating a SageMaker AI real-time endpoint configuration fails through CloudFormation or CDK because SageMaker AI requires the scalable target to be deregistered first, and manual deregistration leaves CloudFormation unable to track Application Auto Scaling resources. The post presents a reusable CDK construct that replaces the native scalable target and scaling policy resources with three custom resources—Deregister, Register Scalable Target, and Attach Scaling Policy—ordered with explicit dependencies and driven by a ConfigHash so endpoint and auto scaling changes deploy together. It includes a walkthrough using the sample-sagemaker-endpoint-autoscaling GitHub repository and guidance on integrating the construct into an existing stack.

Source: AWS Machine Learning Blog · aws.amazon.com