Topic 1 Question 37
A company has trained an ML model in Amazon SageMaker. The company needs to host the model to provide inferences in a production environment. The model must be highly available and must respond with minimum latency. The size of each request will be between 1 KB and 3 MB. The model will receive unpredictable bursts of requests during the day. The inferences must adapt proportionally to the changes in demand. How should the company deploy the model into production to meet these requirements?
Create a SageMaker real-time inference endpoint. Configure auto scaling. Configure the endpoint to present the existing model.
Deploy the model on an Amazon Elastic Container Service (Amazon ECS) cluster. Use ECS scheduled scaling that is based on the CPU of the ECS cluster.
Install SageMaker Operator on an Amazon Elastic Kubernetes Service (Amazon EKS) cluster. Deploy the model in Amazon EKS. Set horizontal pod auto scaling to scale replicas based on the memory metric.
Use Spot Instances with a Spot Fleet behind an Application Load Balancer (ALB) for inferences. Use the ALBRequestCountPerTarget metric as the metric for auto scaling.
ユーザの投票
コメント(2)
- 正解だと思う選択肢: A
SageMaker real-time endpoint: Purpose built for Auto scaling, low latency, handles bursts.
👍 2Saransundar2024/12/04 - 正解だと思う選択肢: A👍 1GiorgioGss2024/11/27
シャッフルモード