Skip to content
v2.278.0

InferenceComponentCapacitySizeProperty Struct ​

Specifies the type and size of the endpoint capacity to activate for a rolling deployment or a rollback strategy.

You can specify your batches as either of the following:

  • A count of inference component copies
  • The overall percentage or your fleet

For a rollback strategy, if you don't specify the fields in this object, or if you set the Value parameter to 100%, then SageMaker AI uses a blue/green rollback strategy and rolls all traffic back to the blue fleet.

Example ​

ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const inferenceComponentCapacitySizeProperty: sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty = {
  type: 'type',
  value: 123,
};
python
# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
from aws_cdk import aws_sagemaker as sagemaker

inference_component_capacity_size_property = sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty(
    type="type",
    value=123
)
java
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.sagemaker.*;

InferenceComponentCapacitySizeProperty inferenceComponentCapacitySizeProperty = InferenceComponentCapacitySizeProperty.builder()
        .type("type")
        .value(123)
        .build();
csharp
// Install: dotnet add package Amazon.CDK.Lib
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;

var inferenceComponentCapacitySizeProperty = new InferenceComponentCapacitySizeProperty {
    Type = "type",
    Value = 123
};
go
// Install: go get github.com/aws/aws-cdk-go/awscdk/v2
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import "github.com/aws/aws-cdk-go/awscdk"

inferenceComponentCapacitySizeProperty := &InferenceComponentCapacitySizeProperty{
	Type: jsii.String("type"),
	Value: jsii.Number(123),
}

Properties ​

typestringtypestrtypeStringTypestringType*string required #
Specifies the endpoint capacity type.
  • COPY_COUNT - The endpoint activates based on the number of inference component copies.
  • CAPACITY_PERCENT - The endpoint activates based on the specified percentage of capacity.
valuenumbervalueint | floatvalueNumberValuedoubleValue*float64 required #
Defines the capacity size, either as a number of inference component copies or a capacity percentage.