InferenceComponentCapacitySizeProperty Struct
Specifies the type and size of the endpoint capacity to activate for a rolling deployment or a rollback strategy.
You can specify your batches as either of the following:
- A count of inference component copies
- The overall percentage or your fleet
For a rollback strategy, if you don't specify the fields in this object, or if you set the Value parameter to 100%, then SageMaker AI uses a blue/green rollback strategy and rolls all traffic back to the blue fleet.
| Source | |
|---|---|
| Type last changed |
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const inferenceComponentCapacitySizeProperty: sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty = {
type: 'type',
value: 123,
};
python
# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
from aws_cdk import aws_sagemaker as sagemaker
inference_component_capacity_size_property = sagemaker.CfnInferenceComponent.InferenceComponentCapacitySizeProperty(
type="type",
value=123
)
java
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.sagemaker.*;
InferenceComponentCapacitySizeProperty inferenceComponentCapacitySizeProperty = InferenceComponentCapacitySizeProperty.builder()
.type("type")
.value(123)
.build();
csharp
// Install: dotnet add package Amazon.CDK.Lib
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;
var inferenceComponentCapacitySizeProperty = new InferenceComponentCapacitySizeProperty {
Type = "type",
Value = 123
};
go
// Install: go get github.com/aws/aws-cdk-go/awscdk/v2
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import "github.com/aws/aws-cdk-go/awscdk"
inferenceComponentCapacitySizeProperty := &InferenceComponentCapacitySizeProperty{
Type: jsii.String("type"),
Value: jsii.Number(123),
}
Properties
Specifies the endpoint capacity type.
- COPY_COUNT - The endpoint activates based on the number of inference component copies.
- CAPACITY_PERCENT - The endpoint activates based on the specified percentage of capacity.
Defines the capacity size, either as a number of inference component copies or a capacity percentage.