MultiModelConfigProperty Struct
Specifies additional configuration for hosting multi-model endpoints.
| Source | |
|---|---|
| Type last changed |
Example
ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const multiModelConfigProperty: sagemaker.CfnModel.MultiModelConfigProperty = {
modelCacheSetting: 'modelCacheSetting',
};
python
# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
from aws_cdk import aws_sagemaker as sagemaker
multi_model_config_property = sagemaker.CfnModel.MultiModelConfigProperty(
model_cache_setting="modelCacheSetting"
)
java
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.sagemaker.*;
MultiModelConfigProperty multiModelConfigProperty = MultiModelConfigProperty.builder()
.modelCacheSetting("modelCacheSetting")
.build();
csharp
// Install: dotnet add package Amazon.CDK.Lib
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;
var multiModelConfigProperty = new MultiModelConfigProperty {
ModelCacheSetting = "modelCacheSetting"
};
go
// Install: go get github.com/aws/aws-cdk-go/awscdk/v2
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import "github.com/aws/aws-cdk-go/awscdk"
multiModelConfigProperty := &MultiModelConfigProperty{
ModelCacheSetting: jsii.String("modelCacheSetting"),
}
Properties
modelCacheSettingoptionalstringmodel_cache_settingoptionalstrmodelCacheSettingoptionalStringModelCacheSettingoptionalstringModelCacheSettingoptional*string #Whether to cache models for a multi-model endpoint.
notes
By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.