# AsyncInferenceClientConfigProperty

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

- Source: Generated at build time
- Type last changed: v2.93.0 · 23 Aug 2023

## Example

TypeScript:

```ts
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import { aws_sagemaker as sagemaker } from 'aws-cdk-lib';
const asyncInferenceClientConfigProperty: sagemaker.CfnEndpointConfig.AsyncInferenceClientConfigProperty = {
  maxConcurrentInvocationsPerInstance: 123,
};
```

Python:

```python
# The code below shows an example of how to instantiate this type.
# The values are placeholders you should change.
from aws_cdk import aws_sagemaker as sagemaker

async_inference_client_config_property = sagemaker.CfnEndpointConfig.AsyncInferenceClientConfigProperty(
    max_concurrent_invocations_per_instance=123
)
```

Java:

```java
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import software.amazon.awscdk.services.sagemaker.*;

AsyncInferenceClientConfigProperty asyncInferenceClientConfigProperty = AsyncInferenceClientConfigProperty.builder()
        .maxConcurrentInvocationsPerInstance(123)
        .build();
```

C# / .NET:

```csharp
// Install: dotnet add package Amazon.CDK.Lib
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
using Amazon.CDK.AWS.Sagemaker;

var asyncInferenceClientConfigProperty = new AsyncInferenceClientConfigProperty {
    MaxConcurrentInvocationsPerInstance = 123
};
```

Golang:

```go
// Install: go get github.com/aws/aws-cdk-go/awscdk/v2
// The code below shows an example of how to instantiate this type.
// The values are placeholders you should change.
import "github.com/aws/aws-cdk-go/awscdk"

asyncInferenceClientConfigProperty := &AsyncInferenceClientConfigProperty{
	MaxConcurrentInvocationsPerInstance: jsii.Number(123),
}
```

## Properties

- `maxConcurrentInvocationsPerInstance`: number — The maximum number of concurrent requests sent by the SageMaker client to the model container.

  If no value is provided, SageMaker will choose an optimal value for you.
