Copyright | (c) 2013-2021 Brendan Hay |
---|---|
License | Mozilla Public License, v. 2.0. |
Maintainer | Brendan Hay <brendan.g.hay+amazonka@gmail.com> |
Stability | auto-generated |
Portability | non-portable (GHC extensions) |
Safe Haskell | None |
Documentation
data AsyncInferenceClientConfig Source #
Configures the behavior of the client used by Amazon SageMaker to interact with the model container during asynchronous inference.
See: newAsyncInferenceClientConfig
smart constructor.
AsyncInferenceClientConfig' | |
|
Instances
newAsyncInferenceClientConfig :: AsyncInferenceClientConfig Source #
Create a value of AsyncInferenceClientConfig
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:maxConcurrentInvocationsPerInstance:AsyncInferenceClientConfig'
, asyncInferenceClientConfig_maxConcurrentInvocationsPerInstance
- The maximum number of concurrent requests sent by the SageMaker client
to the model container. If no value is provided, Amazon SageMaker will
choose an optimal value for you.
asyncInferenceClientConfig_maxConcurrentInvocationsPerInstance :: Lens' AsyncInferenceClientConfig (Maybe Natural) Source #
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, Amazon SageMaker will choose an optimal value for you.