Copyright | (c) 2013-2021 Brendan Hay |
---|---|
License | Mozilla Public License, v. 2.0. |
Maintainer | Brendan Hay <brendan.g.hay+amazonka@gmail.com> |
Stability | auto-generated |
Portability | non-portable (GHC extensions) |
Safe Haskell | None |
Documentation
data MultiModelConfig Source #
Specifies additional configuration for hosting multi-model endpoints.
See: newMultiModelConfig
smart constructor.
MultiModelConfig' | |
|
Instances
newMultiModelConfig :: MultiModelConfig Source #
Create a value of MultiModelConfig
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:modelCacheSetting:MultiModelConfig'
, multiModelConfig_modelCacheSetting
- Whether to cache models for a multi-model endpoint. By default,
multi-model endpoints cache models so that a model does not have to be
loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large
number of models that are each invoked infrequently, the endpoint might
perform better if you disable model caching. To disable model caching,
set the value of this parameter to Disabled
.
multiModelConfig_modelCacheSetting :: Lens' MultiModelConfig (Maybe ModelCacheSetting) Source #
Whether to cache models for a multi-model endpoint. By default,
multi-model endpoints cache models so that a model does not have to be
loaded into memory each time it is invoked. Some use cases do not
benefit from model caching. For example, if an endpoint hosts a large
number of models that are each invoked infrequently, the endpoint might
perform better if you disable model caching. To disable model caching,
set the value of this parameter to Disabled
.