libZSservicesZSamazonka-sagemakerZSamazonka-sagemaker
Copyright(c) 2013-2021 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay <brendan.g.hay+amazonka@gmail.com>
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellNone

Amazonka.SageMaker.Types.MultiModelConfig

Description

 
Synopsis

Documentation

data MultiModelConfig Source #

Specifies additional configuration for hosting multi-model endpoints.

See: newMultiModelConfig smart constructor.

Constructors

MultiModelConfig' 

Fields

  • modelCacheSetting :: Maybe ModelCacheSetting

    Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

Instances

Instances details
Eq MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

Read MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

Show MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

Generic MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

Associated Types

type Rep MultiModelConfig :: Type -> Type #

NFData MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

Methods

rnf :: MultiModelConfig -> () #

Hashable MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

ToJSON MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

FromJSON MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

type Rep MultiModelConfig Source # 
Instance details

Defined in Amazonka.SageMaker.Types.MultiModelConfig

type Rep MultiModelConfig = D1 ('MetaData "MultiModelConfig" "Amazonka.SageMaker.Types.MultiModelConfig" "libZSservicesZSamazonka-sagemakerZSamazonka-sagemaker" 'False) (C1 ('MetaCons "MultiModelConfig'" 'PrefixI 'True) (S1 ('MetaSel ('Just "modelCacheSetting") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe ModelCacheSetting))))

newMultiModelConfig :: MultiModelConfig Source #

Create a value of MultiModelConfig with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:modelCacheSetting:MultiModelConfig', multiModelConfig_modelCacheSetting - Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.

multiModelConfig_modelCacheSetting :: Lens' MultiModelConfig (Maybe ModelCacheSetting) Source #

Whether to cache models for a multi-model endpoint. By default, multi-model endpoints cache models so that a model does not have to be loaded into memory each time it is invoked. Some use cases do not benefit from model caching. For example, if an endpoint hosts a large number of models that are each invoked infrequently, the endpoint might perform better if you disable model caching. To disable model caching, set the value of this parameter to Disabled.