Copyright	(c) 2013-2021 Brendan Hay
License	Mozilla Public License, v. 2.0.
Maintainer	Brendan Hay <brendan.g.hay+amazonka@gmail.com>
Stability	auto-generated
Portability	non-portable (GHC extensions)
Safe Haskell	None

Amazonka.SageMaker.Types.DatasetDefinition

Description

Documentation

data DatasetDefinition Source #

Configuration for Dataset Definition inputs. The Dataset Definition input must specify exactly one of either AthenaDatasetDefinition or RedshiftDatasetDefinition types.

See: newDatasetDefinition smart constructor.

Constructors

DatasetDefinition'

Fields

redshiftDatasetDefinition :: Maybe RedshiftDatasetDefinition
athenaDatasetDefinition :: Maybe AthenaDatasetDefinition
localPath :: Maybe Text
The local path where you want Amazon SageMaker to download the Dataset Definition inputs to run a processing job. LocalPath is an absolute path to the input data. This is a required parameter when AppManaged is False (default).
dataDistributionType :: Maybe DataDistributionType
Whether the generated dataset is FullyReplicated or ShardedByS3Key (default).
inputMode :: Maybe InputMode
Whether to use File or Pipe input mode. In File (default) mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

Instances

Instances details

Eq DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods (==) :: DatasetDefinition -> DatasetDefinition -> Bool # (/=) :: DatasetDefinition -> DatasetDefinition -> Bool #
Read DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods readsPrec :: Int -> ReadS DatasetDefinition # readList :: ReadS [DatasetDefinition] # readPrec :: ReadPrec DatasetDefinition # readListPrec :: ReadPrec [DatasetDefinition] #
Show DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods showsPrec :: Int -> DatasetDefinition -> ShowS # show :: DatasetDefinition -> String # showList :: [DatasetDefinition] -> ShowS #
Generic DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Associated Types type Rep DatasetDefinition :: Type -> Type # Methods from :: DatasetDefinition -> Rep DatasetDefinition x # to :: Rep DatasetDefinition x -> DatasetDefinition #
NFData DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods rnf :: DatasetDefinition -> () #
Hashable DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods hashWithSalt :: Int -> DatasetDefinition -> Int # hash :: DatasetDefinition -> Int #
ToJSON DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods toJSON :: DatasetDefinition -> Value # toEncoding :: DatasetDefinition -> Encoding # toJSONList :: [DatasetDefinition] -> Value # toEncodingList :: [DatasetDefinition] -> Encoding #
FromJSON DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition Methods parseJSON :: Value -> Parser DatasetDefinition # parseJSONList :: Value -> Parser [DatasetDefinition] #
type Rep DatasetDefinition Source #
Instance details Defined in Amazonka.SageMaker.Types.DatasetDefinition type Rep DatasetDefinition = D1 ('MetaData "DatasetDefinition" "Amazonka.SageMaker.Types.DatasetDefinition" "libZSservicesZSamazonka-sagemakerZSamazonka-sagemaker" 'False) (C1 ('MetaCons "DatasetDefinition'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "redshiftDatasetDefinition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RedshiftDatasetDefinition)) :: S1 ('MetaSel ('Just "athenaDatasetDefinition") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe AthenaDatasetDefinition))) :: (S1 ('MetaSel ('Just "localPath") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :: (S1 ('MetaSel ('Just "dataDistributionType") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe DataDistributionType)) :: S1 ('MetaSel ('Just "inputMode") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe InputMode))))))

newDatasetDefinition :: DatasetDefinition Source #

Create a value of DatasetDefinition with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:redshiftDatasetDefinition:DatasetDefinition', datasetDefinition_redshiftDatasetDefinition - Undocumented member.

$sel:athenaDatasetDefinition:DatasetDefinition', datasetDefinition_athenaDatasetDefinition - Undocumented member.

$sel:localPath:DatasetDefinition', datasetDefinition_localPath - The local path where you want Amazon SageMaker to download the Dataset Definition inputs to run a processing job. LocalPath is an absolute path to the input data. This is a required parameter when AppManaged is False (default).

$sel:dataDistributionType:DatasetDefinition', datasetDefinition_dataDistributionType - Whether the generated dataset is FullyReplicated or ShardedByS3Key (default).

$sel:inputMode:DatasetDefinition', datasetDefinition_inputMode - Whether to use File or Pipe input mode. In File (default) mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.

datasetDefinition_redshiftDatasetDefinition :: Lens' DatasetDefinition (Maybe RedshiftDatasetDefinition) Source #

Undocumented member.

datasetDefinition_athenaDatasetDefinition :: Lens' DatasetDefinition (Maybe AthenaDatasetDefinition) Source #

Undocumented member.

datasetDefinition_localPath :: Lens' DatasetDefinition (Maybe Text) Source #

The local path where you want Amazon SageMaker to download the Dataset Definition inputs to run a processing job. LocalPath is an absolute path to the input data. This is a required parameter when AppManaged is False (default).

datasetDefinition_dataDistributionType :: Lens' DatasetDefinition (Maybe DataDistributionType) Source #

Whether the generated dataset is FullyReplicated or ShardedByS3Key (default).

datasetDefinition_inputMode :: Lens' DatasetDefinition (Maybe InputMode) Source #

Whether to use File or Pipe input mode. In File (default) mode, Amazon SageMaker copies the data from the input source onto the local Amazon Elastic Block Store (Amazon EBS) volumes before starting your training algorithm. This is the most commonly used input mode. In Pipe mode, Amazon SageMaker streams input data from the source directly to your algorithm without using the EBS volume.