libZSservicesZSamazonka-glueZSamazonka-glue
Copyright(c) 2013-2021 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay <brendan.g.hay+amazonka@gmail.com>
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellNone

Amazonka.Glue.Types.S3Target

Description

 
Synopsis

Documentation

data S3Target Source #

Specifies a data store in Amazon Simple Storage Service (Amazon S3).

See: newS3Target smart constructor.

Constructors

S3Target' 

Fields

  • path :: Maybe Text

    The path to the Amazon S3 target.

  • sampleSize :: Maybe Int

    Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

  • connectionName :: Maybe Text

    The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

  • exclusions :: Maybe [Text]

    A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

  • eventQueueArn :: Maybe Text

    A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

  • dlqEventQueueArn :: Maybe Text

    A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

Instances

Instances details
Eq S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Read S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Show S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Generic S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Associated Types

type Rep S3Target :: Type -> Type #

Methods

from :: S3Target -> Rep S3Target x #

to :: Rep S3Target x -> S3Target #

NFData S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Methods

rnf :: S3Target -> () #

Hashable S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

Methods

hashWithSalt :: Int -> S3Target -> Int #

hash :: S3Target -> Int #

ToJSON S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

FromJSON S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

type Rep S3Target Source # 
Instance details

Defined in Amazonka.Glue.Types.S3Target

type Rep S3Target = D1 ('MetaData "S3Target" "Amazonka.Glue.Types.S3Target" "libZSservicesZSamazonka-glueZSamazonka-glue" 'False) (C1 ('MetaCons "S3Target'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "path") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "sampleSize") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Int)) :*: S1 ('MetaSel ('Just "connectionName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: (S1 ('MetaSel ('Just "exclusions") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: (S1 ('MetaSel ('Just "eventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "dlqEventQueueArn") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))))))

newS3Target :: S3Target Source #

Create a value of S3Target with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:path:S3Target', s3Target_path - The path to the Amazon S3 target.

$sel:sampleSize:S3Target', s3Target_sampleSize - Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

$sel:connectionName:S3Target', s3Target_connectionName - The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

$sel:exclusions:S3Target', s3Target_exclusions - A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

$sel:eventQueueArn:S3Target', s3Target_eventQueueArn - A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

$sel:dlqEventQueueArn:S3Target', s3Target_dlqEventQueueArn - A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.

s3Target_path :: Lens' S3Target (Maybe Text) Source #

The path to the Amazon S3 target.

s3Target_sampleSize :: Lens' S3Target (Maybe Int) Source #

Sets the number of files in each leaf folder to be crawled when crawling sample files in a dataset. If not set, all the files are crawled. A valid value is an integer between 1 and 249.

s3Target_connectionName :: Lens' S3Target (Maybe Text) Source #

The name of a connection which allows a job or crawler to access data in Amazon S3 within an Amazon Virtual Private Cloud environment (Amazon VPC).

s3Target_exclusions :: Lens' S3Target (Maybe [Text]) Source #

A list of glob patterns used to exclude from the crawl. For more information, see Catalog Tables with a Crawler.

s3Target_eventQueueArn :: Lens' S3Target (Maybe Text) Source #

A valid Amazon SQS ARN. For example, arn:aws:sqs:region:account:sqs.

s3Target_dlqEventQueueArn :: Lens' S3Target (Maybe Text) Source #

A valid Amazon dead-letter SQS ARN. For example, arn:aws:sqs:region:account:deadLetterQueue.