libZSservicesZSamazonka-glueZSamazonka-glue
Copyright(c) 2013-2021 Brendan Hay
LicenseMozilla Public License, v. 2.0.
MaintainerBrendan Hay <brendan.g.hay+amazonka@gmail.com>
Stabilityauto-generated
Portabilitynon-portable (GHC extensions)
Safe HaskellNone

Amazonka.Glue.CreateCrawler

Description

Creates a new crawler with specified targets, role, configuration, and optional schedule. At least one crawl target must be specified, in the s3Targets field, the jdbcTargets field, or the DynamoDBTargets field.

Synopsis

Creating a Request

data CreateCrawler Source #

See: newCreateCrawler smart constructor.

Constructors

CreateCrawler' 

Fields

Instances

Instances details
Eq CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Read CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Show CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Generic CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Associated Types

type Rep CreateCrawler :: Type -> Type #

NFData CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Methods

rnf :: CreateCrawler -> () #

Hashable CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

ToJSON CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

AWSRequest CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Associated Types

type AWSResponse CreateCrawler #

ToHeaders CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

ToPath CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

ToQuery CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

type Rep CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

type Rep CreateCrawler = D1 ('MetaData "CreateCrawler" "Amazonka.Glue.CreateCrawler" "libZSservicesZSamazonka-glueZSamazonka-glue" 'False) (C1 ('MetaCons "CreateCrawler'" 'PrefixI 'True) (((S1 ('MetaSel ('Just "schemaChangePolicy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaChangePolicy)) :*: (S1 ('MetaSel ('Just "schedule") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "recrawlPolicy") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe RecrawlPolicy)))) :*: ((S1 ('MetaSel ('Just "classifiers") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe [Text])) :*: S1 ('MetaSel ('Just "databaseName") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text))) :*: (S1 ('MetaSel ('Just "crawlerSecurityConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "lineageConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe LineageConfiguration))))) :*: ((S1 ('MetaSel ('Just "configuration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: (S1 ('MetaSel ('Just "tablePrefix") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)) :*: S1 ('MetaSel ('Just "description") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Text)))) :*: ((S1 ('MetaSel ('Just "tags") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe (HashMap Text Text))) :*: S1 ('MetaSel ('Just "name") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text)) :*: (S1 ('MetaSel ('Just "role'") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Text) :*: S1 ('MetaSel ('Just "targets") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 CrawlerTargets))))))
type AWSResponse CreateCrawler Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

newCreateCrawler Source #

Create a value of CreateCrawler with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:schemaChangePolicy:CreateCrawler', createCrawler_schemaChangePolicy - The policy for the crawler's update and deletion behavior.

$sel:schedule:CreateCrawler', createCrawler_schedule - A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

$sel:recrawlPolicy:CreateCrawler', createCrawler_recrawlPolicy - A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

$sel:classifiers:CreateCrawler', createCrawler_classifiers - A list of custom classifiers that the user has registered. By default, all built-in classifiers are included in a crawl, but these custom classifiers always override the default classifiers for a given classification.

$sel:databaseName:CreateCrawler', createCrawler_databaseName - The Glue database where results are written, such as: arn:aws:daylight:us-east-1::database/sometable/*.

$sel:crawlerSecurityConfiguration:CreateCrawler', createCrawler_crawlerSecurityConfiguration - The name of the SecurityConfiguration structure to be used by this crawler.

$sel:lineageConfiguration:CreateCrawler', createCrawler_lineageConfiguration - Specifies data lineage configuration settings for the crawler.

$sel:configuration:CreateCrawler', createCrawler_configuration - Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Configuring a Crawler.

$sel:tablePrefix:CreateCrawler', createCrawler_tablePrefix - The table prefix used for catalog tables that are created.

$sel:description:CreateCrawler', createCrawler_description - A description of the new crawler.

$sel:tags:CreateCrawler', createCrawler_tags - The tags to use with this crawler request. You may use tags to limit access to the crawler. For more information about tags in Glue, see Amazon Web Services Tags in Glue in the developer guide.

$sel:name:CreateCrawler', createCrawler_name - Name of the new crawler.

$sel:role':CreateCrawler', createCrawler_role - The IAM role or Amazon Resource Name (ARN) of an IAM role used by the new crawler to access customer resources.

$sel:targets:CreateCrawler', createCrawler_targets - A list of collection of targets to crawl.

Request Lenses

createCrawler_schemaChangePolicy :: Lens' CreateCrawler (Maybe SchemaChangePolicy) Source #

The policy for the crawler's update and deletion behavior.

createCrawler_schedule :: Lens' CreateCrawler (Maybe Text) Source #

A cron expression used to specify the schedule (see Time-Based Schedules for Jobs and Crawlers. For example, to run something every day at 12:15 UTC, you would specify: cron(15 12 * * ? *).

createCrawler_recrawlPolicy :: Lens' CreateCrawler (Maybe RecrawlPolicy) Source #

A policy that specifies whether to crawl the entire dataset again, or to crawl only folders that were added since the last crawler run.

createCrawler_classifiers :: Lens' CreateCrawler (Maybe [Text]) Source #

A list of custom classifiers that the user has registered. By default, all built-in classifiers are included in a crawl, but these custom classifiers always override the default classifiers for a given classification.

createCrawler_databaseName :: Lens' CreateCrawler (Maybe Text) Source #

The Glue database where results are written, such as: arn:aws:daylight:us-east-1::database/sometable/*.

createCrawler_crawlerSecurityConfiguration :: Lens' CreateCrawler (Maybe Text) Source #

The name of the SecurityConfiguration structure to be used by this crawler.

createCrawler_lineageConfiguration :: Lens' CreateCrawler (Maybe LineageConfiguration) Source #

Specifies data lineage configuration settings for the crawler.

createCrawler_configuration :: Lens' CreateCrawler (Maybe Text) Source #

Crawler configuration information. This versioned JSON string allows users to specify aspects of a crawler's behavior. For more information, see Configuring a Crawler.

createCrawler_tablePrefix :: Lens' CreateCrawler (Maybe Text) Source #

The table prefix used for catalog tables that are created.

createCrawler_description :: Lens' CreateCrawler (Maybe Text) Source #

A description of the new crawler.

createCrawler_tags :: Lens' CreateCrawler (Maybe (HashMap Text Text)) Source #

The tags to use with this crawler request. You may use tags to limit access to the crawler. For more information about tags in Glue, see Amazon Web Services Tags in Glue in the developer guide.

createCrawler_name :: Lens' CreateCrawler Text Source #

Name of the new crawler.

createCrawler_role :: Lens' CreateCrawler Text Source #

The IAM role or Amazon Resource Name (ARN) of an IAM role used by the new crawler to access customer resources.

createCrawler_targets :: Lens' CreateCrawler CrawlerTargets Source #

A list of collection of targets to crawl.

Destructuring the Response

data CreateCrawlerResponse Source #

See: newCreateCrawlerResponse smart constructor.

Constructors

CreateCrawlerResponse' 

Fields

Instances

Instances details
Eq CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Read CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Show CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Generic CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Associated Types

type Rep CreateCrawlerResponse :: Type -> Type #

NFData CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

Methods

rnf :: CreateCrawlerResponse -> () #

type Rep CreateCrawlerResponse Source # 
Instance details

Defined in Amazonka.Glue.CreateCrawler

type Rep CreateCrawlerResponse = D1 ('MetaData "CreateCrawlerResponse" "Amazonka.Glue.CreateCrawler" "libZSservicesZSamazonka-glueZSamazonka-glue" 'False) (C1 ('MetaCons "CreateCrawlerResponse'" 'PrefixI 'True) (S1 ('MetaSel ('Just "httpStatus") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 Int)))

newCreateCrawlerResponse Source #

Create a value of CreateCrawlerResponse with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:httpStatus:CreateCrawlerResponse', createCrawlerResponse_httpStatus - The response's http status code.

Response Lenses