Copyright	(c) 2013-2021 Brendan Hay
License	Mozilla Public License, v. 2.0.
Maintainer	Brendan Hay <brendan.g.hay+amazonka@gmail.com>
Stability	auto-generated
Portability	non-portable (GHC extensions)
Safe Haskell	None

Amazonka.Firehose.Types.DataFormatConversionConfiguration

Description

Documentation

data DataFormatConversionConfiguration Source #

Specifies that you want Kinesis Data Firehose to convert data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. Kinesis Data Firehose uses the serializer and deserializer that you specify, in addition to the column information from the AWS Glue table, to deserialize your input data from JSON and then serialize it to the Parquet or ORC format. For more information, see Kinesis Data Firehose Record Format Conversion.

See: newDataFormatConversionConfiguration smart constructor.

Constructors

DataFormatConversionConfiguration'

Fields

outputFormatConfiguration :: Maybe OutputFormatConfiguration
Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.
enabled :: Maybe Bool
Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.
schemaConfiguration :: Maybe SchemaConfiguration
Specifies the AWS Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.
inputFormatConfiguration :: Maybe InputFormatConfiguration
Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.

Instances

Instances details

Eq DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods (==) :: DataFormatConversionConfiguration -> DataFormatConversionConfiguration -> Bool # (/=) :: DataFormatConversionConfiguration -> DataFormatConversionConfiguration -> Bool #
Read DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods readsPrec :: Int -> ReadS DataFormatConversionConfiguration # readList :: ReadS [DataFormatConversionConfiguration] # readPrec :: ReadPrec DataFormatConversionConfiguration # readListPrec :: ReadPrec [DataFormatConversionConfiguration] #
Show DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods showsPrec :: Int -> DataFormatConversionConfiguration -> ShowS # show :: DataFormatConversionConfiguration -> String # showList :: [DataFormatConversionConfiguration] -> ShowS #
Generic DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Associated Types type Rep DataFormatConversionConfiguration :: Type -> Type # Methods from :: DataFormatConversionConfiguration -> Rep DataFormatConversionConfiguration x # to :: Rep DataFormatConversionConfiguration x -> DataFormatConversionConfiguration #
NFData DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods rnf :: DataFormatConversionConfiguration -> () #
Hashable DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods hashWithSalt :: Int -> DataFormatConversionConfiguration -> Int # hash :: DataFormatConversionConfiguration -> Int #
ToJSON DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods toJSON :: DataFormatConversionConfiguration -> Value # toEncoding :: DataFormatConversionConfiguration -> Encoding # toJSONList :: [DataFormatConversionConfiguration] -> Value # toEncodingList :: [DataFormatConversionConfiguration] -> Encoding #
FromJSON DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration Methods parseJSON :: Value -> Parser DataFormatConversionConfiguration # parseJSONList :: Value -> Parser [DataFormatConversionConfiguration] #
type Rep DataFormatConversionConfiguration Source #
Instance details Defined in Amazonka.Firehose.Types.DataFormatConversionConfiguration type Rep DataFormatConversionConfiguration = D1 ('MetaData "DataFormatConversionConfiguration" "Amazonka.Firehose.Types.DataFormatConversionConfiguration" "libZSservicesZSamazonka-kinesis-firehoseZSamazonka-kinesis-firehose" 'False) (C1 ('MetaCons "DataFormatConversionConfiguration'" 'PrefixI 'True) ((S1 ('MetaSel ('Just "outputFormatConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe OutputFormatConfiguration)) :: S1 ('MetaSel ('Just "enabled") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe Bool))) :: (S1 ('MetaSel ('Just "schemaConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe SchemaConfiguration)) :*: S1 ('MetaSel ('Just "inputFormatConfiguration") 'NoSourceUnpackedness 'NoSourceStrictness 'DecidedStrict) (Rec0 (Maybe InputFormatConfiguration)))))

newDataFormatConversionConfiguration :: DataFormatConversionConfiguration Source #

Create a value of DataFormatConversionConfiguration with all optional fields omitted.

Use generic-lens or optics to modify other optional fields.

The following record fields are available, with the corresponding lenses provided for backwards compatibility:

$sel:outputFormatConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_outputFormatConfiguration - Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.

$sel:enabled:DataFormatConversionConfiguration', dataFormatConversionConfiguration_enabled - Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.

$sel:schemaConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_schemaConfiguration - Specifies the AWS Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.

$sel:inputFormatConfiguration:DataFormatConversionConfiguration', dataFormatConversionConfiguration_inputFormatConfiguration - Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_outputFormatConfiguration :: Lens' DataFormatConversionConfiguration (Maybe OutputFormatConfiguration) Source #

Specifies the serializer that you want Kinesis Data Firehose to use to convert the format of your data to the Parquet or ORC format. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_enabled :: Lens' DataFormatConversionConfiguration (Maybe Bool) Source #

Defaults to true. Set it to false if you want to disable format conversion while preserving the configuration details.

dataFormatConversionConfiguration_schemaConfiguration :: Lens' DataFormatConversionConfiguration (Maybe SchemaConfiguration) Source #

Specifies the AWS Glue Data Catalog table that contains the column information. This parameter is required if Enabled is set to true.

dataFormatConversionConfiguration_inputFormatConfiguration :: Lens' DataFormatConversionConfiguration (Maybe InputFormatConfiguration) Source #

Specifies the deserializer that you want Kinesis Data Firehose to use to convert the format of your data from JSON. This parameter is required if Enabled is set to true.