Package org.apache.flink.cdc.debezium.event

Class DebeziumEventDeserializationSchema

java.lang.Object

org.apache.flink.cdc.debezium.event.SourceRecordEventDeserializer

org.apache.flink.cdc.debezium.event.DebeziumEventDeserializationSchema

All Implemented Interfaces:

Serializable, org.apache.flink.api.java.typeutils.ResultTypeQueryable<Event>, EventDeserializer<org.apache.kafka.connect.source.SourceRecord>, DebeziumDeserializationSchema<Event>

Direct Known Subclasses:

MySqlEventDeserializer, OracleEventDeserializer, PostgresEventDeserializer, SqlServerEventDeserializer

@Internal
public abstract class DebeziumEventDeserializationSchema
extends SourceRecordEventDeserializer
implements DebeziumDeserializationSchema<Event>

Debezium event deserializer for SourceRecord.

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field	Description
protected DebeziumChangelogMode	changelogMode	Changelog Mode to use for encoding changes in Flink internal data structure.
protected SchemaDataTypeInference	schemaDataTypeInference	The schema data type inference.

Constructor Summary

Constructors

Constructor	Description
DebeziumEventDeserializationSchema(SchemaDataTypeInference schemaDataTypeInference, DebeziumChangelogMode changelogMode)

Method Summary

Modifier and Type	Method	Description
void	applyChangeEvent(ChangeEvent changeEvent)
protected Object	convertToArray(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToBinary(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToBoolean(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToByte(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToDate(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToDecimal(DecimalType decimalType, Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToDouble(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToFloat(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToInt(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToLocalTimeZoneTimestamp(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToLong(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToMap(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToRecord(RowType rowType, Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToShort(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToString(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToTime(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected Object	convertToTimestamp(Object dbzObj, org.apache.kafka.connect.data.Schema schema)
protected DeserializationRuntimeConverter	createNotNullConverter(DataType type)	Creates a runtime converter which assuming input object is not null.
void	deserialize(org.apache.kafka.connect.source.SourceRecord record, org.apache.flink.util.Collector<Event> out)	Deserialize the Debezium record, it is represented in Kafka SourceRecord.
List<DataChangeEvent>	deserializeDataChangeRecord(org.apache.kafka.connect.source.SourceRecord record)	Deserialize given data change record to DataChangeEvent.
protected RecordData	extractBeforeDataRecord(org.apache.kafka.connect.data.Struct value, org.apache.kafka.connect.data.Schema valueSchema)
Map<io.debezium.relational.TableId,CreateTableEvent>	getCreateTableEventCache()
org.apache.flink.api.common.typeinfo.TypeInformation<Event>	getProducedType()

Methods inherited from class org.apache.flink.cdc.debezium.event.SourceRecordEventDeserializer

deserialize, deserializeSchemaChangeRecord, fieldSchema, fieldStruct, getMetadata, getTableId, isDataChangeRecord, isSchemaChangeRecord

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

schemaDataTypeInference

protected final SchemaDataTypeInference schemaDataTypeInference

The schema data type inference.

changelogMode

protected final DebeziumChangelogMode changelogMode

Changelog Mode to use for encoding changes in Flink internal data structure.

Constructor Detail

DebeziumEventDeserializationSchema

public DebeziumEventDeserializationSchema(SchemaDataTypeInference schemaDataTypeInference,
                                          DebeziumChangelogMode changelogMode)

Method Detail

deserialize

public void deserialize(org.apache.kafka.connect.source.SourceRecord record,
                        org.apache.flink.util.Collector<Event> out)
                 throws Exception

Description copied from interface: DebeziumDeserializationSchema

Deserialize the Debezium record, it is represented in Kafka SourceRecord.

Specified by:

deserialize in interface DebeziumDeserializationSchema<Event>

Throws:

Exception

deserializeDataChangeRecord

public List<DataChangeEvent> deserializeDataChangeRecord(org.apache.kafka.connect.source.SourceRecord record)
                                                  throws Exception

Description copied from class: SourceRecordEventDeserializer

Deserialize given data change record to DataChangeEvent.

Specified by:

deserializeDataChangeRecord in class SourceRecordEventDeserializer

Throws:

Exception

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<Event> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<Event>

extractBeforeDataRecord

protected RecordData extractBeforeDataRecord(org.apache.kafka.connect.data.Struct value,
                                             org.apache.kafka.connect.data.Schema valueSchema)
                                      throws Exception

Throws:

Exception

createNotNullConverter

protected DeserializationRuntimeConverter createNotNullConverter(DataType type)

Creates a runtime converter which assuming input object is not null.

convertToBoolean

protected Object convertToBoolean(Object dbzObj,
                                  org.apache.kafka.connect.data.Schema schema)

convertToByte

protected Object convertToByte(Object dbzObj,
                               org.apache.kafka.connect.data.Schema schema)

convertToShort

protected Object convertToShort(Object dbzObj,
                                org.apache.kafka.connect.data.Schema schema)

convertToInt

protected Object convertToInt(Object dbzObj,
                              org.apache.kafka.connect.data.Schema schema)

convertToLong

protected Object convertToLong(Object dbzObj,
                               org.apache.kafka.connect.data.Schema schema)

convertToDouble

protected Object convertToDouble(Object dbzObj,
                                 org.apache.kafka.connect.data.Schema schema)

convertToFloat

protected Object convertToFloat(Object dbzObj,
                                org.apache.kafka.connect.data.Schema schema)

convertToDate

protected Object convertToDate(Object dbzObj,
                               org.apache.kafka.connect.data.Schema schema)

convertToTime

protected Object convertToTime(Object dbzObj,
                               org.apache.kafka.connect.data.Schema schema)

convertToTimestamp

protected Object convertToTimestamp(Object dbzObj,
                                    org.apache.kafka.connect.data.Schema schema)

convertToLocalTimeZoneTimestamp

protected Object convertToLocalTimeZoneTimestamp(Object dbzObj,
                                                 org.apache.kafka.connect.data.Schema schema)

convertToString

protected Object convertToString(Object dbzObj,
                                 org.apache.kafka.connect.data.Schema schema)

convertToBinary

protected Object convertToBinary(Object dbzObj,
                                 org.apache.kafka.connect.data.Schema schema)

convertToDecimal

protected Object convertToDecimal(DecimalType decimalType,
                                  Object dbzObj,
                                  org.apache.kafka.connect.data.Schema schema)

convertToRecord

protected Object convertToRecord(RowType rowType,
                                 Object dbzObj,
                                 org.apache.kafka.connect.data.Schema schema)
                          throws Exception

Throws:

Exception

convertToMap

protected Object convertToMap(Object dbzObj,
                              org.apache.kafka.connect.data.Schema schema)
                       throws Exception

Throws:

Exception

convertToArray

protected Object convertToArray(Object dbzObj,
                                org.apache.kafka.connect.data.Schema schema)
                         throws Exception

Throws:

Exception

getCreateTableEventCache

public Map<io.debezium.relational.TableId,CreateTableEvent> getCreateTableEventCache()

applyChangeEvent

public void applyChangeEvent(ChangeEvent changeEvent)