Package org.apache.flink.cdc.connectors.paimon.sink.v2

Class PaimonWriterHelper

java.lang.Object

org.apache.flink.cdc.connectors.paimon.sink.v2.PaimonWriterHelper

public class PaimonWriterHelper
extends Object

A helper class to deduce Schema of paimon table for BucketAssignOperator, and create FieldGetter and GenericRow for PaimonWriter.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	PaimonWriterHelper.BinaryFieldDataGetter	A helper class for PaimonWriter to create FieldGetter and GenericRow.

Constructor Summary

Constructors

Constructor	Description
PaimonWriterHelper()

Method Summary

Modifier and Type	Method	Description
static List<org.apache.paimon.data.GenericRow>	convertEventToFullGenericRows(DataChangeEvent dataChangeEvent, List<RecordData.FieldGetter> fieldGetters, boolean hasPrimaryKey)	create full GenericRows from a DataChangeEvent for PaimonWriter.
static org.apache.paimon.data.GenericRow	convertEventToGenericRow(DataChangeEvent dataChangeEvent, List<RecordData.FieldGetter> fieldGetters)	create a GenericRow from a DataChangeEvent for PaimonWriter.
static List<RecordData.FieldGetter>	createFieldGetters(Schema schema, java.time.ZoneId zoneId)	create a list of RecordData.FieldGetter for PaimonWriter.
static List<RecordData.FieldGetter>	createFieldGetters(Schema schema, java.time.ZoneId zoneId, BlobWriteContext blobWriteContext)	create a list of RecordData.FieldGetter for PaimonWriter with BLOB support.
static Schema	deduceSchemaForPaimonTable(org.apache.paimon.table.Table table)	Deduce Schema for a Table.
static org.apache.paimon.catalog.Identifier	identifierFromTableId(TableId tableId)
static Boolean	sameColumnsIgnoreCommentAndDefaultValue(Schema upstreamSchema, Schema physicalSchema)	Check if the columns of upstream schema is the same as the physical schema.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PaimonWriterHelper

public PaimonWriterHelper()

Method Detail

createFieldGetters

public static List<RecordData.FieldGetter> createFieldGetters(Schema schema,
                                                              java.time.ZoneId zoneId)

create a list of RecordData.FieldGetter for PaimonWriter.

createFieldGetters

public static List<RecordData.FieldGetter> createFieldGetters(Schema schema,
                                                              java.time.ZoneId zoneId,
                                                              @Nullable
                                                              BlobWriteContext blobWriteContext)

create a list of RecordData.FieldGetter for PaimonWriter with BLOB support.

Parameters:

schema - The CDC schema containing column definitions.

zoneId - The timezone for timestamp conversion.

blobWriteContext - Optional context for BLOB field handling.

Returns:

List of FieldGetter for converting CDC data to Paimon data.

sameColumnsIgnoreCommentAndDefaultValue

public static Boolean sameColumnsIgnoreCommentAndDefaultValue(Schema upstreamSchema,
                                                              Schema physicalSchema)

Check if the columns of upstream schema is the same as the physical schema.

Note: Default value of column was ignored as it has no influence in createFieldGetter(DataType, int, ZoneId).

convertEventToGenericRow

public static org.apache.paimon.data.GenericRow convertEventToGenericRow(DataChangeEvent dataChangeEvent,
                                                                         List<RecordData.FieldGetter> fieldGetters)

create a GenericRow from a DataChangeEvent for PaimonWriter.

convertEventToFullGenericRows

public static List<org.apache.paimon.data.GenericRow> convertEventToFullGenericRows(DataChangeEvent dataChangeEvent,
                                                                                    List<RecordData.FieldGetter> fieldGetters,
                                                                                    boolean hasPrimaryKey)

create full GenericRows from a DataChangeEvent for PaimonWriter.

deduceSchemaForPaimonTable

public static Schema deduceSchemaForPaimonTable(org.apache.paimon.table.Table table)

Deduce Schema for a Table.

Note: default value was not included in the result.

identifierFromTableId

public static org.apache.paimon.catalog.Identifier identifierFromTableId(TableId tableId)